00000001:02000400:3.0F:1788528173.139265:0:3292:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788528187.065091:0:3514:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788528188.801776:0:3577:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 831 MB/s 00000001:01000000:1.0F:1788528189.051963:0:3577:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1367 MB/s 00000001:01000000:0.0:1788528189.302162:0:3577:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5787 MB/s 00000020:02000000:2.0:1788528189.992517:0:3606:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_4_g0efcf2a 00000400:02000000:1.0:1788528190.973036:0:3621:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.138@tcp [8/256/0/180] 00008000:02000000:1.0:1788528194.673897:0:3771:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1788528245.768837:0:5736:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788528256.999799:0:6485:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:0.0:1788528256.999805:0:6485:0:(obd_mount.c:928:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788528256.999806:0:6485:0:(obd_mount.c:931:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788528256.999915:0:6485:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000d049db85 00000080:02000400:0.0:1788528256.999924:0:6485:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1788528257.011992:0:6485:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1788528257.012006:0:6485:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788528257.012038:0:6485:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000530d5c45) 00000020:00000080:0.0:1788528257.012055:0:6485:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788528257.082408:0:6485:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788528257.082599:0:6485:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1788528257.106923:0:6485:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788528257.107131:0:6485:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788528257.107140:0:6485:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788528257.107154:0:6485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x892c60dda91c748f 00000020:01000004:1.0:1788528257.107162:0:6485:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788528257.107169:0:6485:0:(tgt_mount.c:234:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788528257.107174:0:6485:0:(tgt_mount.c:115:server_register_mount()) register mount 00000000d049db85 from MGS 00000020:01000004:1.0:1788528257.107178:0:6485:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788528257.107198:0:6485:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000252bcd66) 00000020:00000080:1.0:1788528257.107207:0:6485:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788528257.108438:0:6485:0:(tgt_mount.c:167:server_get_mount()) get mount 00000000d049db85 from MGS, refs=2 00080000:01000000:1.0:1788528257.108450:0:6485:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788528257.108460:0:6485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x892c60dda91c749d 00000100:00100000:1.0:1788528257.108770:0:6485:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788528257.108930:0:6485:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788528257.108937:0:6485:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788528257.113728:0:6485:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788528257.113742:0:6485:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788528257.117101:0:6485:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788528257.117390:0:6485:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788528257.117406:0:6485:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788528257.119136:0:6485:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788528257.119146:0:6485:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788528257.120159:0:6485:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788528257.120170:0:6485:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788528257.121198:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528257.121202:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528257.121204:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528257.121786:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528257.121789:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528257.121790:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528257.122278:0:6485:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788528257.126385:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788528257.372022:0:6485:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2651 MB/s 00000001:01000000:0.0:1788528257.621655:0:6485:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3175 MB/s 00000001:01000000:2.0:1788528257.872632:0:6485:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 569 MB/s 00000001:01000000:1.0:1788528258.122974:0:6485:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 635 MB/s 00080000:10000000:2.0:1788528258.133000:0:6485:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:0.0:1788528258.147474:0:6485:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788528258.149955:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788528258.150014:0:6485:0:(mgs_nids.c:671:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788528258.150052:0:6485:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788528258.150248:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788528258.150269:0:6485:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788528258.150890:0:6485:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788528258.151076:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788528258.151085:0:6485:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788528258.151871:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788528258.151880:0:6485:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788528258.152756:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788528258.152766:0:6485:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788528258.153346:0:6485:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788528258.153368:0:6485:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.138@tcp' 00000020:01000004:0.0:1788528258.153370:0:6485:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788528258.153444:0:6485:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.138@tcp (typ=mgc) 00000020:00000080:0.0:1788528258.153456:0:6485:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.138@tcp (0000000029115776) 00000020:00000080:0.0:1788528258.153480:0:6485:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:2.0:1788528258.153662:0:6503:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:0.0:1788528258.154798:0:6485:0:(ldlm_lib.c:102:import_set_conn()) imp 000000001d223636@MGC192.168.203.138@tcp: add connection 192.168.203.138@tcp at head 00010000:00010000:0.0:1788528258.154983:0:6485:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.138@tcp-0 is initialized 00000040:01000000:0.0:1788528258.154991:0:6485:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00010000:00010000:0.0:1788528258.182234:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788528258.184924:0:6506:0:(mgc_request.c:839:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788528258.185025:0:6485:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.138@tcp (uuid dd052447-840d-4bcc-891b-140c465c7625) 00000020:00000080:2.0:1788528258.185069:0:6485:0:(genops.c:1385:class_connect()) connect: client dd052447-840d-4bcc-891b-140c465c7625, cookie 0x892c60dda91c74ab 00000100:00080000:2.0:1788528258.185084:0:6485:0:(import.c:545:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788528258.185090:0:6485:0:(import.c:665:import_select_connection()) MGC192.168.203.138@tcp: import 000000001d223636 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1788528258.185149:0:6485:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fc35bb90 x1875407735357568/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788528258.185179:0:6485:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import dd052447-840d-4bcc-891b-140c465c7625->MGS 00000020:01000004:2.0:1788528258.185203:0:6485:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788528258.185208:0:6485:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788528258.185229:0:6485:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000b577cb8f) 00000020:00000080:2.0:1788528258.185241:0:6485:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788528258.185566:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc35bb90 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd052447-840d-4bcc-891b-140c465c7625:3636:1875407735357568:0@lo:250: 00000100:00100000:1.0:1788528258.185671:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528258.185874:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735357568 00000100:00100000:0.0:1788528258.185884:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735357568 00000100:00100000:0.0:1788528258.185924:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788528258.185931:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d36634b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3636:x1875407735357568:12345-0@lo:250: 00010000:00080000:0.0:1788528258.185957:0:6500:0:(ldlm_lib.c:1458:target_handle_connect()) MGS: connection from dd052447-840d-4bcc-891b-140c465c7625@0@lo t0 exp 0000000000000000 cur 127 last 0 00000020:00000080:0.0:1788528258.185993:0:6500:0:(genops.c:1385:class_connect()) connect: client dd052447-840d-4bcc-891b-140c465c7625, cookie 0x892c60dda91c74b9 00000100:00080000:0.0:1788528258.186131:0:6500:0:(import.c:65:import_set_state_nolock()) 00000000d87e3ec1 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788528258.186220:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d36634b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+5:3636:x1875407735357568:12345-0@lo:250: Request processed in 288us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528258.186228:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788528258.186603:0:3636:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.138@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788528258.186614:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.138@tcp: connect to target with instance 0 00000100:00080000:1.0:1788528258.186622:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.138@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788528258.186627:0:3636:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788528258.186629:0:3636:0:(import.c:65:import_set_state_nolock()) 000000001d223636 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788528258.186632:0:3636:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788528258.186647:0:3636:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788528258.186653:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc35bb90 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd052447-840d-4bcc-891b-140c465c7625:3636:1875407735357568:0@lo:250: 00000100:00100000:2.0:1788528258.208149:0:6485:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788528258.208353:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788528258.208360:0:6485:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788528258.210208:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788528258.210223:0:6485:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788528258.210701:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788528258.210707:0:6485:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788528258.224171:0:6485:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788528258.225246:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788528258.225258:0:6485:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788528258.228283:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788528258.228299:0:6485:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788528258.293270:0:6485:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788528258.295179:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788528258.295189:0:6485:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788528258.301833:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788528258.301849:0:6485:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788528258.302749:0:6485:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788528258.303220:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788528258.303227:0:6485:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788528258.309302:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788528258.309322:0:6485:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788528258.312509:0:6485:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788528258.312727:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788528258.312733:0:6485:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788528258.318291:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788528258.318306:0:6485:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788528258.319200:0:6485:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788528258.319408:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788528258.319413:0:6485:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788528258.320355:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788528258.320364:0:6485:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788528258.341259:0:6485:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788528258.341480:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788528258.341487:0:6485:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788528258.343113:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788528258.343133:0:6485:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788528258.344179:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788528258.344190:0:6485:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788528258.345083:0:6485:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788528258.345124:0:6485:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.138@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788528258.345130:0:6485:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788528258.345132:0:6485:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788528258.345133:0:6485:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788528258.345134:0:6485:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788528258.345135:0:6485:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788528258.345136:0:6485:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788528258.345138:0:6485:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788528258.345139:0:6485:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788528258.345140:0:6485:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788528258.345141:0:6485:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788528258.345143:0:6485:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788528258.345144:0:6485:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788528258.345148:0:6485:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788528258.345151:0:6485:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788528258.345152:0:6485:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788528258.345153:0:6485:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788528258.345154:0:6485:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788528258.345155:0:6485:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788528258.345155:0:6485:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788528258.345156:0:6485:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788528258.345157:0:6485:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788528258.345158:0:6485:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788528258.345159:0:6485:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788528258.345160:0:6485:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788528258.345160:0:6485:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788528258.345194:0:6485:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788528258.345214:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000b717c8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735357696:0@lo:253: 00000100:00100000:2.0:1788528258.345289:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528258.345410:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set 0000000069ebfb52 going to sleep for 11 seconds 00000100:00100000:3.0:1788528258.345469:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735357696 00000100:00100000:3.0:1788528258.345478:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735357696 00000100:00100000:3.0:1788528258.345607:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788528258.345617:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c554c2e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+5:6485:x1875407735357696:12345-0@lo:253: 20000000:01000000:3.0:1788528258.345668:0:6502:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788528258.345671:0:6502:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788528258.346237:0:6524:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788528258.346287:0:6502:0:(mgs_nids.c:671:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788528258.346780:0:6502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788528258.347836:0:6525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788528258.348173:0:6502:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788528258.348177:0:6502:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788528258.348183:0:6502:0:(mgs_llog.c:875:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788528258.348186:0:6502:0:(mgs_llog.c:3618:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788528258.348198:0:6502:0:(mgs_llog.c:3178:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788528258.348369:0:6502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788528258.348874:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788528258.348890:0:6502:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788528258.348919:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788528258.348935:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788528258.348951:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788528258.349080:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788528258.349089:0:6502:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788528258.349103:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788528258.349108:0:6502:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788528258.349131:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788528258.349138:0:6502:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788528258.349152:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788528258.349168:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788528258.349197:0:6502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788528258.349203:0:6502:0:(mgs_llog.c:3178:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788528258.349209:0:6502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788528258.349301:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788528258.349311:0:6502:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788528258.349326:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788528258.349339:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788528258.349352:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788528258.349360:0:6502:0:(mgs_llog.c:3135:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788528258.349382:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788528258.349408:0:6502:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788528258.349422:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788528258.349449:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788528258.349464:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788528258.349472:0:6502:0:(mgs_llog.c:3100:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788528258.349496:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788528258.349503:0:6502:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788528258.349514:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788528258.349529:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788528258.349793:0:6502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788528258.349814:0:6502:0:(mgs_llog.c:3315:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788528258.349820:0:6502:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788528258.350345:0:6526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788528258.350545:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788528258.350717:0:6502:0:(mgs_llog.c:3361:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.138@tcp for mdt 20000000:01000000:3.0:1788528258.350720:0:6502:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.203.138@tcp (null) (null) (null) 00000040:00080000:3.0:1788528258.350738:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788528258.350744:0:6502:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788528258.350755:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788528258.350771:0:6502:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.138@tcp (null) (null) 00000040:00080000:3.0:1788528258.350785:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788528258.350791:0:6502:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788528258.350801:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788528258.350813:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788528258.350838:0:6502:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788528258.350841:0:6502:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788528258.350843:0:6502:0:(mgs_llog.c:4187:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788528258.350896:0:6502:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788528258.350963:0:6502:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788528258.351306:0:6527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788528258.351471:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788528258.351491:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788528258.351504:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1788528258.351515:0:6502:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788528258.351516:0:6502:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788528258.352066:0:6528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1788528258.352227:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788528258.352247:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1788528258.352274:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1788528258.352290:0:6502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788528258.352292:0:6502:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1788528258.352296:0:6502:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788528258.352298:0:6502:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788528258.352302:0:6502:0:(mgs_llog.c:5078:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788528258.352308:0:6502:0:(mgs_llog.c:1385:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788528258.352668:0:6529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1788528258.352789:0:6502:0:(mgs_llog.c:4126:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788528258.361118:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1788528258.361157:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1788528258.361171:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1788528258.361190:0:6502:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788528258.361212:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000522f37b2/0x892c60dda91c74c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528258.361244:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000522f37b2/0x892c60dda91c74c0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528258.361255:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000522f37b2/0x892c60dda91c74c0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528258.361261:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000522f37b2/0x892c60dda91c74c0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528258.361267:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000522f37b2/0x892c60dda91c74c0 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528258.361274:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000522f37b2/0x892c60dda91c74c0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528258.361280:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000522f37b2 already unused, calling callback (0000000092c28bba) 00010000:00010000:3.0:1788528258.361284:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000522f37b2/0x892c60dda91c74c0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528258.361291:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000522f37b2/0x892c60dda91c74c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528258.361305:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000522f37b2/0x892c60dda91c74c0 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528258.361311:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000522f37b2/0x892c60dda91c74c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528258.361317:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000522f37b2/0x892c60dda91c74c0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788528258.361349:0:6502:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788528258.370259:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c554c2e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+5:6485:x1875407735357696:12345-0@lo:253: Request processed in 24637us (24963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528258.370276:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788528258.370361:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000b717c8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735357696:0@lo:253: 10000000:01000000:2.0:1788528258.370378:0:6485:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788528258.370381:0:6485:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788528258.370405:0:6485:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788528258.370407:0:6485:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788528258.370408:0:6485:0:(tgt_mount.c:1242:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788528258.370409:0:6485:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788528258.370410:0:6485:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788528258.370412:0:6485:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788528258.370413:0:6485:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788528258.370415:0:6485:0:(tgt_mount.c:1260:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788528258.370416:0:6485:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788528258.370417:0:6485:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788528258.370438:0:6485:0:(tgt_mount.c:115:server_register_mount()) register mount 00000000d049db85 from lustre-MDT0000 10000000:01000000:2.0:1788528258.370472:0:6485:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788528258.370475:0:6485:0:(mgc_request.c:423:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788528258.370479:0:6485:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8a90c7f88000 10000000:01000000:2.0:1788528258.370484:0:6485:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788528258.372840:0:6485:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff8a90c7f88000 from 1 10000000:01000000:2.0:1788528258.372850:0:6485:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788528258.373073:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 0000000090ef57cc/0x892c60dda91c74c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528258.373086:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 0000000090ef57cc/0x892c60dda91c74c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528258.373098:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 0000000090ef57cc/0x892c60dda91c74c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528258.373124:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000b717c8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735357824:0@lo:101: 00000100:00100000:2.0:1788528258.373198:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528258.373295:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1b1fc42 going to sleep for 11 seconds 00000100:00100000:1.0:1788528258.373355:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735357824 00000100:00100000:1.0:1788528258.373365:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735357824 00000100:00100000:1.0:1788528258.373459:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788528258.373469:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2571765 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+5:6485:x1875407735357824:12345-0@lo:101: 00010000:00010000:1.0:1788528258.373486:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528258.373502:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000003c263a9/0x892c60dda91c74ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c74c7 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528258.373539:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000003c263a9/0x892c60dda91c74ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c74c7 expref: 6 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528258.373550:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000003c263a9/0x892c60dda91c74ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c74c7 expref: 6 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528258.373587:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000003c263a9, rc 0) 00000100:00100000:1.0:1788528258.373634:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2571765 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+6:6485:x1875407735357824:12345-0@lo:101: Request processed in 167us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528258.373641:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788528258.373732:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000b717c8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735357824:0@lo:101: 00010000:00010000:2.0:1788528258.373747:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 0000000090ef57cc/0x892c60dda91c74c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c74ce expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528258.373774:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 0000000090ef57cc/0x892c60dda91c74c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c74ce expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528258.373830:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000b717c8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735357952:0@lo:501: 00000100:00100000:2.0:1788528258.373856:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528258.374268:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1b1fc42 going to sleep for 11 seconds 00000100:00100000:0.0:1788528258.374344:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735357952 00000100:00100000:0.0:1788528258.374349:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735357952 00000100:00100000:0.0:1788528258.374379:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788528258.374396:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021ae080d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+6:6485:x1875407735357952:12345-0@lo:501: 00000100:00100000:0.0:1788528258.374533:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021ae080d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+6:6485:x1875407735357952:12345-0@lo:501: Request processed in 147us (676us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788528258.374541:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788528258.374776:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000b717c8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735357952:0@lo:501: 10000000:01000000:2.0:1788528258.374794:0:6485:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788528258.374854:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 0000000090ef57cc/0x892c60dda91c74c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c74ce expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528258.374863:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 0000000090ef57cc/0x892c60dda91c74c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c74ce expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528258.374872:0:6485:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff8a90c7f88000 10000000:01000000:2.0:1788528258.374878:0:6485:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788528258.374925:0:6485:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-barrier-ffff8a90c7f88000 10000000:01000000:2.0:1788528258.374929:0:6485:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788528258.374944:0:6485:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-barrier-ffff8a90c7f88000 from 1 10000000:01000000:2.0:1788528258.374946:0:6485:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788528258.375110:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 00000000c81f93d0/0x892c60dda91c74d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528258.375119:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 00000000c81f93d0/0x892c60dda91c74d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528258.375127:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 00000000c81f93d0/0x892c60dda91c74d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528258.375153:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000b717c8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735358080:0@lo:101: 00000100:00100000:2.0:1788528258.375187:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528258.375214:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1b1fc42 going to sleep for 11 seconds 00000100:00100000:3.0:1788528258.375355:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735358080 00000100:00100000:3.0:1788528258.375361:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735358080 00000100:00100000:3.0:1788528258.375409:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788528258.375415:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5db471c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+6:6485:x1875407735358080:12345-0@lo:101: 00010000:00010000:3.0:1788528258.375426:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528258.375438:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000522f37b2/0x892c60dda91c74dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c74d5 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528258.375458:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000522f37b2/0x892c60dda91c74dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c74d5 expref: 7 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528258.375468:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000522f37b2/0x892c60dda91c74dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c74d5 expref: 7 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528258.375476:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000522f37b2, rc 0) 00000100:00100000:3.0:1788528258.375631:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5db471c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+7:6485:x1875407735358080:12345-0@lo:101: Request processed in 216us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528258.375637:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788528258.375731:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000b717c8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735358080:0@lo:101: 00010000:00010000:2.0:1788528258.375743:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 00000000c81f93d0/0x892c60dda91c74d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c74dc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528258.375751:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 00000000c81f93d0/0x892c60dda91c74d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c74dc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528258.375763:0:6485:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788528258.375810:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 00000000c81f93d0/0x892c60dda91c74d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c74dc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528258.375818:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 00000000c81f93d0/0x892c60dda91c74d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c74dc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528258.375823:0:6485:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788528258.375828:0:6485:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788528258.375866:0:6485:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff8a90c7f88000 10000000:01000000:2.0:1788528258.375870:0:6485:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788528258.375884:0:6485:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788528258.375886:0:6485:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788528258.376042:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 00000000b3272649/0x892c60dda91c74e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528258.376050:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 00000000b3272649/0x892c60dda91c74e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528258.376067:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 00000000b3272649/0x892c60dda91c74e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528258.376080:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000b717c8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735358208:0@lo:101: 00000100:00100000:2.0:1788528258.376110:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528258.376243:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1b1fc42 going to sleep for 11 seconds 00000100:00100000:3.0:1788528258.376315:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735358208 00000100:00100000:3.0:1788528258.376321:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735358208 00000100:00100000:3.0:1788528258.376396:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788528258.376402:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084eb1759 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+7:6485:x1875407735358208:12345-0@lo:101: 00010000:00010000:3.0:1788528258.376414:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528258.376430:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000007a4c5e8/0x892c60dda91c74ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c74e3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528258.376446:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000007a4c5e8/0x892c60dda91c74ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c74e3 expref: 8 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528258.376453:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000007a4c5e8/0x892c60dda91c74ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c74e3 expref: 8 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528258.376459:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000007a4c5e8, rc 0) 00000100:00100000:3.0:1788528258.376495:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084eb1759 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+8:6485:x1875407735358208:12345-0@lo:101: Request processed in 94us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528258.376501:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788528258.376602:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000b717c8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735358208:0@lo:101: 00010000:00010000:2.0:1788528258.376613:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 00000000b3272649/0x892c60dda91c74e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c74ea expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528258.376620:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 00000000b3272649/0x892c60dda91c74e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c74ea expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528258.376649:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000b717c8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735358336:0@lo:501: 00000100:00100000:2.0:1788528258.376670:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528258.376683:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1b1fc42 going to sleep for 11 seconds 00000100:00100000:3.0:1788528258.376765:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735358336 00000100:00100000:3.0:1788528258.376769:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735358336 00000100:00100000:3.0:1788528258.376783:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788528258.376788:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b2b14d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+8:6485:x1875407735358336:12345-0@lo:501: 00000100:00100000:3.0:1788528258.376890:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b2b14d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+9:6485:x1875407735358336:12345-0@lo:501: Request processed in 101us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528258.376896:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788528258.376995:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000b717c8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735358336:0@lo:501: 00000100:00100000:2.0:1788528258.377033:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000b717c8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735358464:0@lo:503: 00000100:00100000:2.0:1788528258.377069:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528258.377088:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1b1fc42 going to sleep for 11 seconds 00000100:00100000:3.0:1788528258.377273:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735358464 00000100:00100000:3.0:1788528258.377277:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735358464 00000100:00100000:3.0:1788528258.377295:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788528258.377299:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000452d15fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+9:6485:x1875407735358464:12345-0@lo:503: 00000100:00100000:3.0:1788528258.377381:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000452d15fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+9:6485:x1875407735358464:12345-0@lo:503: Request processed in 80us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528258.377396:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788528258.377475:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000b717c8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735358464:0@lo:503: 00000100:00100000:2.0:1788528258.377932:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000b717c8d pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:6530:1875407735358592:0@lo:502: 00000100:00100000:2.0:1788528258.378091:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528258.378126:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dafe7ab1 going to sleep for 11 seconds 00000100:00100000:3.0:1788528258.378183:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735358592 00000100:00100000:3.0:1788528258.378188:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735358592 00000100:00100000:3.0:1788528258.378218:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788528258.378223:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a895 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+9:6530:x1875407735358592:12345-0@lo:502: 00000100:00100000:3.0:1788528258.378314:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a895 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+9:6530:x1875407735358592:12345-0@lo:502: Request processed in 91us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528258.378321:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788528258.378414:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000b717c8d pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:6530:1875407735358592:0@lo:502: 00000020:01000000:2.0:1788528258.378442:0:6530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788528258.378453:0:6530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528258.378455:0:6530:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788528258.378462:0:6530:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788528258.378465:0:6530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788528258.378478:0:6530:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000005c906270) 00000020:00000080:2.0:1788528258.378496:0:6530:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788528258.378503:0:6530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788528258.378685:0:6530:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788528258.378693:0:6530:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x892c60dda91c74f8 00000020:00000080:2.0:1788528258.379124:0:6530:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788528258.379129:0:6530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788528258.379134:0:6530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528258.379135:0:6530:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788528258.379138:0:6530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788528258.379142:0:6530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528258.379143:0:6530:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788528258.379146:0:6530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788528258.379154:0:6530:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000bf8c61d8) 00000020:00000080:2.0:1788528258.379164:0:6530:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788528258.379168:0:6530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788528258.379169:0:6530:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788528258.379172:0:6530:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788528258.379177:0:6530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788528258.379228:0:6530:0:(tgt_mount.c:167:server_get_mount()) get mount 00000000d049db85 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788528258.379241:0:6530:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000000a8be719) 00000020:00000080:2.0:1788528258.379258:0:6530:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788528258.379325:0:6530:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788528258.379331:0:6530:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x892c60dda91c750d 00000020:00000080:2.0:1788528258.379440:0:6530:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788528258.379447:0:6530:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788528258.379451:0:6530:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x892c60dda91c7514 00080000:01000000:2.0:1788528258.379456:0:6530:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788528258.379465:0:6530:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x892c60dda91c751b 00080000:10000000:2.0:1788528258.380225:0:6530:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1788528258.380369:0:6530:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788528258.385458:0:6530:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1788528258.458294:0:6530:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1788528258.458895:0:6530:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1788528258.462344:0:6530:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1788528258.463018:0:6530:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788528258.467163:0:6530:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000003a2b0d20) 00000020:00000080:1.0:1788528258.467185:0:6530:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788528258.467326:0:6530:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788528258.467332:0:6530:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x892c60dda91c7529 00000020:00000080:0.0:1788528258.470143:0:6530:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1788528258.480529:0:6530:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:0.0:1788528258.493207:0:6530:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1788528258.497308:0:6530:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1788528258.500863:0:6530:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1788528258.512135:0:6530:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:0.0:1788528258.519669:0:6530:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:0.0:1788528258.523028:0:6530:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x892c60dda91c7530 00000020:00000080:1.0:1788528258.523537:0:6530:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788528258.523713:0:6530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528258.523720:0:6530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528258.523723:0:6530:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788528258.523728:0:6530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528258.523732:0:6530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528258.523734:0:6530:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788528258.523737:0:6530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788528258.523739:0:6530:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788528258.523741:0:6530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528258.523744:0:6530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528258.523745:0:6530:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788528258.523747:0:6530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528258.523751:0:6530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528258.523752:0:6530:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788528258.523756:0:6530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788528258.524025:0:6530:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1788528258.524107:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ac3474c2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:6530:1875407735358720:0@lo:502: 00000100:00100000:1.0:1788528258.524191:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528258.524373:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set 000000007cbd4176 going to sleep for 11 seconds 00000100:00100000:2.0:1788528258.524716:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735358720 00000100:00100000:2.0:1788528258.524726:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735358720 00000100:00100000:2.0:1788528258.524773:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788528258.524782:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003121cdd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+9:6530:x1875407735358720:12345-0@lo:502: 00000100:00100000:2.0:1788528258.524943:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003121cdd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+9:6530:x1875407735358720:12345-0@lo:502: Request processed in 162us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528258.524951:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788528258.525351:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ac3474c2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:6530:1875407735358720:0@lo:502: 00000020:01000000:1.0:1788528258.525395:0:6530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528258.525402:0:6530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528258.525409:0:6530:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1788528258.525413:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788528258.525761:0:6485:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788528258.525770:0:6485:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788528258.525790:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 00000000b3272649/0x892c60dda91c74e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c74ea expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528258.525801:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 00000000b3272649/0x892c60dda91c74e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c74ea expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528258.525808:0:6485:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff8a90c7f88000 from 1 10000000:01000000:2.0:1788528258.525811:0:6485:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788528258.525844:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 0000000066f1c529/0x892c60dda91c7537 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528258.525851:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 0000000066f1c529/0x892c60dda91c7537 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528258.525860:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 0000000066f1c529/0x892c60dda91c7537 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528258.525891:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000b717c8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735358848:0@lo:101: 00000100:00100000:2.0:1788528258.526034:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528258.526297:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ec09901e going to sleep for 11 seconds 00000100:00100000:1.0:1788528258.526344:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735358848 00000100:00100000:1.0:1788528258.526351:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735358848 00000100:00100000:1.0:1788528258.526401:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788528258.526409:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6e493e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+9:6485:x1875407735358848:12345-0@lo:101: 00010000:00010000:1.0:1788528258.526424:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528258.526438:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004268ed96/0x892c60dda91c753e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7537 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528258.526462:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004268ed96/0x892c60dda91c753e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7537 expref: 10 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528258.526473:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004268ed96/0x892c60dda91c753e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7537 expref: 10 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528258.526483:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004268ed96, rc 0) 00000100:00100000:1.0:1788528258.526537:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6e493e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+10:6485:x1875407735358848:12345-0@lo:101: Request processed in 129us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528258.526575:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788528258.526665:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000b717c8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735358848:0@lo:101: 00010000:00010000:3.0:1788528258.526679:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 0000000066f1c529/0x892c60dda91c7537 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c753e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528258.526687:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 0000000066f1c529/0x892c60dda91c7537 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c753e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528258.528393:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000994d579e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735358976:0@lo:256: 00000100:00100000:3.0:1788528258.528468:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528258.528916:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735358976 00000100:00100000:1.0:1788528258.528924:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735358976 00000100:00100000:1.0:1788528258.528960:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788528258.528967:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029f36b21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+10:6485:x1875407735358976:12345-0@lo:256: 20000000:01000000:1.0:1788528258.528990:0:6501:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788528258.528997:0:6501:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788528258.529069:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029f36b21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+10:6485:x1875407735358976:12345-0@lo:256: Request processed in 103us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528258.529076:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788528258.529286:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set 0000000092b2df52 going to sleep for 11 seconds 00000100:00100000:3.0:1788528258.529313:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000994d579e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735358976:0@lo:256: 10000000:01000000:3.0:1788528258.530486:0:6485:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788528258.530811:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 0000000066f1c529/0x892c60dda91c7537 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c753e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528258.530825:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 0000000066f1c529/0x892c60dda91c7537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c753e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528258.530857:0:6485:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a90c7f88000 from 1 10000000:01000000:3.0:1788528258.530860:0:6485:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788528258.530917:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 000000004c8c79df/0x892c60dda91c7545 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528258.530938:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 000000004c8c79df/0x892c60dda91c7545 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528258.530948:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 000000004c8c79df/0x892c60dda91c7545 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528258.530969:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000994d579e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735359104:0@lo:101: 00000100:00100000:3.0:1788528258.531027:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528258.531074:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set 0000000092b2df52 going to sleep for 11 seconds 00000100:00100000:2.0:1788528258.531194:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735359104 00000100:00100000:2.0:1788528258.531202:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735359104 00000100:00100000:2.0:1788528258.531266:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788528258.531274:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac92b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+10:6485:x1875407735359104:12345-0@lo:101: 00010000:00010000:2.0:1788528258.531289:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528258.531306:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000c38c4d5/0x892c60dda91c754c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7545 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528258.531332:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000c38c4d5/0x892c60dda91c754c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7545 expref: 11 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528258.531342:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000c38c4d5/0x892c60dda91c754c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7545 expref: 11 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528258.531350:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000c38c4d5, rc 0) 00000100:00100000:2.0:1788528258.531406:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac92b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+11:6485:x1875407735359104:12345-0@lo:101: Request processed in 134us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528258.531412:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788528258.531719:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000994d579e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735359104:0@lo:101: 00010000:00010000:3.0:1788528258.531735:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 000000004c8c79df/0x892c60dda91c7545 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c754c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528258.531743:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 000000004c8c79df/0x892c60dda91c7545 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c754c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528258.531782:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000994d579e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735359232:0@lo:501: 00000100:00100000:3.0:1788528258.531811:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528258.531841:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set 0000000092b2df52 going to sleep for 11 seconds 00000100:00100000:0.0:1788528258.531983:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735359232 00000100:00100000:0.0:1788528258.531989:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735359232 00000100:00100000:0.0:1788528258.532025:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788528258.532031:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac95038f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+11:6485:x1875407735359232:12345-0@lo:501: 00000100:00100000:0.0:1788528258.532182:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac95038f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+11:6485:x1875407735359232:12345-0@lo:501: Request processed in 151us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528258.532190:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788528258.532823:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000994d579e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735359232:0@lo:501: 00000100:00100000:3.0:1788528258.532860:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000994d579e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735359360:0@lo:503: 00000100:00100000:3.0:1788528258.532914:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528258.532943:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set 0000000092b2df52 going to sleep for 11 seconds 00000100:00100000:2.0:1788528258.533055:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735359360 00000100:00100000:2.0:1788528258.533061:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735359360 00000100:00100000:2.0:1788528258.533092:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788528258.533098:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003d2a29f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+11:6485:x1875407735359360:12345-0@lo:503: 00000040:00080000:2.0:1788528258.533133:0:6502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788528258.533178:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003d2a29f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+11:6485:x1875407735359360:12345-0@lo:503: Request processed in 81us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528258.533190:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788528258.533368:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000994d579e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735359360:0@lo:503: 00000040:00080000:3.0:1788528258.534814:0:6534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1788528258.535006:0:6485:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788528258.535016:0:6485:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788528258.535289:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 000000004c8c79df/0x892c60dda91c7545 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c754c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528258.535302:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 000000004c8c79df/0x892c60dda91c7545 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c754c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528258.535356:0:6485:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788528258.535360:0:6485:0:(mgc_request.c:423:config_log_add()) add config log lustre-client-ffff8a90c7f88000 10000000:01000000:2.0:1788528258.535363:0:6485:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff8a90c7f88000 10000000:01000000:2.0:1788528258.535368:0:6485:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788528258.535397:0:6485:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff8a90c7f88000 from 1 10000000:01000000:2.0:1788528258.535400:0:6485:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788528258.535441:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 000000009b6f8c89/0x892c60dda91c7553 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528258.535449:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 000000009b6f8c89/0x892c60dda91c7553 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528258.535460:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 000000009b6f8c89/0x892c60dda91c7553 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528258.535483:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001a1fc93f pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735359488:0@lo:101: 00000100:00100000:3.0:1788528258.536124:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528258.536202:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1b1fc42 going to sleep for 11 seconds 00000100:00100000:0.0:1788528258.536322:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735359488 00000100:00100000:0.0:1788528258.536331:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735359488 00000100:00100000:0.0:1788528258.536421:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788528258.536444:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000bec68d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+11:6485:x1875407735359488:12345-0@lo:101: 00010000:00010000:0.0:1788528258.536460:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528258.536478:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b3168ae5/0x892c60dda91c755a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7553 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528258.536517:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b3168ae5/0x892c60dda91c755a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7553 expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528258.536528:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b3168ae5/0x892c60dda91c755a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7553 expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528258.536538:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b3168ae5, rc 0) 00000100:00100000:0.0:1788528258.536639:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000bec68d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+12:6485:x1875407735359488:12345-0@lo:101: Request processed in 198us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528258.536646:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788528258.536740:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001a1fc93f pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735359488:0@lo:101: 00010000:00010000:3.0:1788528258.536757:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 000000009b6f8c89/0x892c60dda91c7553 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c755a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528258.536766:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 000000009b6f8c89/0x892c60dda91c7553 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c755a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528258.536812:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000994d579e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735359616:0@lo:501: 00000100:00100000:3.0:1788528258.536855:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528258.537404:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set 000000009a326e76 going to sleep for 11 seconds 00000100:00100000:2.0:1788528258.537468:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735359616 00000100:00100000:2.0:1788528258.537475:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735359616 00000100:00100000:2.0:1788528258.537521:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788528258.537527:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a4ae801 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+12:6485:x1875407735359616:12345-0@lo:501: 00000100:00100000:3.0:1788528258.538139:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a4ae801 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+12:6485:x1875407735359616:12345-0@lo:501: Request processed in 612us (1283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528258.538148:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788528258.538280:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000994d579e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735359616:0@lo:501: 00000100:00100000:0.0:1788528258.538339:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004312f954 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735359744:0@lo:503: 00000100:00100000:0.0:1788528258.538390:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528258.538450:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b77923b2 going to sleep for 11 seconds 00000100:00100000:3.0:1788528258.538488:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735359744 00000100:00100000:3.0:1788528258.538493:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735359744 00000100:00100000:3.0:1788528258.538739:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788528258.538747:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d879c7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+12:6485:x1875407735359744:12345-0@lo:503: 00000100:00100000:3.0:1788528258.538829:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d879c7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+12:6485:x1875407735359744:12345-0@lo:503: Request processed in 84us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528258.538836:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788528258.538915:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004312f954 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735359744:0@lo:503: 00000100:00100000:0.0:1788528258.539441:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004312f954 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:6535:1875407735359872:0@lo:502: 00000100:00100000:0.0:1788528258.539482:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528258.539590:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set 000000008e45588b going to sleep for 11 seconds 00000100:00100000:3.0:1788528258.539973:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735359872 00000100:00100000:3.0:1788528258.539980:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735359872 00000100:00100000:3.0:1788528258.540051:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788528258.540059:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001162bdaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+12:6535:x1875407735359872:12345-0@lo:502: 00000100:00100000:3.0:1788528258.540174:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001162bdaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+12:6535:x1875407735359872:12345-0@lo:502: Request processed in 116us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528258.540190:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788528258.540408:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004312f954 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:6535:1875407735359872:0@lo:502: 00000020:01000004:0.0:1788528258.540467:0:6535:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788528258.540483:0:6535:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000009ca6ad1b) 00000020:00000080:0.0:1788528258.540518:0:6535:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788528258.540742:0:6535:0:(tgt_mount.c:167:server_get_mount()) get mount 00000000d049db85 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788528258.540747:0:6535:0:(tgt_mount.c:201:server_put_mount()) put mount 00000000d049db85 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788528258.540750:0:6535:0:(obd_mount.c:712:lustre_put_lsi()) put 00000000d049db85 4 00010000:00080000:0.0:1788528258.540779:0:6535:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000870d4bda@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:0.0:1788528258.543309:0:6535:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788528258.543654:0:6535:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788528258.543698:0:6535:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788528258.543711:0:6535:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x892c60dda91c7568 00000100:00080000:0.0:1788528258.543722:0:6535:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788528258.543728:0:6535:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000870d4bda using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1788528258.543771:0:6535:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004312f954 x1875407735360000/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788528258.543794:0:6535:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788528258.544620:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000010cc8b15 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:6535:1875407735360128:0@lo:502: 00000100:00100000:0.0:1788528258.544703:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528258.544748:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set 000000007f726876 going to sleep for 11 seconds 00000100:00100000:2.0:1788528258.544922:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735360128 00000100:00100000:2.0:1788528258.544929:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735360128 00000100:00100000:2.0:1788528258.544981:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788528258.544990:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000367082bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+12:6535:x1875407735360128:12345-0@lo:502: 00000100:00100000:2.0:1788528258.545122:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000367082bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+12:6535:x1875407735360128:12345-0@lo:502: Request processed in 133us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528258.545131:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788528258.547411:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000010cc8b15 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:6535:1875407735360128:0@lo:502: 00000040:00080000:0.0:1788528258.547462:0:6535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788528258.547852:0:6485:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788528258.547864:0:6485:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788528258.547892:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 000000009b6f8c89/0x892c60dda91c7553 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c755a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528258.547911:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 000000009b6f8c89/0x892c60dda91c7553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c755a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788528258.547967:0:6485:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788528258.547970:0:6485:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788528258.547971:0:6485:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788528258.547972:0:6485:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788528258.547973:0:6485:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788528258.547975:0:6485:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788528258.547976:0:6485:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788528258.547978:0:6485:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788528258.547979:0:6485:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788528258.547980:0:6485:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788528258.547982:0:6485:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788528258.547983:0:6485:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788528258.547986:0:6485:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788528258.547989:0:6485:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788528258.547990:0:6485:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788528258.547991:0:6485:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788528258.547992:0:6485:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788528258.547993:0:6485:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788528258.547999:0:6485:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788528258.548000:0:6485:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788528258.548001:0:6485:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788528258.548002:0:6485:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788528258.548002:0:6485:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788528258.548003:0:6485:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788528258.548004:0:6485:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788528258.548031:0:6485:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788528258.548048:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d886157 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735360256:0@lo:253: 00000100:00100000:2.0:1788528258.548117:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528258.548157:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set 0000000069ebfb52 going to sleep for 11 seconds 00000100:00100000:2.0:1788528258.548182:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735360256 00000100:00100000:2.0:1788528258.548189:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735360256 00000100:00100000:2.0:1788528258.548360:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788528258.548371:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022398041 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+12:6485:x1875407735360256:12345-0@lo:253: 20000000:01000000:2.0:1788528258.548435:0:6501:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788528258.548450:0:6501:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788528258.549064:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004312f954 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875407735360000:0@lo:38: 00000100:00100000:1.0:1788528258.549118:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528258.549317:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735360000 00000100:00100000:2.0:1788528258.549323:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735360000 00000100:00100000:2.0:1788528258.549357:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788528258.549362:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac3474c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1875407735360000:12345-0@lo:38: 00000100:00100000:2.0:1788528258.549431:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac3474c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1875407735360000:12345-0@lo:38: Request processed in 68us (313us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788528258.549438:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788528258.550175:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788528258.550186:0:3636:0:(import.c:65:import_set_state_nolock()) 00000000870d4bda lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788528258.550191:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788528258.550195:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004312f954 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875407735360000:0@lo:38: 20000000:01000000:0.0:1788528258.562772:0:6501:0:(mgs_nids.c:820:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788528258.562785:0:6501:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788528258.562948:0:6524:0:(mgs_nids.c:717:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788528258.562955:0:6524:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788528258.562980:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004cadbf8d/0x892c60dda91c756f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528258.563001:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004268ed96/0x892c60dda91c753e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7537 expref: 12 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528258.563009:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004cadbf8d/0x892c60dda91c756f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528258.563060:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004268ed96/0x892c60dda91c753e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c7537 expref: 12 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528258.563077:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004268ed96/0x892c60dda91c753e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c7537 expref: 12 pid: 6501 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528258.563095:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f90d7694 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6524:1875407735360384:0@lo:104: 00000100:00100000:1.0:1788528258.563163:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528258.563320:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022398041 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+12:6485:x1875407735360256:12345-0@lo:253: Request processed in 14950us (15202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528258.563333:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788528258.563588:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d886157 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:6485:1875407735360256:0@lo:253: 10000000:01000000:3.0:1788528258.563604:0:6485:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788528258.563607:0:6485:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788528258.563609:0:6485:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788528258.563610:0:6485:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788528258.563611:0:6485:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788528258.563613:0:6485:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788528258.563614:0:6485:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788528258.563615:0:6485:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788528258.563617:0:6485:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788528258.563618:0:6485:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788528258.563620:0:6485:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788528258.563621:0:6485:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788528258.563623:0:6485:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788528258.563640:0:6485:0:(tgt_mount.c:2815:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788528258.563815:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set 000000003d975f25 going to sleep for 11 seconds 00000100:00100000:2.0:1788528258.566916:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735360384 00000100:00100000:2.0:1788528258.566932:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735360384 00000100:00100000:2.0:1788528258.566992:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788528258.567003:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce239696 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+3:6524:x1875407735360384:12345-0@lo:104: 00010000:00010000:2.0:1788528258.567024:0:6491:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: 0000000066f1c529/0x892c60dda91c7537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c753e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528258.567237:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788528258.567257:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce239696 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+3:6524:x1875407735360384:12345-0@lo:104: Request processed in 256us (4094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528258.567264:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788528258.567396:0:6496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528258.567402:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: 0000000066f1c529/0x892c60dda91c7537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c753e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528258.567424:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000066f1c529 already unused, calling callback (000000009849d88c) 10000000:00010000:1.0:1788528258.567427:0:6496:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: 0000000066f1c529/0x892c60dda91c7537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c753e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528258.567437:0:6496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: 0000000066f1c529/0x892c60dda91c7537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c753e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528258.567444:0:6496:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: 0000000066f1c529/0x892c60dda91c7537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c753e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528258.567449:0:6496:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788528258.567498:0:6496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: 0000000066f1c529/0x892c60dda91c7537 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c753e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528258.567515:0:6496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528258.567531:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: 0000000066f1c529/0x892c60dda91c7537 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c753e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528258.567537:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: 0000000066f1c529/0x892c60dda91c7537 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c753e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528258.567587:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528258.567589:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528258.567591:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1788528258.569944:0:6485:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1788528258.570114:0:6485:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00000100:00100000:2.0:1788528258.570438:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003b29e55f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735360512:0@lo:103: 00000100:00100000:2.0:1788528258.570523:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528258.570790:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735360512 00000100:00100000:1.0:1788528258.570800:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735360512 00010000:00010000:1.0:1788528258.570836:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004268ed96/0x892c60dda91c753e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7537 expref: 12 pid: 6501 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528258.570880:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788528258.570897:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009bdb3361 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd052447-840d-4bcc-891b-140c465c7625+12:3638:x1875407735360512:12345-0@lo:103: 00010000:00010000:1.0:1788528258.570913:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528258.570918:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004268ed96/0x892c60dda91c753e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7537 expref: 12 pid: 6501 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528258.570931:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004268ed96/0x892c60dda91c753e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c7537 expref: 12 pid: 6501 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528258.570955:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004cadbf8d/0x892c60dda91c756f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528258.570963:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004cadbf8d/0x892c60dda91c756f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788528258.570979:0:6493:0:(mgs_nids.c:693:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008026504s 00010000:00010000:1.0:1788528258.570984:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004cadbf8d/0x892c60dda91c756f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528258.570991:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004cadbf8d/0x892c60dda91c756f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528258.570996:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004cadbf8d/0x892c60dda91c756f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528258.571002:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004cadbf8d/0x892c60dda91c756f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528258.571007:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004cadbf8d already unused, calling callback (0000000092c28bba) 00010000:00010000:1.0:1788528258.571011:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004cadbf8d/0x892c60dda91c756f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528258.571019:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004cadbf8d/0x892c60dda91c756f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528258.571034:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004cadbf8d/0x892c60dda91c756f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528258.571045:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528258.571091:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009bdb3361 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd052447-840d-4bcc-891b-140c465c7625+12:3638:x1875407735360512:12345-0@lo:103: Request processed in 196us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528258.571099:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788528258.571144:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003b29e55f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735360512:0@lo:103: 00080000:10000000:3.0:1788528258.572040:0:6485:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1788528258.572447:0:6485:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788528258.575843:0:6485:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1788528258.576514:0:6485:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1788528258.577453:0:6485:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1788528258.577724:0:6485:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1788528258.577913:0:6485:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1788528258.578072:0:6485:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1788528258.578282:0:6485:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1788528258.578448:0:6485:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00010000:00010000:0.0:1788528258.579083:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004268ed96/0x892c60dda91c753e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c7537 expref: 11 pid: 6501 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528258.579105:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f90d7694 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6524:1875407735360384:0@lo:104: 00010000:00010000:0.0:1788528258.579141:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004cadbf8d/0x892c60dda91c756f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528258.579179:0:6524:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004cadbf8d/0x892c60dda91c756f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528258.579187:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004cadbf8d/0x892c60dda91c756f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528258.579193:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004cadbf8d/0x892c60dda91c756f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 40000000:02000000:3.0:1788528258.582355:0:6485:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788528258.591685:0:6485:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788528258.591834:0:6540:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788528258.591839:0:6540:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788528258.591937:0:6541:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788528258.593296:0:6485:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788528258.593418:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788528258.593893:0:6485:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788528258.593901:0:6485:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788528258.593996:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788528258.594999:0:6485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788528258.597393:0:6541:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788528258.601595:0:6485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788528258.601698:0:6485:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788528258.601955:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788528258.602996:0:6541:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788528258.603063:0:6541:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788528258.603067:0:6541:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00080000:10000000:3.0:1788528258.603370:0:6485:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1788528258.604653:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788528258.604800:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788528258.604949:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788528258.605095:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788528258.605323:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788528258.605474:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788528258.605956:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788528258.606122:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788528258.606334:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788528258.606484:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788528258.606831:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788528258.606977:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788528258.607109:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788528258.607326:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788528258.607486:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788528258.607912:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788528258.608299:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788528258.608465:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788528258.608768:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788528258.608900:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788528258.609090:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788528258.609322:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788528258.609478:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788528258.609754:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788528258.609905:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788528258.610052:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788528258.610180:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788528258.610416:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788528258.610807:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788528258.610965:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788528258.611116:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788528258.611328:0:6485:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788528258.611857:0:6485:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1788528258.615112:0:6485:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788528258.615152:0:6485:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9b7a01c539b8 00100000:10000000:2.0:1788528258.615161:0:6485:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788528258.616084:0:6485:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788528258.616105:0:6485:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788528258.616878:0:6485:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788528258.617056:0:6485:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788528259.200992:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528260.234446:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528261.246981:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528262.270782:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788528262.791436:0:6786:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788528263.294888:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788528263.719154:0:6838:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788528263.719367:0:6838:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1788528263.871780:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788528263.871792:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff8a90c7f88000 from 3 10000000:01000000:3.0:1788528263.871798:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788528263.871852:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 00000000624b3072/0x892c60dda91c7576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528263.871867:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 00000000624b3072/0x892c60dda91c7576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528263.871879:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 00000000624b3072/0x892c60dda91c7576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528263.871905:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f5ca80a8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735360640:0@lo:101: 00000100:00100000:3.0:1788528263.871989:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528263.872040:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set 0000000069dd908e going to sleep for 11 seconds 00000100:00080000:1.0:1788528263.872146:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788528263.872214:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788528263.872217:0:469:0:(import.c:65:import_set_state_nolock()) 00000000870d4bda lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788528263.872227:0:469:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000870d4bda using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1788528263.872325:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003b29e55f x1875407735360768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788528263.872380:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003b29e55f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875407735360768:0@lo:38: 00000100:00100000:2.0:1788528263.872441:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528263.872739:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735360768 00000100:00100000:3.0:1788528263.872748:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735360768 00000100:00100000:3.0:1788528263.872808:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788528263.872815:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d00a303c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1875407735360768:12345-0@lo:38: 00010000:00080000:3.0:1788528263.872843:0:6510:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 133 last 0 00000020:00000080:3.0:1788528263.872888:0:6510:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x892c60dda91c757d 00000004:00100000:3.0:1788528263.872942:0:6510:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788528263.873072:0:6510:0:(import.c:65:import_set_state_nolock()) 00000000d1f90c19 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788528263.875732:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735360640 00000100:00100000:0.0:1788528263.875749:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735360640 00000100:00100000:0.0:1788528263.875826:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788528263.875835:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007f64af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+11:6506:x1875407735360640:12345-0@lo:101: 00010000:00010000:0.0:1788528263.875854:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528263.875874:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000038a509d1/0x892c60dda91c7584 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7576 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528263.875904:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000038a509d1/0x892c60dda91c7584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7576 expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528263.875915:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000038a509d1/0x892c60dda91c7584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7576 expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528263.875923:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000038a509d1, rc 0) 00000100:00100000:0.0:1788528263.876002:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007f64af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+12:6506:x1875407735360640:12345-0@lo:101: Request processed in 169us (4015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528263.876020:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788528263.876086:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f5ca80a8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735360640:0@lo:101: 00010000:00010000:0.0:1788528263.876105:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 00000000624b3072/0x892c60dda91c7576 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7584 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528263.876115:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 00000000624b3072/0x892c60dda91c7576 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7584 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528263.876185:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000010cc8b15 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735360896:0@lo:256: 00000100:00100000:0.0:1788528263.876228:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528263.878680:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set 00000000674fc81c going to sleep for 11 seconds 00000100:00100000:0.0:1788528263.878721:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735360896 00000100:00100000:0.0:1788528263.878732:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735360896 00000100:00100000:0.0:1788528263.878798:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788528263.878805:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007eaa498e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+12:6506:x1875407735360896:12345-0@lo:256: 20000000:01000000:0.0:1788528263.878831:0:6501:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788528263.878850:0:6501:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788528263.878853:0:6501:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788528263.878975:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007eaa498e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+12:6506:x1875407735360896:12345-0@lo:256: Request processed in 170us (2747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528263.878982:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788528263.879032:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000010cc8b15 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735360896:0@lo:256: 10000000:01000000:0.0:1788528263.879081:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788528263.879089:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 00000000624b3072/0x892c60dda91c7576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7584 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528263.879100:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 00000000624b3072/0x892c60dda91c7576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7584 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528263.885139:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d00a303c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875407735360768:12345-0@lo:38: Request processed in 12312us (12685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528263.885159:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788528263.885297:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003b29e55f x1875407735360768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788528273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788528263.885318:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788528263.885329:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788528263.885334:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788528263.885337:0:3636:0:(import.c:65:import_set_state_nolock()) 00000000870d4bda lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788528263.885343:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003b29e55f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875407735360768:0@lo:38: 00010000:00010000:0.0:1788528264.324287:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528265.342923:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528266.366809:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788528266.783398:0:6940:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788528266.783670:0:6940:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788528267.394677:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528268.415159:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528268.999077:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc89bc8e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735361152:0@lo:400: 00000100:00100000:3.0:1788528268.999155:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528268.999216:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788528268.999222:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024636e63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735361024:0@lo:400: 00000100:00100000:3.0:1788528268.999249:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528268.999284:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735361152 00000100:00100000:3.0:1788528268.999292:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735361152 00000100:00100000:3.0:1788528268.999349:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788528268.999358:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002af01ffa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735361152:12345-0@lo:400: 00000100:00100000:3.0:1788528268.999418:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002af01ffa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735361152:12345-0@lo:400: Request processed in 61us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528268.999426:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788528268.999471:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000dc89bc8e x1875407735361152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528268.999486:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc89bc8e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735361152:0@lo:400: 00000100:00100000:3.0:1788528269.002977:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735361024 00000100:00100000:3.0:1788528269.002991:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735361024 00000100:00100000:3.0:1788528269.003797:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788528269.003812:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb15f183 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+12:3640:x1875407735361024:12345-0@lo:400: 00000100:00100000:3.0:1788528269.003920:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb15f183 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+12:3640:x1875407735361024:12345-0@lo:400: Request processed in 113us (4670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528269.003929:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788528269.006876:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024636e63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735361024:0@lo:400: 00010000:00010000:0.0:1788528269.443954:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528270.463862:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528271.490882:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528272.515626:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528273.534813:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528274.112628:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee2d5eaf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735361280:0@lo:400: 00000100:00100000:3.0:1788528274.112707:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528274.112748:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735361280 00000100:00100000:0.0:1788528274.112757:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735361280 00000100:00100000:0.0:1788528274.112809:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788528274.112818:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074f8f5b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+12:3637:x1875407735361280:12345-0@lo:400: 00000100:00100000:1.0:1788528274.112850:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096173720 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735361408:0@lo:400: 00000100:00100000:1.0:1788528274.112885:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528274.112937:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735361408 00000100:00100000:1.0:1788528274.112940:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735361408 00000100:00100000:1.0:1788528274.112967:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788528274.112972:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4ae6728 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735361408:12345-0@lo:400: 00000100:00100000:1.0:1788528274.113004:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4ae6728 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735361408:12345-0@lo:400: Request processed in 33us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528274.113010:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788528274.113052:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000096173720 x1875407735361408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528274.113069:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096173720 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735361408:0@lo:400: 00000100:00100000:0.0:1788528274.113232:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074f8f5b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+12:3637:x1875407735361280:12345-0@lo:400: Request processed in 415us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528274.113239:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788528274.113289:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee2d5eaf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735361280:0@lo:400: 00010000:00010000:1.0:1788528274.560596:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528275.584400:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788528276.294330:0:7438:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:2.0:1788528276.294335:0:7438:0:(obd_mount.c:928:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788528276.294337:0:7438:0:(obd_mount.c:931:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788528276.294488:0:7438:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000033ffa407 00000020:01000004:2.0:1788528276.294504:0:7438:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1788528276.294515:0:7438:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788528276.294529:0:7438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000000f470836) 00000020:00000080:2.0:1788528276.294543:0:7438:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788528276.347530:0:7438:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:0.0:1788528276.347814:0:7438:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:1.0:1788528276.374206:0:7438:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788528276.374584:0:7438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1788528276.374595:0:7438:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788528276.374606:0:7438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x892c60dda91c7592 00000020:01000004:1.0:1788528276.374613:0:7438:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788528276.374634:0:7438:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.138@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788528276.374637:0:7438:0:(mgc_request.c:1317:mgc_set_info_async()) InitRecov MGC192.168.203.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788528276.374643:0:7438:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1788528276.374669:0:7438:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.138@tcp, index=0001, flags=0x20061 00000020:01000004:1.0:1788528276.374673:0:7438:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788528276.374675:0:7438:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788528276.374676:0:7438:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788528276.374677:0:7438:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788528276.374678:0:7438:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788528276.374679:0:7438:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788528276.374681:0:7438:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788528276.374682:0:7438:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788528276.374683:0:7438:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788528276.374685:0:7438:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788528276.374686:0:7438:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788528276.374688:0:7438:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:1.0:1788528276.374693:0:7438:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788528276.374694:0:7438:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788528276.374695:0:7438:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788528276.374696:0:7438:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788528276.374697:0:7438:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788528276.374698:0:7438:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788528276.374699:0:7438:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788528276.374700:0:7438:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788528276.374701:0:7438:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788528276.374702:0:7438:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788528276.374703:0:7438:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788528276.374732:0:7438:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788528276.374752:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db538e43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735361536:0@lo:253: 00000100:00100000:1.0:1788528276.374822:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528276.375049:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 000000003061b9a5 going to sleep for 11 seconds 00000100:00100000:0.0:1788528276.375445:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735361536 00000100:00100000:0.0:1788528276.375455:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735361536 00000100:00100000:0.0:1788528276.375600:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788528276.375609:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000169e045d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+12:7438:x1875407735361536:12345-0@lo:253: 20000000:01000000:0.0:1788528276.375641:0:6502:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788528276.375645:0:6502:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1788528276.375649:0:6502:0:(mgs_llog.c:875:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1788528276.375652:0:6502:0:(mgs_llog.c:3618:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1788528276.375688:0:6502:0:(mgs_llog.c:3178:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1788528276.376538:0:6502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788528276.376926:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788528276.376940:0:6502:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788528276.376958:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1788528276.376989:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1788528276.377005:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1788528276.377065:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1788528276.377081:0:6502:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1788528276.377097:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1788528276.377104:0:6502:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1788528276.377117:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1788528276.377121:0:6502:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1788528276.377134:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1788528276.377147:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1788528276.377282:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1788528276.377291:0:6502:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.203.138@tcp (null) (null) (null) 00000040:00080000:0.0:1788528276.377304:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1788528276.377309:0:6502:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788528276.377318:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1788528276.377323:0:6502:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.138@tcp (null) (null) 00000040:00080000:0.0:1788528276.377334:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1788528276.377339:0:6502:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788528276.377349:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1788528276.377364:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1788528276.377374:0:6502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1788528276.377452:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1788528276.377461:0:6502:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1788528276.377471:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1788528276.377485:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1788528276.377510:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1788528276.377517:0:6502:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1788528276.377530:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1788528276.377550:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1788528276.378804:0:6502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1788528276.378854:0:6502:0:(mgs_llog.c:3315:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788528276.378862:0:6502:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1788528276.379382:0:7444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1788528276.379731:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788528276.379761:0:6502:0:(mgs_llog.c:3361:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.138@tcp for mdt 20000000:01000000:0.0:1788528276.379764:0:6502:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.203.138@tcp (null) (null) (null) 00000040:00080000:0.0:1788528276.379781:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788528276.379787:0:6502:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788528276.379800:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788528276.379808:0:6502:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.138@tcp (null) (null) 00000040:00080000:0.0:1788528276.379825:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788528276.379833:0:6502:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1788528276.379846:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1788528276.379861:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1788528276.379917:0:6502:0:(mgs_llog.c:3441:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1788528276.379926:0:6502:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1788528276.380111:0:7445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1788528276.380312:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788528276.380329:0:6502:0:(mgs_llog.c:3499:mgs_write_log_osp_to_mdt()) add nid 192.168.203.138@tcp for mdt 20000000:01000000:2.0:1788528276.380331:0:6502:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.203.138@tcp (null) (null) (null) 00000040:00080000:2.0:1788528276.380344:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788528276.380349:0:6502:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788528276.380362:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788528276.380366:0:6502:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.138@tcp (null) (null) 00000040:00080000:2.0:1788528276.380379:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788528276.380384:0:6502:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1788528276.380396:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788528276.380410:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1788528276.380432:0:6502:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788528276.380441:0:6502:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788528276.380445:0:6502:0:(mgs_llog.c:4187:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788528276.380507:0:6502:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788528276.380509:0:6502:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788528276.380995:0:7446:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1788528276.381016:0:7446:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1788528276.381031:0:7446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788528276.381503:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1788528276.381524:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1788528276.381539:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1788528276.381732:0:6502:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788528276.381735:0:6502:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788528276.382373:0:7447:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788528276.382465:0:7447:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788528276.382480:0:7447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788528276.383207:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788528276.383228:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788528276.383251:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788528276.383275:0:6502:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788528276.383277:0:6502:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788528276.383721:0:7448:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788528276.383741:0:7448:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788528276.383755:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1788528276.383902:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1788528276.383920:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1788528276.384126:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1788528276.384146:0:6502:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788528276.384149:0:6502:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788528276.384154:0:6502:0:(mgs_llog.c:5078:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788528276.384160:0:6502:0:(mgs_llog.c:1385:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788528276.384483:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:0.0:1788528276.384818:0:6502:0:(mgs_llog.c:1456:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788528276.397444:0:6502:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788528276.398047:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004cadbf8d/0x892c60dda91c7599 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.398074:0:6502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000003c263a9/0x892c60dda91c74ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c74c7 expref: 12 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.398081:0:6502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000007a4c5e8/0x892c60dda91c74ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c74e3 expref: 12 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.398087:0:6502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b3168ae5/0x892c60dda91c755a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7553 expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.398094:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004cadbf8d/0x892c60dda91c7599 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.398149:0:6502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b3168ae5/0x892c60dda91c755a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c7553 expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.398165:0:6502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b3168ae5/0x892c60dda91c755a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c7553 expref: 12 pid: 6500 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528276.398272:0:6502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b4902b3b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6502:1875407735361664:0@lo:104: 00000100:00100000:1.0:1788528276.398342:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788528276.398502:0:6502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000007a4c5e8/0x892c60dda91c74ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c74e3 expref: 12 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.398510:0:6502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000007a4c5e8/0x892c60dda91c74ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c74e3 expref: 12 pid: 6502 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528276.398519:0:6502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000978f3138 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6502:1875407735361792:0@lo:104: 00000100:00100000:1.0:1788528276.398585:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788528276.399001:0:6502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000003c263a9/0x892c60dda91c74ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c74c7 expref: 12 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.399010:0:6502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000003c263a9/0x892c60dda91c74ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c74c7 expref: 12 pid: 6501 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528276.399020:0:6502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000df8d8e9f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6502:1875407735361920:0@lo:104: 00000100:00100000:1.0:1788528276.399045:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528276.399064:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735361664 00000100:00100000:2.0:1788528276.399074:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735361664 00000100:00100000:3.0:1788528276.399091:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735361792 00000100:00100000:3.0:1788528276.399095:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735361792 00000100:00100000:2.0:1788528276.399122:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788528276.399129:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d2732ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+4:6502:x1875407735361664:12345-0@lo:104: 00010000:00010000:2.0:1788528276.399143:0:6491:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: 000000009b6f8c89/0x892c60dda91c7553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c755a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.399220:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788528276.399226:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d2732ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+4:6502:x1875407735361664:12345-0@lo:104: Request processed in 97us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528276.399232:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788528276.399250:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788528276.399255:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3faf7be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+3:6502:x1875407735361792:12345-0@lo:104: 00010000:00010000:2.0:1788528276.399274:0:6491:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: 00000000b3272649/0x892c60dda91c74e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c74ea expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.399314:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788528276.399319:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3faf7be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+3:6502:x1875407735361792:12345-0@lo:104: Request processed in 65us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528276.399325:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788528276.399373:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788528276.399380:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: 000000009b6f8c89/0x892c60dda91c7553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c755a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.399397:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009b6f8c89 already unused, calling callback (000000009849d88c) 10000000:00010000:0.0:1788528276.399400:0:6497:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: 000000009b6f8c89/0x892c60dda91c7553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c755a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.399409:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: 000000009b6f8c89/0x892c60dda91c7553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c755a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528276.399416:0:6497:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: 000000009b6f8c89/0x892c60dda91c7553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c755a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528276.399420:0:6497:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788528276.399457:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: 000000009b6f8c89/0x892c60dda91c7553 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c755a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.399464:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788528276.399479:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: 000000009b6f8c89/0x892c60dda91c7553 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c755a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.399486:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: 000000009b6f8c89/0x892c60dda91c7553 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c755a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.399501:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528276.399503:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: 00000000b3272649/0x892c60dda91c74e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c74ea expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.399508:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b3272649 already unused, calling callback (000000009849d88c) 10000000:00010000:0.0:1788528276.399524:0:6497:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: 00000000b3272649/0x892c60dda91c74e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c74ea expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.399531:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: 00000000b3272649/0x892c60dda91c74e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c74ea expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528276.399536:0:6497:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: 00000000b3272649/0x892c60dda91c74e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c74ea expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528276.399541:0:6497:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788528276.399577:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: 00000000b3272649/0x892c60dda91c74e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c74ea expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.399584:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788528276.399588:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: 00000000b3272649/0x892c60dda91c74e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c74ea expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.399594:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: 00000000b3272649/0x892c60dda91c74e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c74ea expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.399604:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528276.399605:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528276.399607:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528276.399827:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528276.399842:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000010cc8b15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735362048:0@lo:103: 00000100:00100000:3.0:1788528276.399876:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528276.399916:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788528276.399922:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9b98d46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735362176:0@lo:103: 00000100:00100000:3.0:1788528276.399943:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528276.400020:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735362048 00000100:00100000:2.0:1788528276.400025:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735362048 00010000:00010000:2.0:1788528276.400052:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b3168ae5/0x892c60dda91c755a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7553 expref: 13 pid: 6500 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528276.400083:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735362176 00000100:00100000:2.0:1788528276.400086:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735362176 00010000:00010000:2.0:1788528276.400097:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000007a4c5e8/0x892c60dda91c74ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c74e3 expref: 14 pid: 6502 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528276.400110:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788528276.400115:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024636e63 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+14:3639:x1875407735362048:12345-0@lo:103: 00010000:00010000:2.0:1788528276.400125:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528276.400130:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b3168ae5/0x892c60dda91c755a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7553 expref: 14 pid: 6500 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.400140:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b3168ae5/0x892c60dda91c755a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c7553 expref: 14 pid: 6500 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.400157:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528276.400183:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024636e63 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+14:3639:x1875407735362048:12345-0@lo:103: Request processed in 69us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528276.400189:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788528276.400203:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788528276.400208:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc89bc8e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+13:3639:x1875407735362176:12345-0@lo:103: 00010000:00010000:2.0:1788528276.400214:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528276.400217:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000007a4c5e8/0x892c60dda91c74ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c74e3 expref: 13 pid: 6502 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.400224:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000007a4c5e8/0x892c60dda91c74ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c74e3 expref: 13 pid: 6502 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.400243:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528276.400276:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc89bc8e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+13:3639:x1875407735362176:12345-0@lo:103: Request processed in 69us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528276.400282:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788528276.401141:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9b98d46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735362176:0@lo:103: 00000100:00100000:3.0:1788528276.401167:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000010cc8b15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735362048:0@lo:103: 00000100:00100000:1.0:1788528276.401320:0:6502:0:(client.c:2716:ptlrpc_set_wait()) set 000000000990f536 going to sleep for 11 seconds 00010000:00010000:1.0:1788528276.401340:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b3168ae5/0x892c60dda91c755a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c7553 expref: 12 pid: 6500 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528276.401355:0:6502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b4902b3b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6502:1875407735361664:0@lo:104: 00010000:00010000:1.0:1788528276.401365:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000007a4c5e8/0x892c60dda91c74ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c74e3 expref: 11 pid: 6502 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528276.401375:0:6502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000978f3138 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6502:1875407735361792:0@lo:104: 00000100:00100000:3.0:1788528276.401470:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735361920 00000100:00100000:3.0:1788528276.401476:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735361920 00000100:00100000:3.0:1788528276.401550:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788528276.401589:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd68593d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+3:6502:x1875407735361920:12345-0@lo:104: 00010000:00010000:3.0:1788528276.401604:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: 0000000090ef57cc/0x892c60dda91c74c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c74ce expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528276.401893:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788528276.401899:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd68593d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+3:6502:x1875407735361920:12345-0@lo:104: Request processed in 312us (2854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528276.401906:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788528276.401947:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528276.401953:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: 0000000090ef57cc/0x892c60dda91c74c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c74ce expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.401961:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000090ef57cc already unused, calling callback (000000009849d88c) 10000000:00010000:0.0:1788528276.401965:0:6497:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: 0000000090ef57cc/0x892c60dda91c74c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c74ce expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.401988:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: 0000000090ef57cc/0x892c60dda91c74c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c74ce expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528276.401994:0:6497:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: 0000000090ef57cc/0x892c60dda91c74c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c74ce expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528276.402000:0:6497:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788528276.402040:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: 0000000090ef57cc/0x892c60dda91c74c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c74ce expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.402047:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788528276.402065:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: 0000000090ef57cc/0x892c60dda91c74c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c74ce expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.402071:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: 0000000090ef57cc/0x892c60dda91c74c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c74ce expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.402089:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528276.402091:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528276.402093:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528276.402100:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788528276.402111:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004b474f66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735362304:0@lo:103: 00000100:00100000:0.0:1788528276.402149:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528276.402188:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735362304 00000100:00100000:0.0:1788528276.402192:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735362304 00010000:00010000:0.0:1788528276.402212:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000003c263a9/0x892c60dda91c74ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c74c7 expref: 11 pid: 6501 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528276.402234:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788528276.402240:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002153b798 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+11:3638:x1875407735362304:12345-0@lo:103: 00010000:00010000:0.0:1788528276.402268:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528276.402273:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000003c263a9/0x892c60dda91c74ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c74c7 expref: 11 pid: 6501 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.402283:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000003c263a9/0x892c60dda91c74ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c74c7 expref: 11 pid: 6501 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.402300:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004cadbf8d/0x892c60dda91c7599 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.402308:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004cadbf8d/0x892c60dda91c7599 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.402324:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004cadbf8d/0x892c60dda91c7599 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.402330:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004cadbf8d/0x892c60dda91c7599 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.402337:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004cadbf8d/0x892c60dda91c7599 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.402342:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004cadbf8d/0x892c60dda91c7599 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.402346:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004cadbf8d already unused, calling callback (0000000092c28bba) 00010000:00010000:0.0:1788528276.402350:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004cadbf8d/0x892c60dda91c7599 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.402356:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004cadbf8d/0x892c60dda91c7599 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.402374:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004cadbf8d/0x892c60dda91c7599 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.402396:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528276.402425:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002153b798 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+11:3638:x1875407735362304:12345-0@lo:103: Request processed in 185us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528276.402432:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788528276.402462:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004b474f66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735362304:0@lo:103: 00010000:00010000:1.0:1788528276.402617:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000003c263a9/0x892c60dda91c74ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c74c7 expref: 10 pid: 6501 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528276.402648:0:6502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000df8d8e9f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6502:1875407735361920:0@lo:104: 00010000:00010000:1.0:1788528276.402666:0:6502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004cadbf8d/0x892c60dda91c7599 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.402675:0:6502:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004cadbf8d/0x892c60dda91c7599 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.402680:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004cadbf8d/0x892c60dda91c7599 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.402686:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004cadbf8d/0x892c60dda91c7599 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788528276.402702:0:6502:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788528276.404689:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000169e045d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+9:7438:x1875407735361536:12345-0@lo:253: Request processed in 29075us (29861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528276.404703:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788528276.404904:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db538e43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735361536:0@lo:253: 10000000:01000000:2.0:1788528276.404919:0:7438:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788528276.404922:0:7438:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788528276.404923:0:7438:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788528276.404924:0:7438:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788528276.404926:0:7438:0:(tgt_mount.c:1242:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1788528276.404927:0:7438:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788528276.404928:0:7438:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788528276.404929:0:7438:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788528276.404931:0:7438:0:(tgt_mount.c:1260:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788528276.404932:0:7438:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788528276.404933:0:7438:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788528276.404952:0:7438:0:(tgt_mount.c:115:server_register_mount()) register mount 0000000033ffa407 from lustre-MDT0001 10000000:01000000:2.0:1788528276.404985:0:7438:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788528276.404988:0:7438:0:(mgc_request.c:423:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788528276.404993:0:7438:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8a90f5add000 10000000:01000000:2.0:1788528276.404999:0:7438:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788528276.405034:0:7438:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-MDT0001-osd 00000040:01000000:2.0:1788528276.415163:0:7438:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788528276.429012:0:7438:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788528276.429030:0:7438:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff8a90f5add000 from 1 10000000:01000000:2.0:1788528276.429034:0:7438:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788528276.429081:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 000000001a1cb73c/0x892c60dda91c75a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.429093:0:7438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 000000001a1cb73c/0x892c60dda91c75a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.429120:0:7438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 000000001a1cb73c/0x892c60dda91c75a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528276.429145:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a9ae4dc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735362432:0@lo:101: 00000100:00100000:2.0:1788528276.429218:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528276.429366:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f06f841f going to sleep for 11 seconds 00000100:00100000:3.0:1788528276.429901:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735362432 00000100:00100000:3.0:1788528276.429912:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735362432 00000100:00100000:3.0:1788528276.429977:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788528276.429987:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033c28818 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+9:7438:x1875407735362432:12345-0@lo:101: 00010000:00010000:3.0:1788528276.430004:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528276.430023:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cf0ff73e/0x892c60dda91c75a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c75a0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528276.430053:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cf0ff73e/0x892c60dda91c75a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c75a0 expref: 10 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528276.430065:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cf0ff73e/0x892c60dda91c75a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c75a0 expref: 10 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528276.430075:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cf0ff73e, rc 0) 00000100:00100000:3.0:1788528276.430134:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033c28818 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+10:7438:x1875407735362432:12345-0@lo:101: Request processed in 148us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528276.430149:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788528276.430647:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a9ae4dc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735362432:0@lo:101: 00010000:00010000:2.0:1788528276.430667:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 000000001a1cb73c/0x892c60dda91c75a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c75a7 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.430677:0:7438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 000000001a1cb73c/0x892c60dda91c75a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c75a7 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528276.430757:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a9ae4dc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735362560:0@lo:501: 00000100:00100000:2.0:1788528276.430792:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528276.430823:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f06f841f going to sleep for 11 seconds 00000100:00100000:3.0:1788528276.430946:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735362560 00000100:00100000:3.0:1788528276.430952:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735362560 00000100:00100000:3.0:1788528276.430995:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788528276.431001:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071c0970c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+10:7438:x1875407735362560:12345-0@lo:501: 00000100:00100000:3.0:1788528276.431066:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071c0970c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+10:7438:x1875407735362560:12345-0@lo:501: Request processed in 66us (274us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788528276.431074:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788528276.431153:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a9ae4dc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735362560:0@lo:501: 10000000:01000000:2.0:1788528276.431166:0:7438:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.203.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:2.0:1788528276.431199:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a9ae4dc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735362688:0@lo:501: 00000100:00100000:2.0:1788528276.431223:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528276.431242:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f06f841f going to sleep for 11 seconds 00000100:00100000:3.0:1788528276.431369:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735362688 00000100:00100000:3.0:1788528276.431373:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735362688 00000100:00100000:3.0:1788528276.431576:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788528276.431583:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a822bf76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+10:7438:x1875407735362688:12345-0@lo:501: 00000100:00100000:3.0:1788528276.431645:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a822bf76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+10:7438:x1875407735362688:12345-0@lo:501: Request processed in 64us (422us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788528276.431652:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788528276.431896:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a9ae4dc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735362688:0@lo:501: 10000000:01000000:2.0:1788528276.431918:0:7438:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788528276.431937:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 000000001a1cb73c/0x892c60dda91c75a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c75a7 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.431964:0:7438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 000000001a1cb73c/0x892c60dda91c75a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c75a7 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528276.431975:0:7438:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff8a90f5add000 10000000:01000000:2.0:1788528276.431980:0:7438:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788528276.432011:0:7438:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-MDT0001-osd 00000040:01000000:2.0:1788528276.432085:0:7438:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788528276.432093:0:7438:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788528276.432100:0:7438:0:(mgc_request.c:206:do_config_log_add()) do adding config log nodemap-ffff8a90c78ee600 10000000:01000000:2.0:1788528276.432104:0:7438:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788528276.432140:0:7438:0:(mgc_request.c:2062:mgc_process_log()) Process log nodemap-ffff8a90c78ee600 from 1 10000000:01000000:2.0:1788528276.432143:0:7438:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788528276.432173:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 0000000090ef57cc/0x892c60dda91c75ae lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.432181:0:7438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 0000000090ef57cc/0x892c60dda91c75ae lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.432189:0:7438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 0000000090ef57cc/0x892c60dda91c75ae lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528276.432202:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a9ae4dc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735362816:0@lo:101: 00000100:00100000:2.0:1788528276.432242:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528276.432282:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735362816 00000100:00100000:2.0:1788528276.432298:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735362816 00000100:00100000:2.0:1788528276.432322:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788528276.432328:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8fa8fbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+10:7438:x1875407735362816:12345-0@lo:101: 00010000:00010000:2.0:1788528276.432338:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528276.432358:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b3272649/0x892c60dda91c75b5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c75ae expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.432377:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b3272649/0x892c60dda91c75b5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c75ae expref: 11 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.432399:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b3272649/0x892c60dda91c75b5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c75ae expref: 11 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.432408:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b3272649, rc 0) 00000100:00100000:0.0:1788528276.432640:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 000000006dff14f2 going to sleep for 11 seconds 00000100:00100000:2.0:1788528276.432775:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8fa8fbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+11:7438:x1875407735362816:12345-0@lo:101: Request processed in 446us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528276.432781:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788528276.432864:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a9ae4dc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735362816:0@lo:101: 00010000:00010000:0.0:1788528276.432878:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 0000000090ef57cc/0x892c60dda91c75ae lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c75b5 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.432886:0:7438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 0000000090ef57cc/0x892c60dda91c75ae lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c75b5 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528276.432903:0:7438:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788528276.432920:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 0000000090ef57cc/0x892c60dda91c75ae lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c75b5 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.432927:0:7438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 0000000090ef57cc/0x892c60dda91c75ae lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c75b5 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528276.432936:0:7438:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-barrier-ffff8a90f5add000 10000000:01000000:0.0:1788528276.432940:0:7438:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788528276.432962:0:7438:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-barrier-ffff8a90f5add000 from 1 10000000:01000000:0.0:1788528276.432964:0:7438:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788528276.432990:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 0000000084527d05/0x892c60dda91c75bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.432996:0:7438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 0000000084527d05/0x892c60dda91c75bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.433002:0:7438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 0000000084527d05/0x892c60dda91c75bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528276.433014:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004b474f66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735362944:0@lo:101: 00000100:00100000:0.0:1788528276.433041:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528276.433060:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 0000000072a83988 going to sleep for 11 seconds 00000100:00100000:2.0:1788528276.433195:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735362944 00000100:00100000:2.0:1788528276.433200:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735362944 00000100:00100000:2.0:1788528276.433223:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788528276.433229:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005fab3857 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+11:7438:x1875407735362944:12345-0@lo:101: 00010000:00010000:2.0:1788528276.433238:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528276.433247:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009b6f8c89/0x892c60dda91c75c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c75bc expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.433274:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009b6f8c89/0x892c60dda91c75c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c75bc expref: 12 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.433290:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009b6f8c89/0x892c60dda91c75c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c75bc expref: 12 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.433297:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009b6f8c89, rc 0) 00000100:00100000:2.0:1788528276.433332:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005fab3857 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+12:7438:x1875407735362944:12345-0@lo:101: Request processed in 104us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528276.433350:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788528276.433510:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004b474f66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735362944:0@lo:101: 00010000:00010000:0.0:1788528276.433522:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 0000000084527d05/0x892c60dda91c75bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c75c3 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.433528:0:7438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 0000000084527d05/0x892c60dda91c75bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c75c3 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528276.433538:0:7438:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788528276.433550:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 0000000084527d05/0x892c60dda91c75bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c75c3 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.433585:0:7438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 0000000084527d05/0x892c60dda91c75bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c75c3 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528276.433591:0:7438:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788528276.433612:0:7438:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788528276.433643:0:7438:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-MDT0001-osd 00000040:01000000:0.0:1788528276.433715:0:7438:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788528276.433728:0:7438:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788528276.433734:0:7438:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff8a90f5add000 10000000:01000000:0.0:1788528276.433738:0:7438:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788528276.433759:0:7438:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788528276.433762:0:7438:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788528276.433778:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 00000000b3168ae5/0x892c60dda91c75ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.433784:0:7438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 00000000b3168ae5/0x892c60dda91c75ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.433790:0:7438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 00000000b3168ae5/0x892c60dda91c75ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528276.433802:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004b474f66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735363072:0@lo:101: 00000100:00100000:0.0:1788528276.433828:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528276.433841:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 0000000068f61280 going to sleep for 11 seconds 00000100:00100000:2.0:1788528276.434212:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735363072 00000100:00100000:2.0:1788528276.434218:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735363072 00000100:00100000:2.0:1788528276.434240:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788528276.434245:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000091d3229 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+12:7438:x1875407735363072:12345-0@lo:101: 00010000:00010000:2.0:1788528276.434254:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528276.434286:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000068244a9c/0x892c60dda91c75d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c75ca expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.434304:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000068244a9c/0x892c60dda91c75d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c75ca expref: 13 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.434312:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000068244a9c/0x892c60dda91c75d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c75ca expref: 13 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.434318:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000068244a9c, rc 0) 00000100:00100000:2.0:1788528276.434350:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000091d3229 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+13:7438:x1875407735363072:12345-0@lo:101: Request processed in 105us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528276.434355:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788528276.434803:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004b474f66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735363072:0@lo:101: 00010000:00010000:0.0:1788528276.434819:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 00000000b3168ae5/0x892c60dda91c75ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c75d1 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.434827:0:7438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 00000000b3168ae5/0x892c60dda91c75ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c75d1 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528276.434896:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004b474f66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735363200:0@lo:501: 00000100:00100000:0.0:1788528276.434926:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528276.434951:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 0000000068f61280 going to sleep for 11 seconds 00000100:00100000:2.0:1788528276.435019:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735363200 00000100:00100000:2.0:1788528276.435024:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735363200 00000100:00100000:2.0:1788528276.435048:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788528276.435053:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a89ff94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+13:7438:x1875407735363200:12345-0@lo:501: 00000100:00100000:2.0:1788528276.435147:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a89ff94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+13:7438:x1875407735363200:12345-0@lo:501: Request processed in 94us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528276.435154:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788528276.435218:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004b474f66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735363200:0@lo:501: 00000100:00100000:0.0:1788528276.435245:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004b474f66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735363328:0@lo:503: 00000100:00100000:0.0:1788528276.435300:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528276.435320:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 0000000068f61280 going to sleep for 11 seconds 00000100:00100000:2.0:1788528276.435364:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735363328 00000100:00100000:2.0:1788528276.435368:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735363328 00000100:00100000:2.0:1788528276.435516:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788528276.435522:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac4043b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+13:7438:x1875407735363328:12345-0@lo:503: 00000100:00100000:2.0:1788528276.435755:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac4043b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+13:7438:x1875407735363328:12345-0@lo:503: Request processed in 232us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528276.435762:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788528276.435852:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004b474f66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735363328:0@lo:503: 00000040:00080000:0.0:1788528276.436101:0:7438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788528276.436170:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004b474f66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735363456:0@lo:502: 00000100:00100000:0.0:1788528276.436206:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528276.436236:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 0000000068f61280 going to sleep for 11 seconds 00000100:00100000:2.0:1788528276.436508:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735363456 00000100:00100000:2.0:1788528276.436514:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735363456 00000100:00100000:2.0:1788528276.436540:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788528276.436545:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003cf1420f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+13:7438:x1875407735363456:12345-0@lo:502: 00000100:00100000:2.0:1788528276.436804:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003cf1420f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+13:7438:x1875407735363456:12345-0@lo:502: Request processed in 258us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528276.436811:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788528276.436890:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004b474f66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735363456:0@lo:502: 00000040:00080000:0.0:1788528276.437098:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788528276.437124:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:0.0:1788528276.437138:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:0.0:1788528276.437150:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:0.0:1788528276.437162:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:0.0:1788528276.437175:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:0.0:1788528276.437186:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:0.0:1788528276.437198:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:0.0:1788528276.437209:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:0.0:1788528276.437220:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:0.0:1788528276.437232:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:0.0:1788528276.437250:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:0.0:1788528276.437274:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:0.0:1788528276.437289:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:0.0:1788528276.437301:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:0.0:1788528276.437313:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:0.0:1788528276.437325:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:0.0:1788528276.437338:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:0.0:1788528276.437349:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:0.0:1788528276.437360:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:0.0:1788528276.437372:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:0.0:1788528276.437396:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:0.0:1788528276.437795:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:0.0:1788528276.437846:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004b474f66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735363584:0@lo:502: 00000100:00100000:0.0:1788528276.437897:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528276.437984:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 0000000068f61280 going to sleep for 11 seconds 00000100:00100000:3.0:1788528276.438022:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735363584 00000100:00100000:3.0:1788528276.438030:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735363584 00000100:00100000:3.0:1788528276.438110:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788528276.438118:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091e61d76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+13:7438:x1875407735363584:12345-0@lo:502: 00000100:00100000:3.0:1788528276.438225:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091e61d76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+13:7438:x1875407735363584:12345-0@lo:502: Request processed in 109us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528276.438233:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788528276.438310:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004b474f66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735363584:0@lo:502: 00000040:00080000:0.0:1788528276.438355:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1788528276.438363:0:7438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:0.0:1788528276.439053:0:7450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788528276.439066:0:7450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528276.439069:0:7450:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788528276.439075:0:7450:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788528276.439077:0:7450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788528276.439091:0:7450:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000b9d03edd) 00000020:00000080:0.0:1788528276.439110:0:7450:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1788528276.439117:0:7450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788528276.439212:0:7450:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788528276.439220:0:7450:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x892c60dda91c75df 00000020:00000080:0.0:1788528276.439459:0:7450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788528276.439464:0:7450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528276.439467:0:7450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528276.439468:0:7450:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788528276.439471:0:7450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788528276.439475:0:7450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528276.439476:0:7450:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1788528276.439479:0:7450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788528276.439486:0:7450:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000009a6e8656) 00000020:00000080:0.0:1788528276.439496:0:7450:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1788528276.439500:0:7450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788528276.439501:0:7450:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1788528276.439504:0:7450:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788528276.439510:0:7450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788528276.439609:0:7450:0:(tgt_mount.c:167:server_get_mount()) get mount 0000000033ffa407 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788528276.439643:0:7450:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000ec6c00dc) 00000020:00000080:0.0:1788528276.439653:0:7450:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1788528276.439732:0:7450:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788528276.439739:0:7450:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x892c60dda91c75f4 00000020:00000080:0.0:1788528276.439837:0:7450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788528276.439844:0:7450:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788528276.439849:0:7450:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x892c60dda91c75fb 00080000:01000000:0.0:1788528276.439855:0:7450:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788528276.439858:0:7450:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x892c60dda91c7602 00080000:10000000:0.0:1788528276.440248:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1788528276.440390:0:7450:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1788528276.539976:0:7450:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1788528276.540835:0:7450:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1788528276.548014:0:7450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788528276.548421:0:7450:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788528276.563747:0:7450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788528276.563764:0:7450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788528276.563779:0:7450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528276.563782:0:7450:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788528276.563786:0:7450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788528276.563792:0:7450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528276.563793:0:7450:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788528276.563796:0:7450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788528276.563802:0:7450:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:00000080:3.0:1788528276.563893:0:7450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788528276.565125:0:7450:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000039915e2e) 00000020:00000080:3.0:1788528276.565155:0:7450:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788528276.565169:0:7450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788528276.565297:0:7450:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788528276.565305:0:7450:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788528276.565312:0:7450:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x892c60dda91c7610 00010000:00080000:3.0:1788528276.565362:0:7450:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008c046190@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.138@tcp at head 00010000:00010000:3.0:1788528276.569762:0:7450:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:0.0:1788528276.572091:0:7450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788528276.572105:0:7450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788528276.572146:0:7450:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788528276.572169:0:7450:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x892c60dda91c7617 00000100:00080000:0.0:1788528276.572181:0:7450:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788528276.572187:0:7450:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000008c046190 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1788528276.572230:0:7450:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004b474f66 x1875407735363712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788528276.572271:0:7450:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1788528276.572333:0:7450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528276.572338:0:7450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528276.572339:0:7450:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788528276.572342:0:7450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788528276.572344:0:7450:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788528276.572346:0:7450:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788528276.572347:0:7450:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788528276.572348:0:7450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788528276.572350:0:7450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528276.572351:0:7450:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788528276.572353:0:7450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788528276.572365:0:7450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528276.572367:0:7450:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788528276.572370:0:7450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788528276.572648:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6bdad81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735363840:0@lo:400: 00000100:00100000:3.0:1788528276.572719:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528276.572793:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735363840 00000100:00100000:3.0:1788528276.572801:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735363840 00000100:00100000:3.0:1788528276.572862:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788528276.572871:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002dba3749 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735363840:12345-0@lo:400: 00000100:00100000:3.0:1788528276.572927:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002dba3749 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735363840:12345-0@lo:400: Request processed in 58us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528276.572935:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788528276.572976:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c6bdad81 x1875407735363840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528276.572991:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6bdad81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735363840:0@lo:400: 00000004:01000000:0.0:1788528276.573186:0:7450:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788528276.573211:0:7450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528276.573215:0:7450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528276.573217:0:7450:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788528276.573220:0:7450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788528276.573222:0:7450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528276.573223:0:7450:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788528276.573225:0:7450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788528276.573227:0:7450:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788528276.573253:0:7450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528276.573256:0:7450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528276.573268:0:7450:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788528276.573271:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:2.0:1788528276.573487:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004b474f66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735363712:0@lo:38: 00000100:00100000:2.0:1788528276.573531:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528276.573682:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735363712 00000100:00100000:0.0:1788528276.573688:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735363712 00000100:00100000:0.0:1788528276.573721:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788528276.573726:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000625067d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1875407735363712:12345-0@lo:38: 00010000:00080000:0.0:1788528276.573751:0:6513:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 145 last 0 00000020:00000080:0.0:1788528276.573786:0:6513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x892c60dda91c761e 00000004:00100000:0.0:1788528276.573803:0:6513:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788528276.573811:0:6513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:3.0:1788528276.574017:0:7438:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1788528276.574041:0:7438:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788528276.574061:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 00000000b3168ae5/0x892c60dda91c75ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c75d1 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528276.574072:0:7438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 00000000b3168ae5/0x892c60dda91c75ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c75d1 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528276.574080:0:7438:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff8a90f5add000 from 1 10000000:01000000:3.0:1788528276.574083:0:7438:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788528276.574113:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 000000006c7d4e3d/0x892c60dda91c7625 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528276.574121:0:7438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 000000006c7d4e3d/0x892c60dda91c7625 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528276.574130:0:7438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 000000006c7d4e3d/0x892c60dda91c7625 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528276.574145:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6bdad81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735363968:0@lo:101: 00000100:00100000:3.0:1788528276.574184:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528276.574214:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 000000001893b040 going to sleep for 11 seconds 00000100:00100000:0.0:1788528276.574314:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735363968 00000100:00100000:0.0:1788528276.574319:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735363968 00000100:00100000:0.0:1788528276.574360:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788528276.574369:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f53f0ebd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+13:7438:x1875407735363968:12345-0@lo:101: 00010000:00010000:0.0:1788528276.574392:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528276.574407:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fb838b4a/0x892c60dda91c762c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7625 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.574441:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fb838b4a/0x892c60dda91c762c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7625 expref: 14 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.574451:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fb838b4a/0x892c60dda91c762c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7625 expref: 14 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.574460:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fb838b4a, rc 0) 00000100:00100000:0.0:1788528276.574499:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f53f0ebd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+14:7438:x1875407735363968:12345-0@lo:101: Request processed in 134us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528276.574505:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788528276.574746:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6bdad81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735363968:0@lo:101: 00010000:00010000:3.0:1788528276.574760:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 000000006c7d4e3d/0x892c60dda91c7625 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c762c expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528276.574769:0:7438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 000000006c7d4e3d/0x892c60dda91c7625 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c762c expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528276.578680:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6bdad81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735364096:0@lo:256: 00000100:00080000:0.0:1788528276.581751:0:6513:0:(import.c:65:import_set_state_nolock()) 00000000ab8a1fcd : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788528276.581922:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000625067d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1875407735363712:12345-0@lo:38: Request processed in 8191us (8387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528276.581933:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788528276.582038:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788528276.582049:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788528276.582058:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788528276.582064:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788528276.582066:0:3636:0:(import.c:65:import_set_state_nolock()) 000000008c046190 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788528276.582088:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004b474f66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735363712:0@lo:38: 00000100:00100000:3.0:1788528276.582292:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528276.582332:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 000000001893b040 going to sleep for 11 seconds 00000100:00100000:2.0:1788528276.582521:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735364096 00000100:00100000:2.0:1788528276.582529:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735364096 00000100:00100000:2.0:1788528276.582594:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788528276.582604:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022ae438d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+14:7438:x1875407735364096:12345-0@lo:256: 20000000:01000000:2.0:1788528276.582637:0:6502:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788528276.582655:0:6502:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788528276.582658:0:6502:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788528276.582753:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022ae438d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+14:7438:x1875407735364096:12345-0@lo:256: Request processed in 150us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528276.582762:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788528276.582805:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6bdad81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735364096:0@lo:256: 00000100:00100000:3.0:1788528276.582998:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c523be53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735364224:0@lo:41: 00000100:00100000:3.0:1788528276.583034:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528276.583465:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735364224 00000100:00100000:0.0:1788528276.583472:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735364224 00000100:00100000:0.0:1788528276.583512:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788528276.583519:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f9bc702 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3639:x1875407735364224:12345-0@lo:41: 00000004:00000024:0.0:1788528276.583548:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1788528276.583621:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f9bc702 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3639:x1875407735364224:12345-0@lo:41: Request processed in 103us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528276.583628:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788528276.583706:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c523be53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735364224:0@lo:41: 10000000:01000000:2.0:1788528276.584400:0:7438:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788528276.584420:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 000000006c7d4e3d/0x892c60dda91c7625 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c762c expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.584432:0:7438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 000000006c7d4e3d/0x892c60dda91c7625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c762c expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528276.584439:0:7438:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a90f5add000 from 1 10000000:01000000:2.0:1788528276.584442:0:7438:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788528276.584475:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 000000008859ef31/0x892c60dda91c7633 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.584482:0:7438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 000000008859ef31/0x892c60dda91c7633 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.584492:0:7438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 000000008859ef31/0x892c60dda91c7633 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528276.584510:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000081ea797a pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735364352:0@lo:101: 00000100:00100000:2.0:1788528276.584578:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528276.584612:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 000000006f0adc29 going to sleep for 11 seconds 00000100:00100000:1.0:1788528276.585210:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735364352 00000100:00100000:1.0:1788528276.585219:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735364352 00000100:00100000:1.0:1788528276.585275:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788528276.585284:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0f8a7e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+14:7438:x1875407735364352:12345-0@lo:101: 00010000:00010000:1.0:1788528276.585300:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528276.585318:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004cadbf8d/0x892c60dda91c763a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7633 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.585344:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004cadbf8d/0x892c60dda91c763a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7633 expref: 15 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.585355:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004cadbf8d/0x892c60dda91c763a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7633 expref: 15 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.585386:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004cadbf8d, rc 0) 00000100:00100000:1.0:1788528276.585437:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0f8a7e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+15:7438:x1875407735364352:12345-0@lo:101: Request processed in 155us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528276.585444:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788528276.585601:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000081ea797a pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735364352:0@lo:101: 00010000:00010000:0.0:1788528276.585617:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 000000008859ef31/0x892c60dda91c7633 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c763a expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.585626:0:7438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 000000008859ef31/0x892c60dda91c7633 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c763a expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528276.585719:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000422ede82 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735364480:0@lo:501: 00000100:00100000:0.0:1788528276.585749:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528276.585775:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ae1933e3 going to sleep for 11 seconds 00000100:00100000:3.0:1788528276.585900:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735364480 00000100:00100000:3.0:1788528276.585904:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735364480 00000100:00100000:3.0:1788528276.585937:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788528276.585943:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e37b06ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+15:7438:x1875407735364480:12345-0@lo:501: 00000100:00100000:3.0:1788528276.586040:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e37b06ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+15:7438:x1875407735364480:12345-0@lo:501: Request processed in 97us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528276.586047:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788528276.586079:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000422ede82 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735364480:0@lo:501: 00000100:00100000:3.0:1788528276.586109:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ac1765be pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735364608:0@lo:503: 00000100:00100000:3.0:1788528276.586148:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528276.586167:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735364608 00000100:00100000:3.0:1788528276.586171:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735364608 00000100:00100000:3.0:1788528276.586186:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788528276.586191:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006cfe30b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+15:7438:x1875407735364608:12345-0@lo:503: 00000040:00080000:3.0:1788528276.586230:0:6502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788528276.586583:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006cfe30b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+15:7438:x1875407735364608:12345-0@lo:503: Request processed in 390us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528276.586590:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788528276.586623:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 00000000770da1ef going to sleep for 11 seconds 00000100:00100000:3.0:1788528276.586636:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ac1765be pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735364608:0@lo:503: 00000040:00080000:3.0:1788528276.586893:0:7438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788528276.586944:0:7438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1788528276.587015:0:7438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788528276.588050:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:1.0:1788528276.588323:0:7438:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788528276.588335:0:7438:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788528276.588387:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 000000008859ef31/0x892c60dda91c7633 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c763a expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.588400:0:7438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 000000008859ef31/0x892c60dda91c7633 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c763a expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528276.588455:0:7438:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788528276.588458:0:7438:0:(mgc_request.c:423:config_log_add()) add config log lustre-client-ffff8a90f5add000 10000000:01000000:1.0:1788528276.588461:0:7438:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff8a90f5add000 10000000:01000000:1.0:1788528276.588466:0:7438:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788528276.588484:0:7438:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-MDT0001-osd 00000040:01000000:1.0:1788528276.588644:0:7438:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:1.0:1788528276.588653:0:7438:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:1.0:1788528276.588664:0:7438:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff8a90f5add000 from 1 10000000:01000000:1.0:1788528276.588666:0:7438:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788528276.588699:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 0000000003c263a9/0x892c60dda91c7641 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.588707:0:7438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 0000000003c263a9/0x892c60dda91c7641 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.588716:0:7438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 0000000003c263a9/0x892c60dda91c7641 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528276.588748:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000df8d8e9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735364736:0@lo:101: 00000100:00100000:1.0:1788528276.588808:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528276.589032:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 000000006aa2eb1e going to sleep for 11 seconds 00000100:00100000:2.0:1788528276.589082:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735364736 00000100:00100000:2.0:1788528276.589094:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735364736 00000100:00100000:2.0:1788528276.589147:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788528276.589156:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022b1a971 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+15:7438:x1875407735364736:12345-0@lo:101: 00010000:00010000:2.0:1788528276.589170:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528276.589181:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000083f9d3e3/0x892c60dda91c7648 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7641 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.589204:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000083f9d3e3/0x892c60dda91c7648 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7641 expref: 16 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.589213:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000083f9d3e3/0x892c60dda91c7648 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7641 expref: 16 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.589222:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000083f9d3e3, rc 0) 00000100:00100000:2.0:1788528276.589278:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022b1a971 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+16:7438:x1875407735364736:12345-0@lo:101: Request processed in 123us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528276.589284:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788528276.589361:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000df8d8e9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735364736:0@lo:101: 00010000:00010000:3.0:1788528276.589386:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 0000000003c263a9/0x892c60dda91c7641 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7648 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528276.589395:0:7438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 0000000003c263a9/0x892c60dda91c7641 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7648 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528276.589453:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ac1765be pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735364864:0@lo:501: 00000100:00100000:3.0:1788528276.589481:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528276.589507:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 00000000db04ede4 going to sleep for 11 seconds 00000100:00100000:2.0:1788528276.589645:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735364864 00000100:00100000:2.0:1788528276.589649:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735364864 00000100:00100000:2.0:1788528276.589682:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788528276.589689:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000218e8586 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+16:7438:x1875407735364864:12345-0@lo:501: 00000100:00100000:2.0:1788528276.589787:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000218e8586 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+16:7438:x1875407735364864:12345-0@lo:501: Request processed in 100us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528276.589794:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788528276.589833:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ac1765be pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735364864:0@lo:501: 00000100:00100000:2.0:1788528276.589859:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000064d4404 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735364992:0@lo:503: 00000100:00100000:2.0:1788528276.589892:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528276.589909:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735364992 00000100:00100000:2.0:1788528276.589916:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735364992 00000100:00100000:2.0:1788528276.589930:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788528276.589934:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000839e6ef8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+16:7438:x1875407735364992:12345-0@lo:503: 00000100:00100000:2.0:1788528276.589994:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000839e6ef8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+16:7438:x1875407735364992:12345-0@lo:503: Request processed in 60us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528276.590000:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788528276.590029:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 0000000087424475 going to sleep for 11 seconds 00000100:00100000:2.0:1788528276.590040:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000064d4404 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735364992:0@lo:503: 00000040:00080000:2.0:1788528276.590302:0:7438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788528276.590368:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000064d4404 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735365120:0@lo:502: 00000100:00100000:2.0:1788528276.590587:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528276.590602:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 0000000087424475 going to sleep for 11 seconds 00000100:00100000:3.0:1788528276.590648:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735365120 00000100:00100000:3.0:1788528276.590653:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735365120 00000100:00100000:3.0:1788528276.590683:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788528276.590689:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e96fc32d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+16:7438:x1875407735365120:12345-0@lo:502: 00000100:00100000:3.0:1788528276.590762:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e96fc32d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+16:7438:x1875407735365120:12345-0@lo:502: Request processed in 74us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528276.590768:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788528276.590936:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000064d4404 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735365120:0@lo:502: 00000040:00080000:2.0:1788528276.591130:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788528276.591155:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788528276.591167:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788528276.591178:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788528276.591188:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788528276.591199:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788528276.591210:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788528276.591223:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788528276.591235:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788528276.591248:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788528276.591275:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788528276.591291:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788528276.591303:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788528276.591314:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788528276.591323:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788528276.591332:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788528276.591353:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788528276.591365:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788528276.591377:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788528276.591465:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788528276.591479:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788528276.591492:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788528276.591503:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788528276.591515:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788528276.591526:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788528276.591541:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788528276.591627:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788528276.591645:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:2.0:1788528276.591672:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000064d4404 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735365248:0@lo:502: 00000100:00100000:2.0:1788528276.591719:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528276.591780:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 0000000087424475 going to sleep for 11 seconds 00000100:00100000:3.0:1788528276.592050:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735365248 00000100:00100000:3.0:1788528276.592057:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735365248 00000100:00100000:3.0:1788528276.592127:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788528276.592135:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9d2125e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+16:7438:x1875407735365248:12345-0@lo:502: 00000100:00100000:3.0:1788528276.592241:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9d2125e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+16:7438:x1875407735365248:12345-0@lo:502: Request processed in 107us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528276.592247:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788528276.592323:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000064d4404 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735365248:0@lo:502: 00000040:00080000:2.0:1788528276.592371:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788528276.592379:0:7438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788528276.593018:0:7456:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788528276.593042:0:7456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000007dc61dac) 00000020:00000080:2.0:1788528276.593071:0:7456:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788528276.593149:0:7456:0:(tgt_mount.c:167:server_get_mount()) get mount 0000000033ffa407 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788528276.593154:0:7456:0:(tgt_mount.c:201:server_put_mount()) put mount 0000000033ffa407 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788528276.593157:0:7456:0:(obd_mount.c:712:lustre_put_lsi()) put 0000000033ffa407 3 00010000:00080000:2.0:1788528276.593191:0:7456:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009b8647c3@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.138@tcp at head 00010000:00010000:2.0:1788528276.595448:0:7456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:2.0:1788528276.595739:0:7456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788528276.595783:0:7456:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788528276.595797:0:7456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x892c60dda91c7656 00000100:00080000:2.0:1788528276.595809:0:7456:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788528276.595934:0:7456:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000009b8647c3 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1788528276.596181:0:7456:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000978f3138 x1875407735365376/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788528276.596238:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000978f3138 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875407735365376:0@lo:38: 00000100:00100000:2.0:1788528276.596324:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528276.596418:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735365376 00000100:00100000:3.0:1788528276.596434:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735365376 00000100:00100000:3.0:1788528276.596469:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788528276.596476:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000064d4404 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1875407735365376:12345-0@lo:38: 00010000:00080000:3.0:1788528276.596501:0:6509:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 145 last 0 00000020:00000080:3.0:1788528276.596533:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x892c60dda91c765d 00000004:00100000:3.0:1788528276.596547:0:6509:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788528276.596600:0:6509:0:(import.c:65:import_set_state_nolock()) 0000000022e7e27b : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788528276.597361:0:7456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788528276.599977:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000064d4404 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875407735365376:12345-0@lo:38: Request processed in 3493us (3646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528276.599995:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788528276.600310:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000978f3138 x1875407735365376/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788528286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528276.600323:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788528276.600336:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788528276.600345:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788528276.600349:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788528276.600353:0:3636:0:(import.c:65:import_set_state_nolock()) 000000009b8647c3 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788528276.600360:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000978f3138 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875407735365376:0@lo:38: 00000040:00080000:0.0:1788528276.600579:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1788528276.600682:0:7438:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788528276.600701:0:7438:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788528276.600714:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 0000000003c263a9/0x892c60dda91c7641 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7648 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528276.600724:0:7438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 0000000003c263a9/0x892c60dda91c7641 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7648 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788528276.600784:0:7438:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788528276.600786:0:7438:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788528276.600787:0:7438:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788528276.600788:0:7438:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788528276.600789:0:7438:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788528276.600791:0:7438:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788528276.600792:0:7438:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788528276.600793:0:7438:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788528276.600794:0:7438:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788528276.600796:0:7438:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788528276.600797:0:7438:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788528276.600800:0:7438:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1788528276.600803:0:7438:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788528276.600804:0:7438:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788528276.600805:0:7438:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788528276.600806:0:7438:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788528276.600807:0:7438:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788528276.600808:0:7438:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788528276.600809:0:7438:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788528276.600810:0:7438:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788528276.600811:0:7438:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788528276.600974:0:7438:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788528276.600975:0:7438:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788528276.601001:0:7438:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788528276.601017:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000000c0922 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735365504:0@lo:253: 00000100:00100000:0.0:1788528276.601085:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528276.601116:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 000000007780c81d going to sleep for 11 seconds 40000000:00080000:1.0:1788528276.601122:0:7458:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:2.0:1788528276.601190:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735365504 00000100:00100000:2.0:1788528276.601198:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735365504 00000100:00100000:2.0:1788528276.601243:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788528276.601252:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ea25f47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+16:7438:x1875407735365504:12345-0@lo:253: 20000000:01000000:2.0:1788528276.601290:0:6500:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788528276.601303:0:6500:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1788528276.602614:0:6487:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788528276.605503:0:6500:0:(mgs_nids.c:820:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788528276.605523:0:6500:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1788528276.605626:0:6524:0:(mgs_nids.c:717:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788528276.605631:0:6524:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788528276.605654:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f82cb60a/0x892c60dda91c7664 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.605676:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000038a509d1/0x892c60dda91c7584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7576 expref: 16 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.605682:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fb838b4a/0x892c60dda91c762c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7625 expref: 16 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.605696:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f82cb60a/0x892c60dda91c7664 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.605740:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fb838b4a/0x892c60dda91c762c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c7625 expref: 16 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.605754:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fb838b4a/0x892c60dda91c762c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c7625 expref: 16 pid: 6500 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528276.605771:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001ce3cd06 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6524:1875407735365632:0@lo:104: 00000100:00100000:2.0:1788528276.605981:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788528276.606029:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000038a509d1/0x892c60dda91c7584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c7576 expref: 16 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.606036:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000038a509d1/0x892c60dda91c7584 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c7576 expref: 16 pid: 6500 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528276.606043:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006c73295 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6524:1875407735365760:0@lo:104: 00000100:00100000:2.0:1788528276.606065:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528276.606087:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set 000000006b35d228 going to sleep for 11 seconds 00000100:00100000:3.0:1788528276.606194:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735365632 00000100:00100000:3.0:1788528276.606203:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735365632 00000100:00100000:3.0:1788528276.606241:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735365760 00000100:00100000:3.0:1788528276.606244:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735365760 00000100:00100000:3.0:1788528276.606269:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788528276.606277:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8fc8a7b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+4:6524:x1875407735365632:12345-0@lo:104: 00010000:00010000:3.0:1788528276.606291:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: 000000006c7d4e3d/0x892c60dda91c7625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c762c expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528276.606357:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788528276.606363:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8fc8a7b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+4:6524:x1875407735365632:12345-0@lo:104: Request processed in 87us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528276.606369:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788528276.606387:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788528276.606392:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f99faea7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+3:6524:x1875407735365760:12345-0@lo:104: 00010000:00010000:3.0:1788528276.606399:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: 00000000624b3072/0x892c60dda91c7576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7584 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.606448:0:6496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788528276.606450:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788528276.606454:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f99faea7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+3:6524:x1875407735365760:12345-0@lo:104: Request processed in 63us (389us total) trans 0 rc 0/0 00010000:00010000:1.0:1788528276.606454:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: 000000006c7d4e3d/0x892c60dda91c7625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c762c expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528276.606462:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788528276.606464:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006c7d4e3d already unused, calling callback (000000009849d88c) 10000000:00010000:1.0:1788528276.606467:0:6496:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: 000000006c7d4e3d/0x892c60dda91c7625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c762c expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.606474:0:6496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: 000000006c7d4e3d/0x892c60dda91c7625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c762c expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528276.606480:0:6496:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: 000000006c7d4e3d/0x892c60dda91c7625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c762c expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528276.606486:0:6496:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788528276.606525:0:6496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: 000000006c7d4e3d/0x892c60dda91c7625 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c762c expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.606533:0:6496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528276.606550:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: 000000006c7d4e3d/0x892c60dda91c7625 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c762c expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.606586:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: 000000006c7d4e3d/0x892c60dda91c7625 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c762c expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.606598:0:6496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528276.606600:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: 00000000624b3072/0x892c60dda91c7576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7584 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.606606:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000624b3072 already unused, calling callback (000000009849d88c) 10000000:00010000:1.0:1788528276.606608:0:6496:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: 00000000624b3072/0x892c60dda91c7576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c7584 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.606614:0:6496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: 00000000624b3072/0x892c60dda91c7576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c7584 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528276.606619:0:6496:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: 00000000624b3072/0x892c60dda91c7576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c7584 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528276.606624:0:6496:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788528276.606638:0:6496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: 00000000624b3072/0x892c60dda91c7576 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7584 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.606644:0:6496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528276.606658:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: 00000000624b3072/0x892c60dda91c7576 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7584 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.606664:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: 00000000624b3072/0x892c60dda91c7576 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7584 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.606677:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528276.606684:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528276.606686:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528276.606700:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b4902b3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735365888:0@lo:103: 00000100:00100000:1.0:1788528276.606732:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528276.606773:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009fe642e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735366016:0@lo:103: 00000100:00100000:1.0:1788528276.606794:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788528276.607177:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528276.607313:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001ce3cd06 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6524:1875407735365632:0@lo:104: 00000100:00100000:2.0:1788528276.607324:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006c73295 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6524:1875407735365760:0@lo:104: 00010000:00010000:2.0:1788528276.607347:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f82cb60a/0x892c60dda91c7664 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528276.607466:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735365888 00000100:00100000:1.0:1788528276.607472:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735365888 00010000:00010000:1.0:1788528276.607494:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fb838b4a/0x892c60dda91c762c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7625 expref: 17 pid: 6500 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528276.607518:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735366016 00000100:00100000:1.0:1788528276.607522:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735366016 00010000:00010000:1.0:1788528276.607532:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000038a509d1/0x892c60dda91c7584 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7576 expref: 18 pid: 6500 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528276.607544:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788528276.607549:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c750d54e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+18:3640:x1875407735365888:12345-0@lo:103: 00010000:00010000:1.0:1788528276.607585:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528276.607590:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fb838b4a/0x892c60dda91c762c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7625 expref: 18 pid: 6500 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.607599:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fb838b4a/0x892c60dda91c762c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c7625 expref: 18 pid: 6500 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.607613:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fb838b4a/0x892c60dda91c762c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c7625 expref: 18 pid: 6500 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.607626:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528276.607663:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c750d54e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+17:3640:x1875407735365888:12345-0@lo:103: Request processed in 114us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528276.607677:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788528276.607692:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788528276.607697:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000249df786 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+16:3637:x1875407735366016:12345-0@lo:103: 00010000:00010000:1.0:1788528276.607705:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528276.607708:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000038a509d1/0x892c60dda91c7584 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7576 expref: 16 pid: 6500 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.607717:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000038a509d1/0x892c60dda91c7584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c7576 expref: 16 pid: 6500 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.607725:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000038a509d1/0x892c60dda91c7584 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c7576 expref: 16 pid: 6500 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.607735:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f82cb60a/0x892c60dda91c7664 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.607743:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f82cb60a/0x892c60dda91c7664 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788528276.607757:0:6495:0:(mgs_nids.c:693:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008026504s 00010000:00010000:1.0:1788528276.607761:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f82cb60a/0x892c60dda91c7664 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.607768:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f82cb60a/0x892c60dda91c7664 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.607773:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f82cb60a/0x892c60dda91c7664 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.607778:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f82cb60a/0x892c60dda91c7664 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.607790:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f82cb60a already unused, calling callback (0000000092c28bba) 00010000:00010000:1.0:1788528276.607795:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f82cb60a/0x892c60dda91c7664 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.607801:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f82cb60a/0x892c60dda91c7664 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.607812:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f82cb60a/0x892c60dda91c7664 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.607918:0:6524:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f82cb60a/0x892c60dda91c7664 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528276.607937:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f82cb60a/0x892c60dda91c7664 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528276.608540:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ea25f47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+15:7438:x1875407735365504:12345-0@lo:253: Request processed in 7287us (7454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528276.608549:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788528276.608622:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000000c0922 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:7438:1875407735365504:0@lo:253: 10000000:01000000:0.0:1788528276.608635:0:7438:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788528276.608638:0:7438:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788528276.608640:0:7438:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788528276.608641:0:7438:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788528276.608642:0:7438:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788528276.608643:0:7438:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788528276.608644:0:7438:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788528276.608645:0:7438:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788528276.608647:0:7438:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788528276.608648:0:7438:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788528276.608649:0:7438:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788528276.608651:0:7438:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788528276.608665:0:7438:0:(tgt_mount.c:2815:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788528276.608907:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528276.608981:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f82cb60a/0x892c60dda91c7664 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528276.608999:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528276.609033:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000249df786 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+14:3637:x1875407735366016:12345-0@lo:103: Request processed in 1335us (2238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528276.609040:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788528276.609074:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009fe642e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735366016:0@lo:103: 00000100:00100000:1.0:1788528276.609097:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b4902b3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735365888:0@lo:103: 00080000:10000000:0.0:1788528276.617251:0:7438:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:0.0:1788528276.618133:0:7438:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788528276.619900:0:7438:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1788528276.620914:0:7438:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788528276.621186:0:7438:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1788528276.622492:0:7438:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1788528276.623748:0:7438:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788528276.624053:0:7438:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1788528276.624234:0:7438:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1788528276.624489:0:7438:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1788528276.624939:0:7438:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1788528276.625114:0:7438:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:2.0:1788528276.626913:0:7438:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1788528276.627226:0:7462:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:2.0:1788528276.627297:0:7462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006c73295 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7462:1875407735366144:0@lo:700: 00000020:00080000:1.0:1788528276.627376:0:7461:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788528276.627380:0:7461:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788528276.627389:0:7462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528276.627437:0:7462:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d2026355 going to sleep for 11 seconds 00000100:00100000:1.0:1788528276.627493:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735366144 00000100:00100000:1.0:1788528276.627502:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735366144 00000040:01000000:0.0:1788528276.627522:0:7438:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1788528276.627574:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788528276.627583:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ce3cd06 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7462:x1875407735366144:12345-0@lo:700: 00000100:00100000:2.0:1788528276.628222:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ae4c3ad pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7463:1875407735366272:0@lo:1000: 00000100:00100000:2.0:1788528276.628277:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528276.628309:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 0000000054622ddb going to sleep for 11 seconds 00000100:00100000:0.0:1788528276.628358:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735366272 00000100:00100000:0.0:1788528276.628363:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735366272 00000100:00100000:0.0:1788528276.628413:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788528276.628420:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001dd55300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7463:x1875407735366272:12345-0@lo:1000: 00000100:00100000:0.0:1788528276.628507:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001dd55300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7463:x1875407735366272:12345-0@lo:1000: Request processed in 88us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528276.628514:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788528276.628662:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ae4c3ad pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7463:1875407735366272:0@lo:1000: 00000040:01000000:3.0:1788528276.628691:0:7463:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1788528276.628713:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b49405f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7463:1875407735366400:0@lo:700: 00000100:00100000:3.0:1788528276.628739:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528276.628765:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 00000000173f9a76 going to sleep for 11 seconds 00000100:00100000:0.0:1788528276.628956:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735366400 00000100:00100000:0.0:1788528276.628961:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735366400 00000100:00100000:0.0:1788528276.628990:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788528276.628997:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a8037bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7463:x1875407735366400:12345-0@lo:700: 00000100:00100000:0.0:1788528276.629047:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a8037bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7463:x1875407735366400:12345-0@lo:700: Request processed in 52us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528276.629055:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788528276.629114:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b49405f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7463:1875407735366400:0@lo:700: 00000100:00100000:3.0:1788528276.629155:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b49405f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7463:1875407735366528:0@lo:900: 00000100:00100000:3.0:1788528276.629183:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528276.629205:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 00000000173f9a76 going to sleep for 11 seconds 00000100:00100000:0.0:1788528276.629296:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735366528 00000100:00100000:0.0:1788528276.629301:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735366528 00000100:00100000:0.0:1788528276.629332:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788528276.629338:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000829c1c28 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7463:x1875407735366528:12345-0@lo:900: 00000100:00100000:0.0:1788528276.629489:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000829c1c28 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7463:x1875407735366528:12345-0@lo:900: Request processed in 150us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528276.629495:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:1.0:1788528276.632045:0:7438:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788528276.632223:0:7438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00080000:3.0:1788528276.632630:0:7463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000006b49405f x1875407735366528/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788528292 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528276.632649:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b49405f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7463:1875407735366528:0@lo:900: 00000100:00100000:3.0:1788528276.632781:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b49405f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7463:1875407735366656:0@lo:1000: 00000100:00100000:3.0:1788528276.632859:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528276.632904:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735366656 00000100:00100000:3.0:1788528276.632910:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735366656 00000100:00100000:3.0:1788528276.632962:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788528276.632970:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e94584a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7463:x1875407735366656:12345-0@lo:1000: 00000100:00100000:3.0:1788528276.633048:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e94584a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7463:x1875407735366656:12345-0@lo:1000: Request processed in 79us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528276.633065:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788528276.633099:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 0000000060bd0c13 going to sleep for 11 seconds 00000100:00100000:3.0:1788528276.633115:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b49405f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7463:1875407735366656:0@lo:1000: 00000004:00080000:3.0:1788528276.633153:0:7463:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000173f9a76 with version 0 00000020:00100000:3.0:1788528276.633166:0:7463:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788528276.633171:0:7463:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000006b49405f x1875407735366912/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788528276.633183:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b49405f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7463:1875407735366912:0@lo:1000: 00000100:00100000:3.0:1788528276.633206:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528276.633224:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735366912 00000100:00100000:3.0:1788528276.633227:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735366912 00000100:00100000:3.0:1788528276.633242:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788528276.633246:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024674c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7463:x1875407735366912:12345-0@lo:1000: 00000004:00000080:1.0:1788528276.633629:0:7438:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788528276.633642:0:7438:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788528276.633852:0:7438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788528276.634778:0:7438:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788528276.635543:0:7438:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788528276.635604:0:7438:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788528276.637351:0:7438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788528276.637729:0:7438:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788528276.638488:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 40000000:02000000:0.0:1788528276.638573:0:6515:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:1.0:1788528276.638905:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788528276.639054:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788528276.639204:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788528276.639378:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788528276.639686:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788528276.639896:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788528276.640036:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788528276.640232:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00000100:00100000:3.0:1788528276.640240:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b2634293 going to sleep for 11 seconds 00100000:10000000:1.0:1788528276.640485:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788528276.640772:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788528276.640991:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788528276.641145:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788528276.641302:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788528276.641481:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788528276.641735:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788528276.642105:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788528276.642273:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788528276.642892:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788528276.643634:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788528276.643950:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788528276.644223:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788528276.644375:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00000001:00080000:2.0:1788528276.644503:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00100000:10000000:1.0:1788528276.646031:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788528276.646199:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788528276.646386:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788528276.646623:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00000100:00100000:0.0:1788528276.647014:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ce3cd06 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7462:x1875407735366144:12345-0@lo:700: Request processed in 19427us (19630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528276.647033:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:1.0:1788528276.647090:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788528276.647227:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788528276.647377:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00010000:00080000:2.0:1788528276.647508:0:7462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000006c73295 x1875407735366144/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788528292 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528276.647525:0:7462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006c73295 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7462:1875407735366144:0@lo:700: 40000000:02000000:2.0:1788528276.647540:0:7462:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000100:00100000:3.0:1788528276.647975:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024674c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7463:x1875407735366912:12345-0@lo:1000: Request processed in 14727us (14767us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788528276.647986:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:0.0:1788528276.648118:0:7463:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1788528276.648122:0:7463:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788528276.648135:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b49405f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7463:1875407735366912:0@lo:1000: 00000100:00100000:0.0:1788528276.648236:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000000c0922 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7463:1875407735367040:0@lo:1000: 00000100:00100000:0.0:1788528276.648289:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528276.648328:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 000000007205dc2b going to sleep for 11 seconds 00000100:00100000:3.0:1788528276.649956:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735367040 00000100:00100000:3.0:1788528276.649970:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735367040 00000100:00100000:3.0:1788528276.650034:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788528276.650044:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000716feecc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7463:x1875407735367040:12345-0@lo:1000: 00000100:00100000:3.0:1788528276.650171:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000716feecc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7463:x1875407735367040:12345-0@lo:1000: Request processed in 128us (1881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528276.650179:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788528276.650484:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000000c0922 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7463:1875407735367040:0@lo:1000: 00000040:00080000:0.0:1788528276.650513:0:7463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788528276.650579:0:7463:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000001e036f2d with version 1 00100000:10000000:1.0:1788528276.650770:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788528276.651015:0:7438:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788528276.651234:0:7438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000004:00080000:3.0:1788528276.651434:0:7453:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000050986ad8 version 1 rpc_version 1 00000020:00100000:3.0:1788528276.651464:0:7453:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788528276.651479:0:7453:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000877f2746 x1875407735367296/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788528276.651503:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000877f2746 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7453:1875407735367296:0@lo:1000: 00000100:00100000:3.0:1788528276.651573:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528276.651609:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 000000004269f056 going to sleep for 11 seconds 00000100:00100000:3.0:1788528276.651631:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735367296 00000100:00100000:3.0:1788528276.651638:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735367296 00000100:00100000:3.0:1788528276.651679:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788528276.651687:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c97e72db pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7453:x1875407735367296:12345-0@lo:1000: 00000001:00080000:1.0:1788528276.656062:0:7438:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788528276.656100:0:7438:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9b7a01f139b8 00100000:10000000:1.0:1788528276.656108:0:7438:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000040:00080000:0.0:1788528276.656345:0:7463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788528276.656488:0:7463:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:0.0:1788528276.659883:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1788528276.660158:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c97e72db pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7453:x1875407735367296:12345-0@lo:1000: Request processed in 8468us (8601us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788528276.660178:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1788528276.660280:0:7453:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1788528276.660285:0:7453:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788528276.660306:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000877f2746 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7453:1875407735367296:0@lo:1000: 00000020:01000004:1.0:1788528276.660494:0:7438:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788528276.660512:0:7438:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788528276.661229:0:7438:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788528276.661441:0:7438:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:2.0:1788528276.676001:0:7462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788528276.680773:0:7462:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788528276.680857:0:7462:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788528276.680862:0:7462:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1788528277.631782:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528278.655537:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528279.678835:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528280.702753:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788528280.760107:0:7708:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:0.0:1788528281.504158:0:7760:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788528281.504389:0:7760:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788528281.728083:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528281.791173:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000877f2746 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735367424:0@lo:400: 00000100:00100000:3.0:1788528281.791244:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000b1bf4db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735367552:0@lo:400: 00000100:00100000:2.0:1788528281.791671:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b49405f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735367808:0@lo:400: 00000100:00100000:3.0:1788528281.791800:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528281.791883:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788528281.791890:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aa85f9d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735367680:0@lo:400: 00000100:00100000:3.0:1788528281.791920:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528281.791961:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735367680 00000100:00100000:3.0:1788528281.791969:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735367680 00000100:00100000:3.0:1788528281.792022:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788528281.792031:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6bdad81 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735367680:12345-0@lo:400: 00000100:00100000:3.0:1788528281.792097:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6bdad81 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735367680:12345-0@lo:400: Request processed in 68us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528281.792105:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788528281.792155:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aa85f9d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735367680:0@lo:400: 00000100:00100000:0.0:1788528281.792675:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735367552 00000100:00100000:0.0:1788528281.792682:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735367552 00000100:00100000:0.0:1788528281.792714:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788528281.792719:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac1765be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735367552:12345-0@lo:400: 00000100:00100000:0.0:1788528281.792763:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac1765be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735367552:12345-0@lo:400: Request processed in 45us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528281.792770:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788528281.793464:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528281.793857:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528281.793913:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788528281.793924:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006c73295 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735367936:0@lo:41: 00000100:00100000:2.0:1788528281.793958:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528281.794367:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735367808 00000100:00100000:1.0:1788528281.794533:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735367808 00000100:00100000:1.0:1788528281.794748:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788528281.794758:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ae4c3ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735367808:12345-0@lo:400: 00000100:00100000:1.0:1788528281.794876:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ae4c3ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735367808:12345-0@lo:400: Request processed in 117us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528281.794880:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735367424 00000100:00100000:1.0:1788528281.794888:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788528281.794892:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735367424 00000100:00100000:0.0:1788528281.794962:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788528281.794973:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000411a54d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+14:3638:x1875407735367424:12345-0@lo:400: 00010000:00080000:2.0:1788528281.794997:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000b1bf4db x1875407735367552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528281.795016:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000b1bf4db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735367552:0@lo:400: 00000100:00100000:0.0:1788528281.795042:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000411a54d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+14:3638:x1875407735367424:12345-0@lo:400: Request processed in 70us (1583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528281.795052:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788528281.795070:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735367936 00000100:00100000:2.0:1788528281.795078:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735367936 00000100:00100000:2.0:1788528281.795130:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788528281.795140:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081ea797a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735367936:12345-0@lo:41: 00000100:00100000:0.0:1788528281.795143:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000877f2746 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735367424:0@lo:400: 00000004:00000024:2.0:1788528281.795180:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1788528281.795248:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081ea797a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735367936:12345-0@lo:41: Request processed in 110us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528281.795255:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788528281.798083:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006c73295 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735367936:0@lo:41: 00010000:00080000:2.0:1788528281.798302:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000006b49405f x1875407735367808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528281.798315:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b49405f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735367808:0@lo:400: 00010000:00010000:3.0:1788528282.750851:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528283.775961:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788528283.840029:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788528283.840039:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff8a90f5add000 from 4 10000000:01000000:1.0:1788528283.840056:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788528283.840176:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 000000004268ed96/0x892c60dda91c766b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528283.840191:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 000000004268ed96/0x892c60dda91c766b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528283.840203:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 000000004268ed96/0x892c60dda91c766b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528283.840241:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b4902b3b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735368064:0@lo:101: 00000100:00100000:1.0:1788528283.840339:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528283.840397:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c92f4631 going to sleep for 11 seconds 00000100:00100000:1.0:1788528283.840422:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735368064 00000100:00100000:1.0:1788528283.840430:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735368064 00000100:00100000:1.0:1788528283.840498:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788528283.840507:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cde5afe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+14:6506:x1875407735368064:12345-0@lo:101: 00010000:00010000:1.0:1788528283.840521:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528283.840534:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000166130a4/0x892c60dda91c7672 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c766b expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528283.840579:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000166130a4/0x892c60dda91c7672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c766b expref: 15 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528283.840611:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000166130a4/0x892c60dda91c7672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c766b expref: 15 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528283.840621:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000166130a4, rc 0) 00000100:00100000:1.0:1788528283.840663:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cde5afe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+15:6506:x1875407735368064:12345-0@lo:101: Request processed in 156us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528283.840670:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788528283.840707:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b4902b3b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735368064:0@lo:101: 00010000:00010000:3.0:1788528283.840725:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 000000004268ed96/0x892c60dda91c766b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7672 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528283.840735:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 000000004268ed96/0x892c60dda91c766b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7672 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528283.840807:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aa85f9d3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735368192:0@lo:256: 00000100:00100000:3.0:1788528283.840848:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528283.840871:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set 000000003b498a61 going to sleep for 11 seconds 00000100:00100000:1.0:1788528283.844471:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735368192 00000100:00100000:1.0:1788528283.844489:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735368192 00000100:00100000:1.0:1788528283.844588:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788528283.844598:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d9be129 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+15:6506:x1875407735368192:12345-0@lo:256: 20000000:01000000:1.0:1788528283.844634:0:6501:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788528283.844655:0:6501:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788528283.844659:0:6501:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788528283.844814:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d9be129 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+15:6506:x1875407735368192:12345-0@lo:256: Request processed in 218us (3966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528283.844823:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788528283.844884:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aa85f9d3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735368192:0@lo:256: 10000000:01000000:1.0:1788528283.844959:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788528283.844969:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 000000004268ed96/0x892c60dda91c766b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7672 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528283.844981:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 000000004268ed96/0x892c60dda91c766b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7672 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528283.844996:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788528283.844998:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff8a90c7f88000 from 21 10000000:01000000:1.0:1788528283.845009:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788528283.845042:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 0000000080b189d9/0x892c60dda91c7679 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528283.845050:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 0000000080b189d9/0x892c60dda91c7679 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528283.845058:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 0000000080b189d9/0x892c60dda91c7679 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528283.845076:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009fe642e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735368320:0@lo:101: 00000100:00100000:1.0:1788528283.845113:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528283.845158:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c92f4631 going to sleep for 11 seconds 00000100:00100000:2.0:1788528283.845296:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735368320 00000100:00100000:2.0:1788528283.845308:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735368320 00000100:00100000:2.0:1788528283.845345:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788528283.845351:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077722b99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+15:6506:x1875407735368320:12345-0@lo:101: 00010000:00010000:2.0:1788528283.845360:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528283.845372:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000acf2d2f3/0x892c60dda91c7680 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7679 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528283.845395:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000acf2d2f3/0x892c60dda91c7680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7679 expref: 16 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528283.845405:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000acf2d2f3/0x892c60dda91c7680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7679 expref: 16 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528283.845413:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000acf2d2f3, rc 0) 00000100:00100000:2.0:1788528283.845452:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077722b99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+16:6506:x1875407735368320:12345-0@lo:101: Request processed in 102us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528283.845458:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788528283.845489:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009fe642e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735368320:0@lo:101: 00010000:00010000:2.0:1788528283.845499:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 0000000080b189d9/0x892c60dda91c7679 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7680 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528283.845506:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 0000000080b189d9/0x892c60dda91c7679 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7680 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528283.845532:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006c73295 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735368448:0@lo:501: 00000100:00100000:2.0:1788528283.845575:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528283.845591:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ff0e02e5 going to sleep for 11 seconds 00000100:00100000:2.0:1788528283.845599:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735368448 00000100:00100000:2.0:1788528283.845601:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735368448 00000100:00100000:2.0:1788528283.845623:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788528283.845626:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056dc07fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+16:6506:x1875407735368448:12345-0@lo:501: 00000100:00100000:2.0:1788528283.845746:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056dc07fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+16:6506:x1875407735368448:12345-0@lo:501: Request processed in 119us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528283.845752:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788528283.845784:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006c73295 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735368448:0@lo:501: 00000100:00100000:2.0:1788528283.845822:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006c73295 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735368576:0@lo:503: 00000100:00100000:2.0:1788528283.845864:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528283.845879:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ff0e02e5 going to sleep for 11 seconds 00000100:00100000:2.0:1788528283.845891:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735368576 00000100:00100000:2.0:1788528283.845894:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735368576 00000100:00100000:2.0:1788528283.845910:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788528283.845914:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051d4663c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+16:6506:x1875407735368576:12345-0@lo:503: 00000100:00100000:2.0:1788528283.845997:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051d4663c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+16:6506:x1875407735368576:12345-0@lo:503: Request processed in 83us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528283.846004:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788528283.846044:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006c73295 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735368576:0@lo:503: 00000100:00100000:2.0:1788528283.846515:0:7842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006c73295 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:7842:1875407735368704:0@lo:502: 00000100:00100000:2.0:1788528283.846546:0:7842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528283.846611:0:7842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b2053644 going to sleep for 11 seconds 00000100:00100000:1.0:1788528283.846635:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735368704 00000100:00100000:1.0:1788528283.846639:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735368704 00000100:00100000:1.0:1788528283.846682:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788528283.846687:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f367f8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+16:7842:x1875407735368704:12345-0@lo:502: 00000100:00100000:1.0:1788528283.846774:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f367f8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+16:7842:x1875407735368704:12345-0@lo:502: Request processed in 86us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528283.846781:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788528283.846837:0:7842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006c73295 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:7842:1875407735368704:0@lo:502: 00000100:00100000:2.0:1788528283.846878:0:7842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006c73295 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:7842:1875407735368832:0@lo:502: 00000100:00100000:2.0:1788528283.846909:0:7842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528283.846932:0:7842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b2053644 going to sleep for 11 seconds 00000100:00100000:1.0:1788528283.846961:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735368832 00000100:00100000:1.0:1788528283.846965:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735368832 00000100:00100000:1.0:1788528283.846991:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788528283.846996:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b8f1ba3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+16:7842:x1875407735368832:12345-0@lo:502: 00000100:00100000:1.0:1788528283.847054:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b8f1ba3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+16:7842:x1875407735368832:12345-0@lo:502: Request processed in 58us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528283.847061:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788528283.847206:0:7842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006c73295 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:7842:1875407735368832:0@lo:502: 00000040:00080000:2.0:1788528283.847243:0:7842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788528283.847438:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788528283.847447:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788528283.847462:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 0000000080b189d9/0x892c60dda91c7679 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7680 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528283.847473:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 0000000080b189d9/0x892c60dda91c7679 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7680 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528283.847484:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788528283.847487:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff8a90c7f88000 from 4 10000000:01000000:1.0:1788528283.847490:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788528283.847516:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 0000000081538938/0x892c60dda91c7687 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528283.847523:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 0000000081538938/0x892c60dda91c7687 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528283.847532:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 0000000081538938/0x892c60dda91c7687 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528283.847545:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074cda608 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735368960:0@lo:101: 00000100:00100000:1.0:1788528283.847863:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528283.847932:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set 0000000013ead626 going to sleep for 11 seconds 00000100:00100000:2.0:1788528283.847969:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735368960 00000100:00100000:2.0:1788528283.847975:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735368960 00000100:00100000:2.0:1788528283.848051:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788528283.848058:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093e08056 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+16:6506:x1875407735368960:12345-0@lo:101: 00010000:00010000:2.0:1788528283.848070:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528283.848086:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005dc2818f/0x892c60dda91c768e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7687 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528283.848109:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005dc2818f/0x892c60dda91c768e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7687 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528283.848120:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005dc2818f/0x892c60dda91c768e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7687 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528283.848128:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005dc2818f, rc 0) 00000100:00100000:2.0:1788528283.848170:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093e08056 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+17:6506:x1875407735368960:12345-0@lo:101: Request processed in 113us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528283.848177:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788528283.848241:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074cda608 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735368960:0@lo:101: 00010000:00010000:1.0:1788528283.848255:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 0000000081538938/0x892c60dda91c7687 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c768e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528283.848263:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 0000000081538938/0x892c60dda91c7687 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c768e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528283.848309:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074cda608 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735369088:0@lo:256: 00000100:00100000:1.0:1788528283.848347:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528283.848409:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set 0000000013ead626 going to sleep for 11 seconds 00000100:00100000:0.0:1788528283.848435:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735369088 00000100:00100000:0.0:1788528283.848440:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735369088 00000100:00100000:0.0:1788528283.848464:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788528283.848469:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc21dd50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+17:6506:x1875407735369088:12345-0@lo:256: 20000000:01000000:0.0:1788528283.848485:0:6501:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788528283.848503:0:6501:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788528283.848507:0:6501:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788528283.848606:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc21dd50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+17:6506:x1875407735369088:12345-0@lo:256: Request processed in 137us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528283.848613:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788528283.848810:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074cda608 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735369088:0@lo:256: 10000000:01000000:1.0:1788528283.848857:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788528283.848864:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 0000000081538938/0x892c60dda91c7687 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c768e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528283.848871:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 0000000081538938/0x892c60dda91c7687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c768e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528283.848879:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788528283.848882:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788528283.848884:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788528283.848903:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 000000003e1daff9/0x892c60dda91c7695 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528283.848909:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 000000003e1daff9/0x892c60dda91c7695 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528283.848916:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 000000003e1daff9/0x892c60dda91c7695 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528283.848928:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074cda608 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735369216:0@lo:101: 00000100:00100000:1.0:1788528283.848953:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528283.849019:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set 0000000013ead626 going to sleep for 11 seconds 00000100:00100000:0.0:1788528283.849051:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735369216 00000100:00100000:0.0:1788528283.849056:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735369216 00000100:00100000:0.0:1788528283.849115:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788528283.849121:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043a48821 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+17:6506:x1875407735369216:12345-0@lo:101: 00010000:00010000:0.0:1788528283.849130:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528283.849140:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000acd1bc08/0x892c60dda91c769c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7695 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528283.849157:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000acd1bc08/0x892c60dda91c769c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7695 expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528283.849165:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000acd1bc08/0x892c60dda91c769c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7695 expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528283.849171:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000acd1bc08, rc 0) 00000100:00100000:0.0:1788528283.849204:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043a48821 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735369216:12345-0@lo:101: Request processed in 84us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528283.849218:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788528283.849278:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074cda608 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735369216:0@lo:101: 00010000:00010000:1.0:1788528283.849288:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 000000003e1daff9/0x892c60dda91c7695 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c769c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528283.849305:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 000000003e1daff9/0x892c60dda91c7695 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c769c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528283.849335:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074cda608 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735369344:0@lo:501: 00000100:00100000:1.0:1788528283.849359:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528283.849416:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set 0000000013ead626 going to sleep for 11 seconds 00000100:00100000:2.0:1788528283.849450:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735369344 00000100:00100000:2.0:1788528283.849455:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735369344 00000100:00100000:2.0:1788528283.849475:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788528283.849480:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2bf8582 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735369344:12345-0@lo:501: 00000100:00100000:2.0:1788528283.849634:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2bf8582 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735369344:12345-0@lo:501: Request processed in 154us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528283.849641:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788528283.849759:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074cda608 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735369344:0@lo:501: 00000100:00100000:1.0:1788528283.849787:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074cda608 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735369472:0@lo:503: 00000100:00100000:1.0:1788528283.849828:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528283.849882:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set 0000000013ead626 going to sleep for 11 seconds 00000100:00100000:2.0:1788528283.849909:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735369472 00000100:00100000:2.0:1788528283.849913:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735369472 00000100:00100000:2.0:1788528283.849974:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788528283.849981:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa18ceea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735369472:12345-0@lo:503: 00000100:00100000:2.0:1788528283.850070:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa18ceea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735369472:12345-0@lo:503: Request processed in 91us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528283.850077:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788528283.850136:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074cda608 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735369472:0@lo:503: 00000100:00100000:1.0:1788528283.850429:0:7843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074cda608 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:7843:1875407735369600:0@lo:502: 00000100:00100000:1.0:1788528283.850466:0:7843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528283.850663:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735369600 00000100:00100000:0.0:1788528283.850668:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735369600 00000100:00100000:0.0:1788528283.850695:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788528283.850701:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e748a0d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+18:7843:x1875407735369600:12345-0@lo:502: 00000100:00100000:0.0:1788528283.850790:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e748a0d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+18:7843:x1875407735369600:12345-0@lo:502: Request processed in 90us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528283.850798:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788528283.850883:0:7843:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f9a607ca going to sleep for 11 seconds 00000100:00100000:1.0:1788528283.850897:0:7843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074cda608 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:7843:1875407735369600:0@lo:502: 00000020:01000000:1.0:1788528283.850918:0:7843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528283.850931:0:7843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528283.850933:0:7843:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788528283.850938:0:7843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788528283.850943:0:7843:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:00000080:1.0:1788528283.850968:0:7843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788528283.850983:0:7843:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000008eccb8c9) 00000020:00000080:1.0:1788528283.851007:0:7843:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1788528283.851013:0:7843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788528283.851114:0:7843:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788528283.851126:0:7843:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788528283.851134:0:7843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x892c60dda91c76aa 00010000:00080000:1.0:1788528283.851164:0:7843:0:(ldlm_lib.c:102:import_set_conn()) imp 000000007921ceba@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:1.0:1788528283.853340:0:7843:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:0.0:1788528283.854638:0:7843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788528283.854656:0:7843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788528283.854702:0:7843:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788528283.854731:0:7843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x892c60dda91c76b1 00000100:00080000:0.0:1788528283.854744:0:7843:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788528283.854750:0:7843:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000007921ceba using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1788528283.854788:0:7843:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000000c0922 x1875407735369728/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788528283.854844:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000000c0922 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735369728:0@lo:38: 00000100:00100000:1.0:1788528283.854928:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788528283.855065:0:7843:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788528283.855161:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000042ce69cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735369984:0@lo:400: 00000100:00100000:0.0:1788528283.855193:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528283.855228:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788528283.855234:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000021f429ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735369856:0@lo:400: 00000100:00100000:0.0:1788528283.855264:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528283.855287:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788528283.855295:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008185b989 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875407735370112:0@lo:400: 00000100:00100000:0.0:1788528283.855321:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528283.855350:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735369728 00000100:00100000:0.0:1788528283.855358:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735369728 00000100:00100000:0.0:1788528283.855381:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735369984 00000100:00100000:0.0:1788528283.855383:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735369984 00000100:00100000:0.0:1788528283.855420:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788528283.855426:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074cda608 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1875407735369728:12345-0@lo:38: 00010000:00080000:0.0:1788528283.855452:0:6513:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 153 last 0 00000020:00000080:0.0:1788528283.855489:0:6513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x892c60dda91c76b8 00000004:00100000:0.0:1788528283.855505:0:6513:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788528283.855511:0:6513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1788528283.855623:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735369856 00000100:00100000:0.0:1788528283.855627:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735369856 00000100:00100000:0.0:1788528283.855656:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735370112 00000100:00100000:0.0:1788528283.855660:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735370112 00000100:00100000:0.0:1788528283.855675:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788528283.855680:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000662f9d0b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735369856:12345-0@lo:400: 00000100:00100000:0.0:1788528283.855728:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000662f9d0b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735369856:12345-0@lo:400: Request processed in 48us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528283.855735:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788528283.855751:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788528283.855757:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c862d670 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875407735370112:12345-0@lo:400: 00000100:00100000:0.0:1788528283.855786:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c862d670 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875407735370112:12345-0@lo:400: Request processed in 30us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528283.855792:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788528283.855829:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000008185b989 x1875407735370112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528283.855841:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008185b989 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875407735370112:0@lo:400: 00010000:00080000:0.0:1788528283.855867:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000021f429ac x1875407735369856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528283.855875:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000021f429ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735369856:0@lo:400: 00000040:01000000:0.0:1788528283.855916:0:7843:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:1.0:1788528283.857535:0:7846:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000000481e4c1 x1875407735370240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528283.857575:0:7846:0:(client.c:2716:ptlrpc_set_wait()) set 00000000173f9a76 going to sleep for 0 seconds 00000020:01000000:0.0:1788528283.859377:0:7843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528283.859392:0:7843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528283.859394:0:7843:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788528283.859398:0:7843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788528283.859404:0:7843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528283.859405:0:7843:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788528283.859408:0:7843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788528283.859410:0:7843:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788528283.859457:0:7843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000021f429ac pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:7843:1875407735370368:0@lo:502: 00000100:00100000:0.0:1788528283.859707:0:7843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528283.859755:0:7843:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b6eed6dd going to sleep for 11 seconds 00000100:00100000:2.0:1788528283.859818:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735370368 00000100:00100000:2.0:1788528283.859827:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735370368 00000100:00100000:2.0:1788528283.859883:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788528283.859892:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009bb7e4aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+18:7843:x1875407735370368:12345-0@lo:502: 00000100:00100000:2.0:1788528283.860157:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009bb7e4aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+18:7843:x1875407735370368:12345-0@lo:502: Request processed in 263us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528283.860166:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788528283.860332:0:7843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000021f429ac pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:7843:1875407735370368:0@lo:502: 00000020:01000000:0.0:1788528283.860366:0:7843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528283.860372:0:7843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528283.860374:0:7843:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788528283.860379:0:7843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1788528283.860623:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788528283.860640:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788528283.860650:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 000000003e1daff9/0x892c60dda91c7695 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c769c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528283.860661:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 000000003e1daff9/0x892c60dda91c7695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c769c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528283.860672:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788528283.860675:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff8a90c7f88000 from 1 10000000:01000000:1.0:1788528283.860678:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788528283.860724:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 00000000b0c7fd55/0x892c60dda91c76bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528283.860732:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 00000000b0c7fd55/0x892c60dda91c76bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528283.860742:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 00000000b0c7fd55/0x892c60dda91c76bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528283.860759:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000044cc1c59 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735370496:0@lo:101: 00000100:00100000:1.0:1788528283.860806:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528283.860835:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e766fa05 going to sleep for 11 seconds 00000100:00100000:2.0:1788528283.861466:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735370496 00000100:00100000:2.0:1788528283.861474:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735370496 00000100:00100000:2.0:1788528283.861972:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788528283.861981:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008265373d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735370496:12345-0@lo:101: 00010000:00010000:2.0:1788528283.861996:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528283.862011:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d007e8a6/0x892c60dda91c76c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c76bf expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528283.862037:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d007e8a6/0x892c60dda91c76c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c76bf expref: 19 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528283.862048:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d007e8a6/0x892c60dda91c76c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c76bf expref: 19 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528283.862057:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d007e8a6, rc 0) 00000100:00100000:2.0:1788528283.862232:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008265373d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735370496:12345-0@lo:101: Request processed in 252us (1425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528283.862247:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788528283.862362:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000044cc1c59 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735370496:0@lo:101: 00010000:00010000:0.0:1788528283.862381:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 00000000b0c7fd55/0x892c60dda91c76bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c76c6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528283.862390:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 00000000b0c7fd55/0x892c60dda91c76bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c76c6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528283.862447:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000021f429ac pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735370624:0@lo:501: 00000100:00100000:0.0:1788528283.862482:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528283.862520:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b6eed6dd going to sleep for 11 seconds 00000100:00100000:3.0:1788528283.862530:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735370624 00000100:00100000:3.0:1788528283.862538:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735370624 00000100:00100000:3.0:1788528283.862604:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788528283.862694:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005489fe5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735370624:12345-0@lo:501: 00000100:00100000:3.0:1788528283.862798:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005489fe5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735370624:12345-0@lo:501: Request processed in 187us (316us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788528283.862807:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788528283.863034:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000021f429ac pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735370624:0@lo:501: 10000000:01000000:1.0:1788528283.863050:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788528283.863057:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 00000000b0c7fd55/0x892c60dda91c76bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c76c6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528283.863065:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 00000000b0c7fd55/0x892c60dda91c76bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c76c6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788528283.863278:0:6513:0:(import.c:65:import_set_state_nolock()) 00000000535cf6a4 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788528283.863441:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074cda608 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1875407735369728:12345-0@lo:38: Request processed in 8013us (8513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528283.863457:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788528283.863478:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788528283.863485:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051101181 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735369984:12345-0@lo:400: 00000100:00100000:0.0:1788528283.863539:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051101181 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735369984:12345-0@lo:400: Request processed in 55us (8346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528283.863545:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788528283.863643:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788528283.863652:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788528283.863660:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788528283.863666:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788528283.863668:0:3636:0:(import.c:65:import_set_state_nolock()) 000000007921ceba lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788528283.863689:0:3636:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000173f9a76): req@000000000481e4c1 x1875407735370240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528283.863709:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000000c0922 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735369728:0@lo:38: 00000100:00100000:3.0:1788528283.863784:0:7846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528283.863823:0:7846:0:(client.c:2716:ptlrpc_set_wait()) set 00000000173f9a76 going to sleep for 11 seconds 00000100:00100000:2.0:1788528283.863833:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000042ce69cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735369984:0@lo:400: 00000100:00100000:2.0:1788528283.863862:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735370240 00000100:00100000:2.0:1788528283.863866:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735370240 00000100:00100000:2.0:1788528283.863894:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788528283.863899:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5ca80a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7846:x1875407735370240:12345-0@lo:1000: 00000100:00100000:2.0:1788528283.863975:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5ca80a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7846:x1875407735370240:12345-0@lo:1000: Request processed in 76us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528283.863982:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788528283.864153:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788528283.864164:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008185b989 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735370752:0@lo:41: 00000100:00100000:0.0:1788528283.864197:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528283.864233:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735370752 00000100:00100000:0.0:1788528283.864236:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735370752 00000100:00100000:0.0:1788528283.864254:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788528283.864259:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016ead3f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1875407735370752:12345-0@lo:41: 00000004:00000024:0.0:1788528283.864281:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788528283.864315:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016ead3f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1875407735370752:12345-0@lo:41: Request processed in 56us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528283.864321:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788528283.864362:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008185b989 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735370752:0@lo:41: 00000100:00100000:3.0:1788528283.864449:0:7846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000481e4c1 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7846:1875407735370240:0@lo:1000: 00000040:01000000:3.0:1788528283.864491:0:7846:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788528283.864529:0:7846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000994d579e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7846:1875407735370880:0@lo:1000: 00000100:00100000:3.0:1788528283.864605:0:7846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528283.864713:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735370880 00000100:00100000:0.0:1788528283.864718:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735370880 00000100:00100000:0.0:1788528283.864810:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788528283.864817:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa85f9d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7846:x1875407735370880:12345-0@lo:1000: 00000100:00100000:0.0:1788528283.864923:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa85f9d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7846:x1875407735370880:12345-0@lo:1000: Request processed in 107us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528283.864930:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788528283.865171:0:7846:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b3aeb80d going to sleep for 11 seconds 00000100:00100000:3.0:1788528283.865202:0:7846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000994d579e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7846:1875407735370880:0@lo:1000: 00000100:00100000:3.0:1788528283.865389:0:7846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000994d579e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7846:1875407735371008:0@lo:700: 00000100:00100000:3.0:1788528283.865433:0:7846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528283.865456:0:7846:0:(client.c:2716:ptlrpc_set_wait()) set 000000000ea0c58a going to sleep for 11 seconds 00000100:00100000:2.0:1788528283.865495:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735371008 00000100:00100000:2.0:1788528283.865502:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735371008 00000100:00100000:2.0:1788528283.865543:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788528283.865591:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b49405f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7846:x1875407735371008:12345-0@lo:700: 00000100:00100000:2.0:1788528283.865647:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b49405f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7846:x1875407735371008:12345-0@lo:700: Request processed in 98us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528283.865653:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788528283.866401:0:7846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000994d579e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7846:1875407735371008:0@lo:700: 00000100:00100000:3.0:1788528283.867104:0:7846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000994d579e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7846:1875407735371136:0@lo:1000: 00000100:00100000:3.0:1788528283.867157:0:7846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528283.867190:0:7846:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ff5f4dfc going to sleep for 11 seconds 00000100:00100000:1.0:1788528283.867267:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735371136 00000100:00100000:1.0:1788528283.867274:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735371136 00000100:00100000:1.0:1788528283.867327:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788528283.867343:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000877f2746 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7846:x1875407735371136:12345-0@lo:1000: 00000100:00100000:1.0:1788528283.867433:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000877f2746 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7846:x1875407735371136:12345-0@lo:1000: Request processed in 91us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528283.867441:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788528283.867749:0:7846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000994d579e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7846:1875407735371136:0@lo:1000: 00000004:00080000:3.0:1788528283.867811:0:7846:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000000ea0c58a with version 0 00000020:00100000:3.0:1788528283.867830:0:7846:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788528283.867837:0:7846:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000994d579e x1875407735371392/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788528283.867852:0:7846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000994d579e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7846:1875407735371392:0@lo:1000: 00000100:00100000:3.0:1788528283.867884:0:7846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528283.867898:0:7846:0:(client.c:2716:ptlrpc_set_wait()) set 00000000564337a4 going to sleep for 11 seconds 00000100:00100000:1.0:1788528283.868603:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735371392 00000100:00100000:1.0:1788528283.868630:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735371392 00000100:00100000:1.0:1788528283.868675:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788528283.868681:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b1bf4db pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7846:x1875407735371392:12345-0@lo:1000: 00000001:00080000:3.0:1788528283.874961:0:7440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:3.0:1788528283.874978:0:7440:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788528283.875970:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b1bf4db pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7846:x1875407735371392:12345-0@lo:1000: Request processed in 7280us (8077us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788528283.875989:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1788528283.876183:0:7846:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1788528283.876189:0:7846:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788528283.876217:0:7846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000994d579e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7846:1875407735371392:0@lo:1000: 00000100:00100000:3.0:1788528283.876335:0:7846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000994d579e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7846:1875407735371520:0@lo:1000: 00000100:00100000:3.0:1788528283.876401:0:7846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528283.876508:0:7846:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b3aeb80d going to sleep for 11 seconds 00000100:00100000:2.0:1788528283.876879:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735371520 00000100:00100000:2.0:1788528283.876887:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735371520 00000100:00100000:2.0:1788528283.876939:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788528283.876948:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f56bb65 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7846:x1875407735371520:12345-0@lo:1000: 00000100:00100000:2.0:1788528283.877039:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f56bb65 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7846:x1875407735371520:12345-0@lo:1000: Request processed in 92us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528283.877047:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788528283.877125:0:7846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000994d579e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7846:1875407735371520:0@lo:1000: 00000040:00080000:3.0:1788528283.877159:0:7846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788528283.877200:0:7846:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000000ea0c58a with version 1 00000040:00080000:3.0:1788528283.879355:0:7846:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788528283.879472:0:7846:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788528283.879477:0:7846:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:2.0:1788528283.879819:0:7844:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000001c25aa3e version 1 rpc_version 1 00000020:00100000:2.0:1788528283.879871:0:7844:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788528283.879883:0:7844:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000006c73295 x1875407735371776/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788528283.879922:0:7844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006c73295 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7844:1875407735371776:0@lo:1000: 00000100:00100000:2.0:1788528283.880007:0:7844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528283.880080:0:7844:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a876be4b going to sleep for 11 seconds 00000100:00100000:3.0:1788528283.880183:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735371776 00000100:00100000:3.0:1788528283.880192:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735371776 00000100:00100000:3.0:1788528283.880250:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788528283.880258:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9ae4dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7844:x1875407735371776:12345-0@lo:1000: 00000001:00080000:3.0:1788528283.891160:0:7440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1788528283.891505:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9ae4dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7844:x1875407735371776:12345-0@lo:1000: Request processed in 11243us (11493us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788528283.891520:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:0.0:1788528283.896705:0:7844:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1788528283.896742:0:7844:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788528283.896771:0:7844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006c73295 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7844:1875407735371776:0@lo:1000: 00000020:00000004:3.0:1788528284.101768:0:7866:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788528284.102017:0:7866:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788528284.798750:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788528284.983189:0:7914:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe5494ad50 20000000:00000080:3.0:1788528284.983223:0:7914:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a90f6ce7000 uarg=0000000000000000 20000000:01000000:3.0:1788528284.983278:0:7914:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788528284.983339:0:7914:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788528284.983346:0:7914:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788528284.983721:0:7914:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788528284.983735:0:7914:0:(mgs_llog.c:4126:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788528284.991787:0:7914:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788528284.992278:0:7914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788528284.992338:0:7914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788528284.992359:0:7914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788528284.992382:0:7914:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788528284.992405:0:7914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000059d3173f/0x892c60dda91c76cd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528284.992427:0:7914:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000c38c4d5/0x892c60dda91c754c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7545 expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528284.992836:0:7914:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004cadbf8d/0x892c60dda91c763a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7633 expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528284.992842:0:7914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000059d3173f/0x892c60dda91c76cd lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528284.992887:0:7914:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004cadbf8d/0x892c60dda91c763a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c7633 expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528284.992904:0:7914:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004cadbf8d/0x892c60dda91c763a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c7633 expref: 18 pid: 6501 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528284.992918:0:7914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008e5d0819 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7914:1875407735371904:0@lo:104: 00000100:00100000:3.0:1788528284.993015:0:7914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788528284.993096:0:7914:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000c38c4d5/0x892c60dda91c754c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c7545 expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528284.993104:0:7914:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000c38c4d5/0x892c60dda91c754c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c7545 expref: 18 pid: 6501 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528284.993112:0:7914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e51fd84 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7914:1875407735372032:0@lo:104: 00000100:00100000:3.0:1788528284.993131:0:7914:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c92f4631 going to sleep for 11 seconds 00000100:00100000:2.0:1788528284.993238:0:6491:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788528284.993260:0:6491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528284.993290:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735371904 00000100:00100000:2.0:1788528284.993297:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735371904 00000100:00100000:2.0:1788528284.993347:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735372032 00000100:00100000:2.0:1788528284.993350:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735372032 00000100:00100000:2.0:1788528284.993365:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788528284.993371:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8d88be1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+4:7914:x1875407735371904:12345-0@lo:104: 00010000:00010000:2.0:1788528284.993385:0:6491:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: 000000008859ef31/0x892c60dda91c7633 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c763a expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528284.993466:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788528284.993472:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8d88be1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+4:7914:x1875407735371904:12345-0@lo:104: Request processed in 101us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528284.993479:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788528284.993537:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788528284.993544:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee2d5eaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+3:7914:x1875407735372032:12345-0@lo:104: 00010000:00010000:2.0:1788528284.993580:0:6491:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: 000000004c8c79df/0x892c60dda91c7545 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c754c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528284.993605:0:7914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008e5d0819 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7914:1875407735371904:0@lo:104: 00010000:00010000:3.0:1788528284.993717:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528284.993723:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: 000000008859ef31/0x892c60dda91c7633 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c763a expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528284.993730:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008859ef31 already unused, calling callback (000000009849d88c) 10000000:00010000:3.0:1788528284.993734:0:6497:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: 000000008859ef31/0x892c60dda91c7633 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c763a expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528284.993757:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: 000000008859ef31/0x892c60dda91c7633 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c763a expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788528284.993763:0:6497:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: 000000008859ef31/0x892c60dda91c7633 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c763a expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528284.993768:0:6497:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788528284.993807:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: 000000008859ef31/0x892c60dda91c7633 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c763a expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528284.993813:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788528284.993831:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: 000000008859ef31/0x892c60dda91c7633 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c763a expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528284.993837:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: 000000008859ef31/0x892c60dda91c7633 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c763a expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528284.993850:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528284.993851:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528284.993853:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528284.993871:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001640dddd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735372160:0@lo:103: 00000100:00100000:3.0:1788528284.993906:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528284.993950:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735372160 00000100:00100000:3.0:1788528284.993954:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735372160 00010000:00010000:3.0:1788528284.993972:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004cadbf8d/0x892c60dda91c763a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7633 expref: 19 pid: 6501 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528284.993997:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788528284.994003:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084278620 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+19:3639:x1875407735372160:12345-0@lo:103: 00010000:00010000:3.0:1788528284.994020:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528284.994025:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004cadbf8d/0x892c60dda91c763a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7633 expref: 19 pid: 6501 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528284.994034:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004cadbf8d/0x892c60dda91c763a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c7633 expref: 19 pid: 6501 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528284.994049:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004cadbf8d/0x892c60dda91c763a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c7633 expref: 19 pid: 6501 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528284.994068:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528284.994111:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084278620 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+18:3639:x1875407735372160:12345-0@lo:103: Request processed in 109us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528284.994119:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788528284.994253:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001640dddd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735372160:0@lo:103: 00010000:00010000:2.0:1788528284.995626:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788528284.995655:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee2d5eaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+3:7914:x1875407735372032:12345-0@lo:104: Request processed in 2109us (2392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528284.995666:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1788528284.995891:0:6496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528284.995899:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: 000000004c8c79df/0x892c60dda91c7545 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c754c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528284.995910:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004c8c79df already unused, calling callback (000000009849d88c) 10000000:00010000:0.0:1788528284.995914:0:6496:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: 000000004c8c79df/0x892c60dda91c7545 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c754c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528284.995925:0:6496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: 000000004c8c79df/0x892c60dda91c7545 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c754c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528284.995933:0:6496:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: 000000004c8c79df/0x892c60dda91c7545 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c754c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528284.995938:0:6496:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788528284.995980:0:6496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: 000000004c8c79df/0x892c60dda91c7545 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c754c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528284.995986:0:6496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788528284.996006:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: 000000004c8c79df/0x892c60dda91c7545 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c754c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528284.996011:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: 000000004c8c79df/0x892c60dda91c7545 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c754c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528284.996028:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528284.996029:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528284.996030:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528284.996050:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008185b989 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735372288:0@lo:103: 00000100:00100000:0.0:1788528284.996112:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528284.996164:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735372288 00000100:00100000:0.0:1788528284.996171:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735372288 00010000:00010000:0.0:1788528284.997124:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000c38c4d5/0x892c60dda91c754c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7545 expref: 18 pid: 6501 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528284.997171:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788528284.997184:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6b836ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd052447-840d-4bcc-891b-140c465c7625+18:3640:x1875407735372288:12345-0@lo:103: 00010000:00010000:0.0:1788528284.997209:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528284.997217:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000c38c4d5/0x892c60dda91c754c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7545 expref: 18 pid: 6501 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528284.997228:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000c38c4d5/0x892c60dda91c754c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c7545 expref: 18 pid: 6501 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528284.997248:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000059d3173f/0x892c60dda91c76cd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528284.997257:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000059d3173f/0x892c60dda91c76cd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528284.997275:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000059d3173f/0x892c60dda91c76cd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528284.997281:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000059d3173f/0x892c60dda91c76cd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528284.997287:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000059d3173f/0x892c60dda91c76cd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528284.997307:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000059d3173f/0x892c60dda91c76cd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528284.997313:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000059d3173f already unused, calling callback (0000000092c28bba) 00010000:00010000:0.0:1788528284.997316:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000059d3173f/0x892c60dda91c76cd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528284.997336:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000059d3173f/0x892c60dda91c76cd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528284.997345:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000059d3173f/0x892c60dda91c76cd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528284.997815:0:7914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000c38c4d5/0x892c60dda91c754c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c7545 expref: 18 pid: 6501 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528284.997834:0:7914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e51fd84 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7914:1875407735372032:0@lo:104: 00010000:00010000:3.0:1788528284.997860:0:7914:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000059d3173f/0x892c60dda91c76cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528284.997869:0:7914:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000059d3173f/0x892c60dda91c76cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528284.997875:0:7914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000059d3173f/0x892c60dda91c76cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528284.997880:0:7914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000059d3173f/0x892c60dda91c76cd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528284.998956:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528284.999321:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6b836ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd052447-840d-4bcc-891b-140c465c7625+17:3640:x1875407735372288:12345-0@lo:103: Request processed in 2138us (3204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528284.999335:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788528284.999809:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008185b989 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735372288:0@lo:103: 00010000:00010000:3.0:1788528285.822781:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528286.858927:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528286.911082:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788528286.911113:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b8fc8a7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735372416:0@lo:41: 00000100:00100000:3.0:1788528286.911245:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528286.911667:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735372416 00000100:00100000:1.0:1788528286.911678:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735372416 00000100:00100000:1.0:1788528286.911744:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788528286.911752:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e51fd84 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735372416:12345-0@lo:41: 00000004:00000024:1.0:1788528286.911794:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1788528286.911901:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e51fd84 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735372416:12345-0@lo:41: Request processed in 149us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528286.911908:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788528286.912234:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b8fc8a7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735372416:0@lo:41: 00010000:00010000:2.0:1788528287.874911:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528288.895763:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528288.960713:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096173720 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735372800:0@lo:400: 00000100:00100000:0.0:1788528288.960790:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528288.960861:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788528288.960867:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f99faea7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735372544:0@lo:400: 00000100:00100000:0.0:1788528288.960898:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528288.960921:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000b717c8d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735373184:0@lo:400: 00000100:00100000:0.0:1788528288.960946:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528288.960981:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d886157 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735372928:0@lo:400: 00000100:00100000:0.0:1788528288.961006:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528288.961025:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788528288.961030:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008185b989 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735372672:0@lo:41: 00000100:00100000:2.0:1788528288.961056:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735372800 00000100:00100000:2.0:1788528288.961067:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735372800 00000100:00100000:0.0:1788528288.961071:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528288.961084:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001a1fc93f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735373056:0@lo:400: 00000100:00100000:0.0:1788528288.961107:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528288.962208:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735372544 00000100:00100000:0.0:1788528288.962218:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735372544 00000100:00100000:0.0:1788528288.962266:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788528288.962275:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d36634b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+17:3640:x1875407735372544:12345-0@lo:400: 00000100:00100000:0.0:1788528288.962339:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d36634b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+17:3640:x1875407735372544:12345-0@lo:400: Request processed in 66us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528288.962348:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788528288.962457:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735373184 00000100:00100000:0.0:1788528288.962462:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735373184 00000100:00100000:0.0:1788528288.962482:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735372928 00000100:00100000:0.0:1788528288.962485:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735372928 00000100:00100000:0.0:1788528288.962498:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735372672 00000100:00100000:0.0:1788528288.962500:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735372672 00000100:00100000:0.0:1788528288.962511:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788528288.962516:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002153b798 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1875407735373184:12345-0@lo:400: 00000100:00100000:0.0:1788528288.962581:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002153b798 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1875407735373184:12345-0@lo:400: Request processed in 64us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528288.962588:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788528288.962601:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788528288.962606:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042ce69cb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735372928:12345-0@lo:400: 00000100:00100000:0.0:1788528288.962640:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042ce69cb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735372928:12345-0@lo:400: Request processed in 34us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528288.962646:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788528288.962658:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788528288.962676:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000000c0922 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735372672:12345-0@lo:41: 00000004:00000024:0.0:1788528288.962702:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788528288.962734:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000000c0922 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735372672:12345-0@lo:41: Request processed in 61us (1667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528288.962740:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788528288.963909:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735373056 00000100:00100000:2.0:1788528288.963920:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735373056 00000100:00100000:2.0:1788528288.963967:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788528288.963976:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c78bee3f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735372800:12345-0@lo:400: 00000100:00100000:2.0:1788528288.964038:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c78bee3f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735372800:12345-0@lo:400: Request processed in 64us (3249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528288.964045:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788528288.964060:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788528288.964065:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021f429ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735373056:12345-0@lo:400: 00000100:00100000:2.0:1788528288.964091:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021f429ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735373056:12345-0@lo:400: Request processed in 26us (2984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528288.964097:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788528288.965241:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008185b989 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735372672:0@lo:41: 00010000:00080000:0.0:1788528288.965263:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000001a1fc93f x1875407735373056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528288.965274:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001a1fc93f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735373056:0@lo:400: 00000100:00100000:0.0:1788528288.965285:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d886157 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735372928:0@lo:400: 00000100:00100000:0.0:1788528288.965329:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f99faea7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735372544:0@lo:400: 00000100:00100000:0.0:1788528288.965338:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000b717c8d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735373184:0@lo:400: 00010000:00080000:0.0:1788528288.965349:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000096173720 x1875407735372800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528288.965490:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096173720 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735372800:0@lo:400: 00010000:00010000:0.0:1788528289.918776:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528290.952820:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788528291.518762:0:6506:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:2.0:1788528291.518774:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a90f5add000 from 1 10000000:01000000:2.0:1788528291.518780:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788528291.518839:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 00000000bd730657/0x892c60dda91c76d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528291.518853:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 00000000bd730657/0x892c60dda91c76d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528291.518885:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 00000000bd730657/0x892c60dda91c76d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528291.518911:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc35bb90 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735373312:0@lo:101: 00000100:00100000:2.0:1788528291.519288:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528291.519360:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set 0000000061a88d0b going to sleep for 11 seconds 00000100:00100000:0.0:1788528291.519361:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735373312 00000100:00100000:0.0:1788528291.519370:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735373312 00000100:00100000:0.0:1788528291.519477:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788528291.519487:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c554c2e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+17:6506:x1875407735373312:12345-0@lo:101: 00010000:00010000:0.0:1788528291.519502:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528291.519519:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000090b2947/0x892c60dda91c76db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c76d4 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528291.519602:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000090b2947/0x892c60dda91c76db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c76d4 expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528291.519615:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000090b2947/0x892c60dda91c76db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c76d4 expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528291.519626:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000090b2947, rc 0) 00000100:00100000:0.0:1788528291.519667:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c554c2e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735373312:12345-0@lo:101: Request processed in 182us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528291.519675:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788528291.519695:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc35bb90 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735373312:0@lo:101: 00010000:00010000:2.0:1788528291.519772:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 00000000bd730657/0x892c60dda91c76d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c76db expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528291.519780:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 00000000bd730657/0x892c60dda91c76d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c76db expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788528291.519884:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788528291.519915:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc35bb90 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735373440:0@lo:501: 00000100:00100000:2.0:1788528291.519945:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528291.520543:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735373440 00000100:00100000:2.0:1788528291.520608:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set 0000000061a88d0b going to sleep for 11 seconds 00000100:00100000:1.0:1788528291.520695:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735373440 00000100:00100000:1.0:1788528291.520747:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788528291.520754:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2571765 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735373440:12345-0@lo:501: 00000100:00100000:1.0:1788528291.521844:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2571765 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735373440:12345-0@lo:501: Request processed in 1080us (1887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528291.521857:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788528291.522010:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc35bb90 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735373440:0@lo:501: 00000100:00100000:3.0:1788528291.522077:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008e5d0819 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735373568:0@lo:503: 00000100:00100000:3.0:1788528291.522142:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528291.522410:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f4843e11 going to sleep for 11 seconds 00000100:00100000:0.0:1788528291.522737:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735373568 00000100:00100000:0.0:1788528291.522747:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735373568 00000100:00100000:1.0:1788528291.523171:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788528291.523267:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021ae080d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735373568:12345-0@lo:503: 00000100:00100000:1.0:1788528291.523459:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021ae080d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735373568:12345-0@lo:503: Request processed in 198us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528291.523467:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788528291.523864:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008e5d0819 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735373568:0@lo:503: 00000040:00080000:3.0:1788528291.524899:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788528291.525392:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008e5d0819 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735373696:0@lo:502: 00000100:00100000:3.0:1788528291.525479:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528291.528933:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f4843e11 going to sleep for 11 seconds 00000100:00100000:1.0:1788528291.528982:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735373696 00000100:00100000:1.0:1788528291.528994:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735373696 00000100:00100000:1.0:1788528291.533628:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788528291.533656:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5db471c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735373696:12345-0@lo:502: 00000100:00100000:1.0:1788528291.533936:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5db471c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735373696:12345-0@lo:502: Request processed in 294us (8456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528291.533946:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788528291.534041:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008e5d0819 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735373696:0@lo:502: 00000040:00080000:3.0:1788528291.534796:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788528291.534842:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000100:00100000:3.0:1788528291.534885:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008e5d0819 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735373824:0@lo:502: 00000100:00100000:3.0:1788528291.534955:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528291.535046:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f4843e11 going to sleep for 11 seconds 00000100:00100000:1.0:1788528291.535090:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735373824 00000100:00100000:1.0:1788528291.535098:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735373824 00000100:00100000:1.0:1788528291.535244:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788528291.535252:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084eb1759 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735373824:12345-0@lo:502: 00000100:00100000:1.0:1788528291.535824:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084eb1759 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735373824:12345-0@lo:502: Request processed in 572us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528291.535833:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788528291.535933:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008e5d0819 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735373824:0@lo:502: 00000040:00080000:3.0:1788528291.535989:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788528291.535999:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788528291.536827:0:8295:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528291.536839:0:8295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528291.536842:0:8295:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788528291.536849:0:8295:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a90f5add000 00000020:00000080:1.0:1788528291.536851:0:8295:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788528291.536884:0:8295:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528291.536887:0:8295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528291.536888:0:8295:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788528291.536891:0:8295:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 4 count 4 00000020:01000000:3.0:1788528291.537051:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788528291.537063:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788528291.537075:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101850600/0x892c60dda91c76d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c76db expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528291.537086:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a9101850600/0x892c60dda91c76d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c76db expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528291.537097:0:6506:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:3.0:1788528291.537099:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a90c7f88000 from 1 10000000:01000000:3.0:1788528291.537102:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788528291.537793:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c76e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528291.537806:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c76e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528291.537818:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c76e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528291.537842:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735373952:0@lo:101: 00000100:00100000:3.0:1788528291.537917:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528291.537960:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d93240 going to sleep for 11 seconds 00000100:00100000:0.0:1788528291.538090:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735373952 00000100:00100000:0.0:1788528291.538099:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735373952 00000100:00100000:0.0:1788528291.538166:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788528291.538175:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735373952:12345-0@lo:101: 00010000:00010000:0.0:1788528291.538190:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528291.538205:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c0031200/0x892c60dda91c76e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c76e2 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528291.538230:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c0031200/0x892c60dda91c76e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c76e2 expref: 19 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528291.538241:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c0031200/0x892c60dda91c76e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c76e2 expref: 19 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528291.538250:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031200, rc 0) 00000100:00100000:0.0:1788528291.538461:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735373952:12345-0@lo:101: Request processed in 286us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528291.538482:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788528291.538779:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735373952:0@lo:101: 00010000:00010000:3.0:1788528291.538799:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c76e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c76e9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528291.538811:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c76e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c76e9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528291.538856:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735374080:0@lo:501: 00000100:00100000:3.0:1788528291.538895:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528291.538921:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d93240 going to sleep for 11 seconds 00000100:00100000:2.0:1788528291.540423:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735374080 00000100:00100000:2.0:1788528291.540440:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735374080 00000100:00100000:2.0:1788528291.540507:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788528291.540516:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735374080:12345-0@lo:501: 00000100:00100000:2.0:1788528291.540730:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735374080:12345-0@lo:501: Request processed in 214us (1833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528291.540740:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788528291.540767:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735374080:0@lo:501: 00000100:00100000:3.0:1788528291.540819:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735374208:0@lo:503: 00000100:00100000:3.0:1788528291.540879:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528291.540906:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d93240 going to sleep for 11 seconds 00000100:00100000:0.0:1788528291.541196:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735374208 00000100:00100000:0.0:1788528291.541202:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735374208 00000100:00100000:0.0:1788528291.542457:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788528291.542477:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735374208:12345-0@lo:503: 00000100:00100000:0.0:1788528291.542671:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735374208:12345-0@lo:503: Request processed in 203us (1791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528291.542678:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788528291.542806:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735374208:0@lo:503: 00000100:00100000:1.0:1788528291.545549:0:8296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:8296:1875407735374336:0@lo:502: 00000100:00100000:1.0:1788528291.545693:0:8296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528291.545757:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735374336 00000100:00100000:1.0:1788528291.545760:0:8296:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f8d6ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528291.545769:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735374336 00000100:00100000:2.0:1788528291.545835:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788528291.545845:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+19:8296:x1875407735374336:12345-0@lo:502: 00000100:00100000:2.0:1788528291.546008:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+19:8296:x1875407735374336:12345-0@lo:502: Request processed in 163us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528291.546016:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788528291.546042:0:8296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:8296:1875407735374336:0@lo:502: 00000020:01000000:1.0:1788528291.546077:0:8296:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528291.546220:0:8296:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528291.546223:0:8296:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788528291.546232:0:8296:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a90c7f88000 00000020:00000080:1.0:1788528291.546234:0:8296:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788528291.546342:0:8296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:8296:1875407735374464:0@lo:502: 00000100:00100000:1.0:1788528291.546384:0:8296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528291.546411:0:8296:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f8d6ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528291.546467:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735374464 00000100:00100000:2.0:1788528291.546472:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735374464 00000100:00100000:2.0:1788528291.546508:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788528291.546515:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+19:8296:x1875407735374464:12345-0@lo:502: 00000100:00100000:2.0:1788528291.548119:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+19:8296:x1875407735374464:12345-0@lo:502: Request processed in 1585us (1715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528291.548135:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788528291.549325:0:8296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:8296:1875407735374464:0@lo:502: 00000020:01000000:3.0:1788528291.549380:0:8296:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788528291.549392:0:8296:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528291.549395:0:8296:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788528291.549402:0:8296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788528291.549849:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788528291.549861:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788528291.549874:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c76e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c76e9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528291.549886:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c76e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c76e9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528291.966802:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528292.031655:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788528292.031687:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735374592:0@lo:41: 00000100:00100000:1.0:1788528292.031788:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528292.031834:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735374592 00000100:00100000:0.0:1788528292.031844:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735374592 00000100:00100000:0.0:1788528292.031908:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788528292.031919:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735374592:12345-0@lo:41: 00000004:00000024:0.0:1788528292.031959:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1788528292.032010:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735374592:12345-0@lo:41: Request processed in 92us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528292.032066:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735374592:0@lo:41: 00000100:00100000:0.0:1788528292.032724:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1788528293.000497:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788528293.374547:0:8414:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:3.0:1788528293.374570:0:8414:0:(obd_mount.c:928:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788528293.374573:0:8414:0:(obd_mount.c:931:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788528293.374709:0:8414:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a90fa76f800 00000020:01000004:3.0:1788528293.374724:0:8414:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788528293.374736:0:8414:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788528293.374749:0:8414:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8a90fa60e600) 00000020:00000080:3.0:1788528293.374765:0:8414:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788528293.394984:0:8414:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788528293.395047:0:8414:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1788528293.412025:0:8414:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788528293.412277:0:8414:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788528293.412288:0:8414:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788528293.412301:0:8414:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x892c60dda91c76f7 00000020:01000004:0.0:1788528293.412307:0:8414:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788528293.412329:0:8414:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.138@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788528293.412332:0:8414:0:(mgc_request.c:1317:mgc_set_info_async()) InitRecov MGC192.168.203.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788528293.412339:0:8414:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788528293.412349:0:8414:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788528293.412361:0:8414:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8a910195e600) 00000020:00000080:0.0:1788528293.412372:0:8414:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1788528293.414023:0:8414:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788528293.414224:0:8414:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788528293.414231:0:8414:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788528293.416624:0:8414:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788528293.416635:0:8414:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788528293.417870:0:8414:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788528293.417880:0:8414:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788528293.422744:0:8414:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788528293.422961:0:8414:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788528293.422966:0:8414:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788528293.423759:0:8414:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788528293.423767:0:8414:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788528293.446050:0:8414:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788528293.446610:0:8414:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788528293.446618:0:8414:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788528293.450662:0:8414:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788528293.450681:0:8414:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788528293.453390:0:8414:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788528293.453406:0:8414:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788528293.456322:0:8414:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788528293.456863:0:8414:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788528293.456870:0:8414:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788528293.457855:0:8414:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788528293.457865:0:8414:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788528293.513535:0:8414:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788528293.514072:0:8414:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788528293.514080:0:8414:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788528293.516523:0:8414:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788528293.516541:0:8414:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788528293.519616:0:8414:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788528293.519674:0:8414:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.138@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788528293.519680:0:8414:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788528293.519682:0:8414:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788528293.519683:0:8414:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788528293.519685:0:8414:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788528293.519686:0:8414:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788528293.519688:0:8414:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788528293.519689:0:8414:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788528293.519691:0:8414:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788528293.519692:0:8414:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788528293.519693:0:8414:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788528293.519695:0:8414:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788528293.519705:0:8414:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788528293.519707:0:8414:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788528293.519708:0:8414:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788528293.519709:0:8414:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788528293.519710:0:8414:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788528293.519711:0:8414:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788528293.519712:0:8414:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788528293.519713:0:8414:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788528293.519714:0:8414:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788528293.519715:0:8414:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788528293.519716:0:8414:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788528293.519717:0:8414:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788528293.519747:0:8414:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788528293.519778:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735374720:0@lo:253: 00000100:00100000:1.0:1788528293.520071:0:8414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528293.520161:0:8414:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1c599c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528293.520232:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735374720 00000100:00100000:2.0:1788528293.520240:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735374720 00000100:00100000:2.0:1788528293.520291:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788528293.520301:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+19:8414:x1875407735374720:12345-0@lo:253: 20000000:01000000:2.0:1788528293.520771:0:6500:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788528293.520776:0:6500:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788528293.520781:0:6500:0:(mgs_llog.c:875:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788528293.520784:0:6500:0:(mgs_llog.c:3868:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788528293.521054:0:6500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788528293.522484:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788528293.522516:0:6500:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788528293.522548:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788528293.522569:0:6500:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788528293.522586:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788528293.522607:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788528293.522737:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788528293.522753:0:6500:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.203.138@tcp 20000000:01000000:2.0:1788528293.522755:0:6500:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.203.138@tcp (null) (null) (null) 00000040:00080000:2.0:1788528293.522767:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788528293.522772:0:6500:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788528293.522805:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788528293.522810:0:6500:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.138@tcp (null) (null) 00000040:00080000:2.0:1788528293.522820:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788528293.522825:0:6500:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788528293.522835:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788528293.522847:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788528293.522915:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1788528293.522925:0:6500:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.203.138@tcp 20000000:01000000:2.0:1788528293.522926:0:6500:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.203.138@tcp (null) (null) (null) 00000040:00080000:2.0:1788528293.522939:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1788528293.522943:0:6500:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788528293.522953:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1788528293.522957:0:6500:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.138@tcp (null) (null) 00000040:00080000:2.0:1788528293.522967:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1788528293.522971:0:6500:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788528293.522981:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1788528293.522992:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1788528293.523421:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1788528293.523431:0:6500:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.203.138@tcp 20000000:01000000:2.0:1788528293.523432:0:6500:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.203.138@tcp (null) (null) (null) 00000040:00080000:2.0:1788528293.523443:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1788528293.523447:0:6500:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788528293.523456:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1788528293.523460:0:6500:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.138@tcp (null) (null) 00000040:00080000:2.0:1788528293.523470:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1788528293.523474:0:6500:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788528293.523484:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1788528293.523496:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1788528293.523507:0:6500:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788528293.523509:0:6500:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788528293.523512:0:6500:0:(mgs_llog.c:4187:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788528293.523551:0:6500:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788528293.523574:0:6500:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788528293.525839:0:8433:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:2.0:1788528293.525897:0:8433:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:2.0:1788528293.525915:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1788528293.526100:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1788528293.526126:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1788528293.526154:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:1.0:1788528293.526169:0:6500:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788528293.526171:0:6500:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788528293.526452:0:8434:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1788528293.526479:0:8434:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1788528293.526491:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788528293.526619:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788528293.526774:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788528293.526791:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788528293.526802:0:6500:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788528293.526804:0:6500:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788528293.529195:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788528293.529499:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788528293.529527:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788528293.529542:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788528293.529585:0:6500:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788528293.529588:0:6500:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788528293.533300:0:8436:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:2.0:1788528293.533364:0:8436:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:2.0:1788528293.533383:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1788528293.534083:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1788528293.534111:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1788528293.534128:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:3.0:1788528293.534161:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788528293.534185:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c7705 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.534203:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c1551a00/0x892c60dda91c75a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c75a0 expref: 19 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.534229:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9101851c00/0x892c60dda91c75d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c75ca expref: 19 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.534237:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9101850400/0x892c60dda91c7648 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7641 expref: 19 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.534244:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9101850800/0x892c60dda91c7680 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7679 expref: 19 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.534251:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c0031a00/0x892c60dda91c769c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7695 expref: 19 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.534258:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9101851600/0x892c60dda91c76c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c76bf expref: 19 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.534266:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c7705 lrc: 9/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.534313:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9101851600/0x892c60dda91c76c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c76bf expref: 19 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.534328:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9101851600/0x892c60dda91c76c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c76bf expref: 19 pid: 6502 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528293.534345:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6500:1875407735374848:0@lo:104: 00000100:00100000:3.0:1788528293.534410:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788528293.534508:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c0031a00/0x892c60dda91c769c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c7695 expref: 19 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.534516:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a90c0031a00/0x892c60dda91c769c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c7695 expref: 19 pid: 6501 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528293.534532:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6500:1875407735374976:0@lo:104: 00000100:00100000:3.0:1788528293.534583:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788528293.535056:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9101850800/0x892c60dda91c7680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c7679 expref: 19 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.535065:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9101850800/0x892c60dda91c7680 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c7679 expref: 19 pid: 6500 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528293.535074:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6500:1875407735375104:0@lo:104: 00000100:00100000:3.0:1788528293.535098:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528293.535123:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735374848 00000100:00100000:2.0:1788528293.535131:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735374848 00010000:00010000:3.0:1788528293.535273:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9101850400/0x892c60dda91c7648 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c7641 expref: 19 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.535281:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9101850400/0x892c60dda91c7648 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c7641 expref: 19 pid: 6500 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528293.535290:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea0e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6500:1875407735375232:0@lo:104: 00000100:00100000:3.0:1788528293.535313:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528293.535335:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735374976 00000100:00100000:0.0:1788528293.535339:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735374976 00000100:00100000:0.0:1788528293.535360:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735375104 00000100:00100000:0.0:1788528293.535362:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735375104 00000100:00100000:0.0:1788528293.535379:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788528293.535388:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+5:6500:x1875407735374848:12345-0@lo:104: 00010000:00010000:0.0:1788528293.535402:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16000/0x892c60dda91c76bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c76c6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.535506:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788528293.535514:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+5:6500:x1875407735374848:12345-0@lo:104: Request processed in 127us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528293.535520:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788528293.535537:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788528293.535543:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+4:6500:x1875407735374976:12345-0@lo:104: 00010000:00010000:0.0:1788528293.535551:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab400/0x892c60dda91c7695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c769c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528293.535777:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788528293.535786:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16000/0x892c60dda91c76bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c76c6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528293.535807:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16000 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528293.535811:0:6497:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16000/0x892c60dda91c76bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c76c6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528293.535819:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16000/0x892c60dda91c76bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c76c6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528293.535826:0:6497:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16000/0x892c60dda91c76bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c76c6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528293.535830:0:6497:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788528293.535886:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16000/0x892c60dda91c76bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c76c6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528293.535893:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528293.535913:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16000/0x892c60dda91c76bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c76c6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528293.535921:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16000/0x892c60dda91c76bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c76c6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528293.535932:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528293.535936:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab400/0x892c60dda91c7695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c769c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528293.535942:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c14ab400 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528293.535945:0:6497:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab400/0x892c60dda91c7695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c769c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528293.535961:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab400/0x892c60dda91c7695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c769c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528293.535968:0:6497:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab400/0x892c60dda91c7695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c769c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528293.535973:0:6497:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788528293.535988:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab400/0x892c60dda91c7695 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c769c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528293.535994:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528293.535999:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab400/0x892c60dda91c7695 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c769c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528293.536006:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab400/0x892c60dda91c7695 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c769c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528293.536016:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528293.536017:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528293.536019:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528293.536034:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735375360:0@lo:103: 00000100:00100000:1.0:1788528293.536066:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528293.536098:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788528293.536104:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735375488:0@lo:103: 00000100:00100000:1.0:1788528293.536135:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528293.536171:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735375360 00000100:00100000:1.0:1788528293.536176:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735375360 00010000:00010000:1.0:1788528293.536196:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9101851600/0x892c60dda91c76c6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c76bf expref: 20 pid: 6502 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528293.536226:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735375488 00000100:00100000:1.0:1788528293.536229:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735375488 00010000:00010000:1.0:1788528293.536249:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c0031a00/0x892c60dda91c769c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7695 expref: 21 pid: 6501 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528293.536260:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788528293.536266:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+21:3637:x1875407735375360:12345-0@lo:103: 00010000:00010000:1.0:1788528293.536276:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528293.536281:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9101851600/0x892c60dda91c76c6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c76bf expref: 21 pid: 6502 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528293.536291:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9101851600/0x892c60dda91c76c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c76bf expref: 21 pid: 6502 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528293.536309:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528293.536332:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+21:3637:x1875407735375360:12345-0@lo:103: Request processed in 66us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528293.536338:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788528293.536350:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788528293.536355:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+20:3637:x1875407735375488:12345-0@lo:103: 00010000:00010000:1.0:1788528293.536370:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528293.536375:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c0031a00/0x892c60dda91c769c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7695 expref: 20 pid: 6501 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528293.536384:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c0031a00/0x892c60dda91c769c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c7695 expref: 20 pid: 6501 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528293.536393:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528293.536413:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+20:3637:x1875407735375488:12345-0@lo:103: Request processed in 58us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528293.536419:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788528293.536452:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735375488:0@lo:103: 00000100:00100000:1.0:1788528293.536462:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735375360:0@lo:103: 00010000:00010000:0.0:1788528293.537015:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788528293.537025:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+4:6500:x1875407735374976:12345-0@lo:104: Request processed in 1481us (2440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528293.537040:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788528293.537057:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788528293.537065:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+3:6500:x1875407735375104:12345-0@lo:104: 00010000:00010000:0.0:1788528293.537076:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c14aba00/0x892c60dda91c7679 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7680 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.537212:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9101851c00/0x892c60dda91c75d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c75ca expref: 19 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.537224:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9101851c00/0x892c60dda91c75d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c75ca expref: 19 pid: 6501 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528293.537235:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6500:1875407735375616:0@lo:104: 00000100:00100000:3.0:1788528293.537260:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788528293.537274:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c1551a00/0x892c60dda91c75a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c75a0 expref: 19 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.537291:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a90c1551a00/0x892c60dda91c75a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c75a0 expref: 19 pid: 6501 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528293.537300:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6500:1875407735375744:0@lo:104: 00000100:00100000:3.0:1788528293.537319:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528293.537327:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d93840 going to sleep for 11 seconds 00010000:00010000:3.0:1788528293.537341:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101851600/0x892c60dda91c76c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c76bf expref: 19 pid: 6502 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528293.537353:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6500:1875407735374848:0@lo:104: 00010000:00010000:3.0:1788528293.537362:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c0031a00/0x892c60dda91c769c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c7695 expref: 18 pid: 6501 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528293.537370:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6500:1875407735374976:0@lo:104: 00000100:00100000:3.0:1788528293.537376:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6500:1875407735375104:0@lo:104: 00000100:00100000:2.0:1788528293.537432:0:6491:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788528293.537442:0:6491:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788528293.537447:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1788528293.537809:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735375232 00000100:00100000:3.0:1788528293.537816:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735375232 00000100:00100000:3.0:1788528293.537840:0:6491:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788528293.537844:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735375616 00000100:00100000:3.0:1788528293.537846:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735375616 00000100:00100000:3.0:1788528293.537853:0:6491:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788528293.537862:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735375744 00000100:00100000:3.0:1788528293.537864:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735375744 00000100:00100000:2.0:1788528293.537983:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788528293.537991:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dd052447-840d-4bcc-891b-140c465c7625+6:6500:x1875407735375232:12345-0@lo:104: 00010000:00010000:2.0:1788528293.538001:0:8437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa000/0x892c60dda91c7641 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7648 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528293.538082:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea0e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6500:1875407735375232:0@lo:104: 00010000:00010000:1.0:1788528293.540046:0:6496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788528293.540061:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c14aba00/0x892c60dda91c7679 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7680 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528293.540073:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c14aba00 already unused, calling callback (ffffffffc11e0e00) 00010000:00010000:0.0:1788528293.541192:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788528293.541212:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+6:6500:x1875407735375104:12345-0@lo:104: Request processed in 4142us (6106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528293.541225:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788528293.541271:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788528293.541287:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+5:6500:x1875407735375616:12345-0@lo:104: 00010000:00010000:0.0:1788528293.541308:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c75ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c75d1 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.541402:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788528293.541408:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+5:6500:x1875407735375616:12345-0@lo:104: Request processed in 130us (4147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528293.541414:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788528293.541430:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788528293.541437:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa77dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+4:6500:x1875407735375744:12345-0@lo:104: 00010000:00010000:0.0:1788528293.541445:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c13fda00/0x892c60dda91c75a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c75a7 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.541476:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788528293.541481:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa77dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+4:6500:x1875407735375744:12345-0@lo:104: Request processed in 45us (4160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528293.541500:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1788528293.541593:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788528293.541602:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dd052447-840d-4bcc-891b-140c465c7625+3:6500:x1875407735375232:12345-0@lo:104: Request processed in 3612us (6287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528293.541610:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788528293.541767:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6500:1875407735375616:0@lo:104: 00000100:00100000:0.0:1788528293.541777:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6500:1875407735375744:0@lo:104: 00010000:00010000:0.0:1788528293.541810:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c7705 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.542028:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788528293.542338:0:8438:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788528293.542596:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:1.0:1788528293.542647:0:6496:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c14aba00/0x892c60dda91c7679 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c7680 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528293.542665:0:6496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c14aba00/0x892c60dda91c7679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c7680 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528293.542674:0:6496:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c14aba00/0x892c60dda91c7679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c7680 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528293.542681:0:6496:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788528293.542729:0:6496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c14aba00/0x892c60dda91c7679 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7680 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528293.542736:0:6496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788528293.542752:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c75ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c75d1 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.542762:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030a00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:0.0:1788528293.542766:0:8438:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c75ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c75d1 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528293.542767:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c14aba00/0x892c60dda91c7679 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7680 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.542781:0:8438:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c75ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c75d1 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528293.542783:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c14aba00/0x892c60dda91c7679 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7680 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528293.542795:0:8438:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c75ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c75d1 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528293.542800:0:8438:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788528293.542819:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528293.542821:0:8438:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c75ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c75d1 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528293.542822:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528293.542825:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528293.542830:0:8438:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788528293.542838:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c75ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c75d1 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528293.542855:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735376000:0@lo:103: 00000100:00100000:2.0:1788528293.542984:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735375872:0@lo:103: 00000100:00100000:2.0:1788528293.543036:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788528293.543104:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c75ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c75d1 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.543124:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528293.543126:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528293.543128:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528293.543172:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa000/0x892c60dda91c7641 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7648 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.543189:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c14aa000 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:3.0:1788528293.543193:0:6497:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa000/0x892c60dda91c7641 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c7648 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.543200:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa000/0x892c60dda91c7641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c7648 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788528293.543207:0:6497:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa000/0x892c60dda91c7641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c7648 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528293.543212:0:6497:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788528293.543263:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa000/0x892c60dda91c7641 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7648 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.543269:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788528293.543288:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa000/0x892c60dda91c7641 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7648 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.543295:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa000/0x892c60dda91c7641 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7648 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.543305:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528293.543306:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528293.543308:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528293.543347:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735376128:0@lo:103: 00000100:00100000:0.0:1788528293.543373:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528293.543429:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735375872 00000100:00100000:3.0:1788528293.543436:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735375872 00010000:00010000:3.0:1788528293.543461:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9101850800/0x892c60dda91c7680 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7679 expref: 18 pid: 6500 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528293.543490:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735376128 00000100:00100000:3.0:1788528293.543497:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735376128 00010000:00010000:3.0:1788528293.543508:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9101850400/0x892c60dda91c7648 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7641 expref: 19 pid: 6500 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528293.543521:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788528293.543527:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+19:3639:x1875407735375872:12345-0@lo:103: 00010000:00010000:3.0:1788528293.543540:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528293.543545:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9101850800/0x892c60dda91c7680 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7679 expref: 19 pid: 6500 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.543575:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9101850800/0x892c60dda91c7680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c7679 expref: 19 pid: 6500 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.543590:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101850800/0x892c60dda91c7680 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c7679 expref: 19 pid: 6500 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.543603:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528293.543648:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+18:3639:x1875407735375872:12345-0@lo:103: Request processed in 120us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528293.543655:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788528293.543670:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788528293.543675:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+17:3637:x1875407735376128:12345-0@lo:103: 00010000:00010000:3.0:1788528293.543682:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528293.543686:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9101850400/0x892c60dda91c7648 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7641 expref: 17 pid: 6500 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.543695:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9101850400/0x892c60dda91c7648 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c7641 expref: 17 pid: 6500 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.543705:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101850400/0x892c60dda91c7648 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c7641 expref: 17 pid: 6500 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.543717:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528293.543740:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+16:3637:x1875407735376128:12345-0@lo:103: Request processed in 65us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528293.543746:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788528293.543773:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735376128:0@lo:103: 00000100:00100000:2.0:1788528293.544249:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735375872:0@lo:103: 00010000:00010000:3.0:1788528293.544373:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528293.544376:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528293.544378:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528293.544396:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c13fda00/0x892c60dda91c75a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c75a7 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.544405:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c13fda00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:2.0:1788528293.544414:0:8439:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c13fda00/0x892c60dda91c75a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c75a7 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.544423:0:8439:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c13fda00/0x892c60dda91c75a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c75a7 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788528293.544430:0:8439:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c13fda00/0x892c60dda91c75a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c75a7 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528293.544435:0:8439:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788528293.544493:0:8439:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c13fda00/0x892c60dda91c75a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c75a7 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.544500:0:8439:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788528293.544515:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c13fda00/0x892c60dda91c75a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c75a7 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.544522:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c13fda00/0x892c60dda91c75a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c75a7 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.544535:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528293.544536:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528293.544538:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528293.544577:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788528293.544588:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735376256:0@lo:103: 00000100:00100000:0.0:1788528293.544632:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528293.544748:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735376256 00000100:00100000:2.0:1788528293.544754:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735376256 00010000:00010000:2.0:1788528293.544774:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c1551a00/0x892c60dda91c75a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c75a0 expref: 16 pid: 6501 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528293.544801:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788528293.544808:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+16:3637:x1875407735376256:12345-0@lo:103: 00010000:00010000:2.0:1788528293.544818:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528293.544830:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c1551a00/0x892c60dda91c75a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c75a0 expref: 16 pid: 6501 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.544841:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c1551a00/0x892c60dda91c75a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c75a0 expref: 16 pid: 6501 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.544864:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c1551a00/0x892c60dda91c75a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c75a0 expref: 16 pid: 6501 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528293.544865:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788528293.544881:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528293.544912:0:6495:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788528293.544919:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+15:3637:x1875407735376256:12345-0@lo:103: Request processed in 110us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528293.544926:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788528293.544938:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735376000 00000100:00100000:2.0:1788528293.544941:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735376000 00010000:00010000:2.0:1788528293.544951:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9101851c00/0x892c60dda91c75d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c75ca expref: 15 pid: 6501 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528293.544962:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788528293.544967:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90efa87450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+15:3640:x1875407735376000:12345-0@lo:103: 00010000:00010000:2.0:1788528293.544973:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528293.544976:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9101851c00/0x892c60dda91c75d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c75ca expref: 15 pid: 6501 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528293.544985:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1788528293.544986:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9101851c00/0x892c60dda91c75d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c75ca expref: 15 pid: 6501 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.544997:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101851c00/0x892c60dda91c75d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c75ca expref: 15 pid: 6501 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.545011:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c7705 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.545025:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c7705 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.545042:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c7705 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.545049:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c7705 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.545055:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c7705 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.545061:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c7705 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.545066:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c1550a00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528293.545071:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c7705 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.545078:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c7705 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.545093:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c7705 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.545104:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528293.545130:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90efa87450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+14:3640:x1875407735376000:12345-0@lo:103: Request processed in 162us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528293.545136:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788528293.545171:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735376000:0@lo:103: 00000100:00100000:2.0:1788528293.545206:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735376256:0@lo:103: 00010000:00010000:2.0:1788528293.545232:0:6500:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c7705 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.545241:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c7705 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.545247:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c7705 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788528293.545262:0:6500:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788528293.550276:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+13:8414:x1875407735374720:12345-0@lo:253: Request processed in 29957us (30186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528293.550291:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788528293.550428:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735374720:0@lo:253: 10000000:01000000:1.0:1788528293.550445:0:8414:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788528293.550448:0:8414:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788528293.550450:0:8414:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788528293.550452:0:8414:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788528293.550453:0:8414:0:(tgt_mount.c:1242:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1788528293.550454:0:8414:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788528293.550455:0:8414:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788528293.550456:0:8414:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788528293.550458:0:8414:0:(tgt_mount.c:1260:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788528293.550460:0:8414:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788528293.550461:0:8414:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788528293.550484:0:8414:0:(tgt_mount.c:115:server_register_mount()) register mount ffff8a90fa76f800 from lustre-OST0000 10000000:01000000:1.0:1788528293.550514:0:8414:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788528293.550518:0:8414:0:(mgc_request.c:423:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788528293.550526:0:8414:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8a90fa76f800 10000000:01000000:1.0:1788528293.550532:0:8414:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788528293.550549:0:8414:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-OST0000-osd 00000040:01000000:1.0:1788528293.557832:0:8414:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788528293.576851:0:8414:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788528293.576870:0:8414:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff8a90fa76f800 from 1 10000000:01000000:0.0:1788528293.576873:0:8414:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788528293.576918:0:8414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c770c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.576930:0:8414:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c770c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.576943:0:8414:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c770c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528293.576967:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735376384:0@lo:101: 00000100:00100000:0.0:1788528293.577035:0:8414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528293.577137:0:8414:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c82bdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788528293.577876:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735376384 00000100:00100000:3.0:1788528293.577887:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735376384 00000100:00100000:3.0:1788528293.577943:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788528293.577954:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+13:8414:x1875407735376384:12345-0@lo:101: 00010000:00010000:3.0:1788528293.577972:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528293.577990:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c7713 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c770c expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.578019:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c7713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c770c expref: 14 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.578030:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c7713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c770c expref: 14 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.578039:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c1550a00, rc 0) 00000100:00100000:3.0:1788528293.578171:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+14:8414:x1875407735376384:12345-0@lo:101: Request processed in 217us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528293.578178:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788528293.579284:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735376384:0@lo:101: 00010000:00010000:0.0:1788528293.579312:0:8414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c770c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7713 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.579342:0:8414:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c770c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7713 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528293.579593:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735376512:0@lo:501: 00000100:00100000:0.0:1788528293.579642:0:8414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528293.579684:0:8414:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c82bdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788528293.579750:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735376512 00000100:00100000:2.0:1788528293.579758:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735376512 00000100:00100000:2.0:1788528293.579808:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788528293.579816:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+14:8414:x1875407735376512:12345-0@lo:501: 00000100:00100000:2.0:1788528293.579901:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+14:8414:x1875407735376512:12345-0@lo:501: Request processed in 86us (258us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788528293.579909:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788528293.579986:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735376512:0@lo:501: 10000000:01000000:0.0:1788528293.580000:0:8414:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.203.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:0.0:1788528293.580027:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735376640:0@lo:501: 00000100:00100000:0.0:1788528293.580052:0:8414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528293.580076:0:8414:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c82bdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788528293.580132:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735376640 00000100:00100000:3.0:1788528293.580153:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735376640 00000100:00100000:3.0:1788528293.580182:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788528293.580188:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d9d54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+14:8414:x1875407735376640:12345-0@lo:501: 00000100:00100000:3.0:1788528293.580246:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d9d54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+14:8414:x1875407735376640:12345-0@lo:501: Request processed in 58us (193us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788528293.580253:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788528293.580323:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735376640:0@lo:501: 10000000:01000000:0.0:1788528293.580341:0:8414:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788528293.580361:0:8414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c770c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7713 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.580499:0:8414:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c770c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7713 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528293.580513:0:8414:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff8a90fa76f800 10000000:01000000:0.0:1788528293.580519:0:8414:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788528293.580625:0:8414:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-OST0000-osd 00000040:01000000:0.0:1788528293.580697:0:8414:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788528293.580704:0:8414:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788528293.580712:0:8414:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788528293.580716:0:8414:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788528293.580739:0:8414:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-OST0000-osd 00000040:01000000:0.0:1788528293.580766:0:8414:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788528293.580771:0:8414:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788528293.580777:0:8414:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788528293.580779:0:8414:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788528293.580803:0:8414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0030800/0x892c60dda91c771a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.580812:0:8414:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c0030800/0x892c60dda91c771a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.580821:0:8414:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c0030800/0x892c60dda91c771a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528293.580834:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735376768:0@lo:101: 00000100:00100000:0.0:1788528293.581001:0:8414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528293.581072:0:8414:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d01b3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788528293.583225:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735376768 00000100:00100000:2.0:1788528293.583242:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735376768 00000100:00100000:2.0:1788528293.583303:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788528293.583315:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+14:8414:x1875407735376768:12345-0@lo:101: 00010000:00010000:2.0:1788528293.583333:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528293.583355:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9101851c00/0x892c60dda91c7721 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c771a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.583394:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101851c00/0x892c60dda91c7721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c771a expref: 15 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.583420:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9101851c00/0x892c60dda91c7721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c771a expref: 15 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.583432:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101851c00, rc 0) 00000100:00100000:2.0:1788528293.583571:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+15:8414:x1875407735376768:12345-0@lo:101: Request processed in 242us (2679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528293.583578:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788528293.583879:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735376768:0@lo:101: 00010000:00010000:0.0:1788528293.583899:0:8414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c0030800/0x892c60dda91c771a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7721 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.583909:0:8414:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c0030800/0x892c60dda91c771a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7721 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528293.584001:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735376896:0@lo:501: 00000100:00100000:0.0:1788528293.584038:0:8414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528293.584178:0:8414:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d01b3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788528293.584283:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735376896 00000100:00100000:3.0:1788528293.584289:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735376896 00000100:00100000:3.0:1788528293.584373:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788528293.584382:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+15:8414:x1875407735376896:12345-0@lo:501: 00000100:00100000:3.0:1788528293.584501:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+15:8414:x1875407735376896:12345-0@lo:501: Request processed in 120us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528293.584508:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788528293.584584:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735376896:0@lo:501: 00000100:00100000:0.0:1788528293.584632:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735377024:0@lo:503: 00000100:00100000:0.0:1788528293.584675:0:8414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528293.585168:0:8414:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d01b3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788528293.585378:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735377024 00000100:00100000:2.0:1788528293.585385:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735377024 00000100:00100000:2.0:1788528293.585420:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788528293.585427:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+15:8414:x1875407735377024:12345-0@lo:503: 00000100:00100000:2.0:1788528293.585544:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+15:8414:x1875407735377024:12345-0@lo:503: Request processed in 117us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528293.585551:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788528293.585699:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735377024:0@lo:503: 00000040:00080000:0.0:1788528293.585962:0:8414:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788528293.586084:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735377152:0@lo:502: 00000100:00100000:0.0:1788528293.586123:0:8414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528293.586169:0:8414:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d01b3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788528293.587218:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735377152 00000100:00100000:2.0:1788528293.587229:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735377152 00000100:00100000:2.0:1788528293.587270:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788528293.587280:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+15:8414:x1875407735377152:12345-0@lo:502: 00000100:00100000:2.0:1788528293.588879:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+15:8414:x1875407735377152:12345-0@lo:502: Request processed in 1593us (2748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528293.588895:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788528293.589024:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735377152:0@lo:502: 00000040:00080000:0.0:1788528293.589274:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788528293.589304:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788528293.589318:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788528293.589334:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788528293.589346:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788528293.589357:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788528293.589428:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735377280:0@lo:502: 00000100:00100000:0.0:1788528293.589478:0:8414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528293.589522:0:8414:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d01b3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788528293.590249:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735377280 00000100:00100000:1.0:1788528293.590261:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735377280 00000100:00100000:1.0:1788528293.590321:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788528293.590341:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+15:8414:x1875407735377280:12345-0@lo:502: 00000100:00100000:1.0:1788528293.590508:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+15:8414:x1875407735377280:12345-0@lo:502: Request processed in 168us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528293.590515:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788528293.590624:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735377280:0@lo:502: 00000040:00080000:0.0:1788528293.590681:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788528293.590691:0:8414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788528293.592995:0:8442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788528293.593009:0:8442:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788528293.593018:0:8442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528293.593020:0:8442:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788528293.593027:0:8442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788528293.593045:0:8442:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8a90fa609980) 00000020:00000080:3.0:1788528293.593069:0:8442:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788528293.593076:0:8442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788528293.593173:0:8442:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a90fa76f800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788528293.593182:0:8442:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788528293.593190:0:8442:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x892c60dda91c772f 00010000:00010000:3.0:1788528293.604649:0:8442:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1788528293.605003:0:8442:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788528293.608809:0:8442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788528293.609348:0:8442:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788528293.623932:0:8442:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1788528293.624838:0:8442:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1788528293.637043:0:8442:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1788528293.638341:0:8442:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788528293.638355:0:8442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788528293.638366:0:8442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528293.638368:0:8442:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788528293.638372:0:8442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788528293.638377:0:8442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528293.638508:0:8442:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788528293.638514:0:8442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788528293.638516:0:8442:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788528293.638541:0:8442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788528293.638545:0:8442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528293.638546:0:8442:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788528293.638549:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788528293.641063:0:8414:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788528293.641084:0:8414:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788528293.641114:0:8414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0030800/0x892c60dda91c771a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7721 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.641127:0:8414:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c0030800/0x892c60dda91c771a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7721 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528293.641160:0:8414:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a90fa76f800 from 1 10000000:01000000:0.0:1788528293.641164:0:8414:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788528293.641207:0:8414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c7736 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.641216:0:8414:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c7736 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.641229:0:8414:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c7736 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528293.641256:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735377408:0@lo:101: 00000100:00100000:0.0:1788528293.641330:0:8414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528293.641374:0:8414:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d01b3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788528293.641454:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735377408 00000100:00100000:2.0:1788528293.641463:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735377408 00000100:00100000:2.0:1788528293.641526:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788528293.641537:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+15:8414:x1875407735377408:12345-0@lo:101: 00010000:00010000:2.0:1788528293.641585:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528293.641604:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9101850400/0x892c60dda91c773d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7736 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.641632:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101850400/0x892c60dda91c773d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7736 expref: 16 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.641646:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9101850400/0x892c60dda91c773d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7736 expref: 16 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.641656:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101850400, rc 0) 00000100:00100000:2.0:1788528293.641702:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+16:8414:x1875407735377408:12345-0@lo:101: Request processed in 165us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528293.641709:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788528293.642978:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735377408:0@lo:101: 00010000:00010000:0.0:1788528293.643004:0:8414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c7736 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c773d expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.643018:0:8414:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c7736 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c773d expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528293.643104:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735377536:0@lo:501: 00000100:00100000:0.0:1788528293.643165:0:8414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528293.643208:0:8414:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d01b3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788528293.643874:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735377536 00000100:00100000:1.0:1788528293.643884:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735377536 00000100:00100000:1.0:1788528293.643933:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788528293.643943:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+16:8414:x1875407735377536:12345-0@lo:501: 00000100:00100000:1.0:1788528293.644067:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+16:8414:x1875407735377536:12345-0@lo:501: Request processed in 125us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528293.644075:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788528293.645524:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735377536:0@lo:501: 00000100:00100000:0.0:1788528293.645612:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735377664:0@lo:503: 00000100:00100000:0.0:1788528293.645701:0:8414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528293.645744:0:8414:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d01b3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788528293.646031:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735377664 00000100:00100000:1.0:1788528293.646038:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735377664 00000100:00100000:1.0:1788528293.646091:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788528293.646101:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+16:8414:x1875407735377664:12345-0@lo:503: 00000100:00100000:1.0:1788528293.646233:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+16:8414:x1875407735377664:12345-0@lo:503: Request processed in 133us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528293.646241:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788528293.646347:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735377664:0@lo:503: 00000040:00080000:0.0:1788528293.648029:0:8414:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788528293.648134:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735377792:0@lo:502: 00000100:00100000:0.0:1788528293.648218:0:8414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528293.648264:0:8414:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d01b3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788528293.648798:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735377792 00000100:00100000:2.0:1788528293.648807:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735377792 00000100:00100000:2.0:1788528293.649005:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788528293.649015:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+16:8414:x1875407735377792:12345-0@lo:502: 00000100:00100000:2.0:1788528293.649157:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+16:8414:x1875407735377792:12345-0@lo:502: Request processed in 143us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528293.649165:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788528293.649256:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735377792:0@lo:502: 00000040:00080000:3.0:1788528293.649791:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788528293.649819:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788528293.649850:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735377920:0@lo:502: 00000100:00100000:3.0:1788528293.649892:0:8414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528293.649931:0:8414:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d9d04a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788528293.649980:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735377920 00000100:00100000:1.0:1788528293.649986:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735377920 00000100:00100000:1.0:1788528293.650019:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788528293.650026:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+16:8414:x1875407735377920:12345-0@lo:502: 00000100:00100000:1.0:1788528293.650112:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+16:8414:x1875407735377920:12345-0@lo:502: Request processed in 86us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528293.650118:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788528293.650294:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735377920:0@lo:502: 00000040:00080000:3.0:1788528293.650340:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788528293.650347:0:8414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788528293.651199:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788528293.651208:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528293.651210:0:8446:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788528293.651217:0:8446:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a90fa76f800 00000020:00000080:3.0:1788528293.651220:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788528293.651231:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788528293.651234:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528293.651235:0:8446:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788528293.651237:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788528293.651352:0:8414:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788528293.651361:0:8414:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788528293.651379:0:8414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c7736 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c773d expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.651390:0:8414:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c7736 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c773d expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528293.651451:0:8414:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788528293.651455:0:8414:0:(mgc_request.c:423:config_log_add()) add config log lustre-client-ffff8a90fa76f800 10000000:01000000:2.0:1788528293.651458:0:8414:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff8a90fa76f800 10000000:01000000:2.0:1788528293.651463:0:8414:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788528293.651479:0:8414:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-OST0000-osd 00000040:01000000:2.0:1788528293.651517:0:8414:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788528293.651524:0:8414:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788528293.651536:0:8414:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff8a90fa76f800 from 1 10000000:01000000:2.0:1788528293.651539:0:8414:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788528293.651594:0:8414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.651603:0:8414:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.651614:0:8414:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528293.651655:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735378048:0@lo:101: 00000100:00100000:2.0:1788528293.651697:0:8414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528293.651733:0:8414:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3dada80 going to sleep for 11 seconds 00000100:00100000:0.0:1788528293.651735:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735378048 00000100:00100000:0.0:1788528293.651741:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735378048 00000100:00100000:0.0:1788528293.651936:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788528293.651945:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+16:8414:x1875407735378048:12345-0@lo:101: 00010000:00010000:0.0:1788528293.651959:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528293.651973:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c0031800/0x892c60dda91c774b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7744 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.651995:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c0031800/0x892c60dda91c774b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7744 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.652005:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c0031800/0x892c60dda91c774b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7744 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.652015:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031800, rc 0) 00000100:00100000:0.0:1788528293.652055:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+17:8414:x1875407735378048:12345-0@lo:101: Request processed in 110us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528293.652061:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788528293.652351:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735378048:0@lo:101: 00010000:00010000:2.0:1788528293.652367:0:8414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7744 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c774b expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528293.652375:0:8414:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7744 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c774b expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528293.652436:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735378176:0@lo:501: 00000100:00100000:2.0:1788528293.652466:0:8414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528293.652534:0:8414:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3dada80 going to sleep for 11 seconds 00000100:00100000:3.0:1788528293.652724:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735378176 00000100:00100000:3.0:1788528293.652729:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735378176 00000100:00100000:3.0:1788528293.652768:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788528293.652775:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+17:8414:x1875407735378176:12345-0@lo:501: 00000100:00100000:3.0:1788528293.652919:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+17:8414:x1875407735378176:12345-0@lo:501: Request processed in 144us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528293.652926:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788528293.652979:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735378176:0@lo:501: 00000100:00100000:2.0:1788528293.653008:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735378304:0@lo:503: 00000100:00100000:2.0:1788528293.653049:0:8414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528293.653086:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735378304 00000100:00100000:3.0:1788528293.653090:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735378304 00000100:00100000:2.0:1788528293.653103:0:8414:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3dada80 going to sleep for 11 seconds 00000100:00100000:3.0:1788528293.653161:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788528293.653171:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+17:8414:x1875407735378304:12345-0@lo:503: 00000100:00100000:3.0:1788528293.653257:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+17:8414:x1875407735378304:12345-0@lo:503: Request processed in 87us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528293.653269:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788528293.653340:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735378304:0@lo:503: 00000040:00080000:2.0:1788528293.653977:0:8414:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788528293.654058:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735378432:0@lo:502: 00000100:00100000:2.0:1788528293.654097:0:8414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528293.654126:0:8414:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d0b11480 going to sleep for 11 seconds 00000100:00100000:3.0:1788528293.654176:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735378432 00000100:00100000:3.0:1788528293.654181:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735378432 00000100:00100000:3.0:1788528293.654219:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788528293.654227:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+17:8414:x1875407735378432:12345-0@lo:502: 00000100:00100000:3.0:1788528293.654319:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+17:8414:x1875407735378432:12345-0@lo:502: Request processed in 92us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528293.654327:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788528293.654426:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735378432:0@lo:502: 00000040:00080000:2.0:1788528293.654972:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788528293.655005:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788528293.655018:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788528293.655030:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788528293.655043:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788528293.655054:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788528293.655067:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788528293.655079:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788528293.655093:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788528293.655106:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788528293.655118:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788528293.655131:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788528293.655155:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788528293.655171:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788528293.655197:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788528293.655211:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788528293.655224:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788528293.655236:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788528293.655247:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788528293.655259:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788528293.655271:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788528293.655284:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788528293.655297:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788528293.655309:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788528293.655321:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788528293.655334:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788528293.655351:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788528293.655365:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788528293.655377:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788528293.655388:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788528293.655412:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788528293.655427:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788528293.655438:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788528293.655448:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788528293.655471:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788528293.655485:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788528293.655498:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1788528293.655528:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735378560:0@lo:502: 00000100:00100000:2.0:1788528293.655813:0:8414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528293.655885:0:8414:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3dada80 going to sleep for 11 seconds 00000100:00100000:3.0:1788528293.655935:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735378560 00000100:00100000:3.0:1788528293.655942:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735378560 00000100:00100000:3.0:1788528293.656017:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788528293.656027:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+17:8414:x1875407735378560:12345-0@lo:502: 00000100:00100000:3.0:1788528293.656150:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+17:8414:x1875407735378560:12345-0@lo:502: Request processed in 116us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528293.656158:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788528293.656242:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735378560:0@lo:502: 00000040:00080000:2.0:1788528293.656292:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788528293.656300:0:8414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788528293.656786:0:8447:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788528293.656800:0:8447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8a90f6c4e600) 00000020:00000080:2.0:1788528293.656822:0:8447:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788528293.657603:0:8447:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a90fa76f800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788528293.657610:0:8447:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8a90fa76f800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788528293.657612:0:8447:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a90fa76f800 3 00010000:00080000:2.0:1788528293.657647:0:8447:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a8fc2400800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.138@tcp at head 00010000:00010000:2.0:1788528293.659911:0:8447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1788528293.660202:0:8447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788528293.660247:0:8447:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788528293.660262:0:8447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x892c60dda91c7759 00000100:00080000:2.0:1788528293.660276:0:8447:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788528293.660283:0:8447:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a8fc2400800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1788528293.660337:0:8447:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90f8e20000 x1875407735378688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788528293.660402:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1875407735378688:0@lo:38: 00000100:00100000:3.0:1788528293.660494:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788528293.660576:0:8447:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788528293.662066:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735378688 00000100:00100000:2.0:1788528293.662077:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735378688 00000100:00100000:2.0:1788528293.662120:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788528293.662129:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1875407735378688:12345-0@lo:38: 00010000:00080000:2.0:1788528293.662185:0:6509:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 162 last 0 00000020:00000080:2.0:1788528293.662232:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x892c60dda91c7760 00000004:00100000:2.0:1788528293.662250:0:6509:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788528293.662287:0:6509:0:(import.c:65:import_set_state_nolock()) ffff8a8fc2407000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788528293.662692:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735378944:0@lo:400: 00000100:00100000:0.0:1788528293.662738:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528293.662774:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788528293.662788:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735378816:0@lo:400: 00000100:00100000:0.0:1788528293.662814:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528293.662957:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788528293.662966:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000020:01000004:0.0:1788528293.664123:0:8447:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788528293.664153:0:8447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8a9101959980) 00000020:00000080:0.0:1788528293.664178:0:8447:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1788528293.664255:0:8447:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a90fa76f800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788528293.664259:0:8447:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8a90fa76f800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788528293.664262:0:8447:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a90fa76f800 3 00010000:00080000:0.0:1788528293.664291:0:8447:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a8fc1fe6000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.138@tcp at head 00000100:00100000:2.0:1788528293.665090:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875407735378688:12345-0@lo:38: Request processed in 1710us (3344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528293.665107:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788528293.665137:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735378816 00000100:00100000:2.0:1788528293.665156:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735378816 00000100:00100000:2.0:1788528293.665195:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788528293.665203:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735378816:12345-0@lo:400: 00000100:00100000:2.0:1788528293.665283:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735378816:12345-0@lo:400: Request processed in 80us (2468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528293.665290:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788528293.665324:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735379072:0@lo:400: 00000100:00100000:2.0:1788528293.665362:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528293.665390:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788528293.665397:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735379200:0@lo:400: 00000100:00100000:2.0:1788528293.665421:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528293.665447:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735379072 00000100:00100000:2.0:1788528293.665450:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735379072 00000100:00100000:2.0:1788528293.665467:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788528293.665473:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735379072:12345-0@lo:400: 00000100:00100000:2.0:1788528293.665506:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735379072:12345-0@lo:400: Request processed in 33us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528293.665512:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788528293.665576:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a90f8e22d80 x1875407735378816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528293.665592:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735378816:0@lo:400: 00000100:00100000:2.0:1788528293.665619:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735378944 00000100:00100000:2.0:1788528293.665623:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735378944 00000100:00100000:2.0:1788528293.665641:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735379200 00000100:00100000:2.0:1788528293.665644:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735379200 00000100:00100000:2.0:1788528293.665657:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788528293.665663:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735378944:12345-0@lo:400: 00000100:00100000:2.0:1788528293.665703:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735378944:12345-0@lo:400: Request processed in 39us (2965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528293.665709:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788528293.665720:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788528293.665726:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735379200:12345-0@lo:400: 00000100:00100000:2.0:1788528293.665751:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735379200:12345-0@lo:400: Request processed in 26us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528293.665757:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788528293.665779:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735379200:0@lo:400: 00010000:00080000:2.0:1788528293.665789:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a90f8e20a80 x1875407735379072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528293.665797:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735379072:0@lo:400: 00000100:00100000:2.0:1788528293.665820:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735378944:0@lo:400: 00010000:00080000:3.0:1788528293.666353:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a90f8e20000 x1875407735378688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788528303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528293.666364:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788528293.666375:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788528293.666384:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788528293.666390:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788528293.666394:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc2400800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788528293.666401:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1875407735378688:0@lo:38: 00010000:00010000:0.0:1788528293.670266:0:8447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:0.0:1788528293.670472:0:8447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788528293.670517:0:8447:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788528293.670530:0:8447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x892c60dda91c776e 00000100:00080000:0.0:1788528293.670542:0:8447:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788528293.670549:0:8447:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8a8fc1fe6000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1788528293.670610:0:8447:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90f5a0f480 x1875407735379328/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788528293.670633:0:8447:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788528293.672113:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1875407735379328:0@lo:38: 00000100:00100000:3.0:1788528293.672203:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788528293.672268:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1788528293.672271:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735379328 00000100:00100000:3.0:1788528293.672280:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735379328 00000100:00100000:3.0:1788528293.672314:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788528293.672322:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1875407735379328:12345-0@lo:38: 00000020:01000000:0.0:1788528293.672399:0:8414:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788528293.672417:0:8414:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00080000:3.0:1788528293.672432:0:6508:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 162 last 0 00010000:00010000:0.0:1788528293.672437:0:8414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7744 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c774b expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.672447:0:8414:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c774b expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788528293.672465:0:6508:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x892c60dda91c7775 00000004:00100000:3.0:1788528293.672481:0:6508:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:01000004:0.0:1788528293.672495:0:8414:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788528293.672500:0:8414:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788528293.672501:0:8414:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788528293.672502:0:8414:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788528293.672502:0:8414:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788528293.672504:0:8414:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788528293.672505:0:8414:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788528293.672506:0:8414:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788528293.672507:0:8414:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788528293.672509:0:8414:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788528293.672510:0:8414:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000100:00080000:3.0:1788528293.672512:0:6508:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1f90800 : changing import state from RECOVER to FULL 10000000:01000000:0.0:1788528293.672513:0:8414:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788528293.672515:0:8414:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788528293.672516:0:8414:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788528293.672517:0:8414:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788528293.672518:0:8414:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788528293.672519:0:8414:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788528293.672520:0:8414:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788528293.672520:0:8414:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788528293.672521:0:8414:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788528293.672522:0:8414:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788528293.672523:0:8414:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788528293.672524:0:8414:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788528293.672542:0:8414:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788528293.672579:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735379456:0@lo:253: 00000100:00100000:0.0:1788528293.672618:0:8414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528293.672661:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875407735379328:12345-0@lo:38: Request processed in 337us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528293.672669:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788528293.672712:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a90f5a0f480 x1875407735379328/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788528303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528293.672712:0:8414:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d01b3600 going to sleep for 11 seconds 00000100:00100000:3.0:1788528293.672723:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00100000:0.0:1788528293.672727:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735379456 00000100:00100000:0.0:1788528293.672729:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735379456 00000100:00080000:3.0:1788528293.672732:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788528293.672739:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788528293.672744:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788528293.672746:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1fe6000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788528293.672753:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1875407735379328:0@lo:38: 00000100:00100000:0.0:1788528293.672914:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788528293.672923:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+17:8414:x1875407735379456:12345-0@lo:253: 20000000:01000000:0.0:1788528293.672945:0:6500:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788528293.672959:0:6500:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788528293.677966:0:6500:0:(mgs_nids.c:820:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788528293.677990:0:6500:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788528293.678170:0:6524:0:(mgs_nids.c:717:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788528293.678176:0:6524:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788528293.678211:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a90f6e16000/0x892c60dda91c777c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528293.678231:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c14abc00/0x892c60dda91c7672 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c766b expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528293.678238:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9101850a00/0x892c60dda91c768e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7687 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528293.678246:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a90f6e16000/0x892c60dda91c777c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528293.678302:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9101850a00/0x892c60dda91c768e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c7687 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528293.678317:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9101850a00/0x892c60dda91c768e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c7687 expref: 17 pid: 6500 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528293.678333:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6524:1875407735379584:0@lo:104: 00000100:00100000:1.0:1788528293.678404:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788528293.678463:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c14abc00/0x892c60dda91c7672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c766b expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528293.678471:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a90c14abc00/0x892c60dda91c7672 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c766b expref: 17 pid: 6500 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528293.678479:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6524:1875407735379712:0@lo:104: 00000100:00100000:1.0:1788528293.678516:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528293.678536:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1c59600 going to sleep for 11 seconds 00000100:00100000:0.0:1788528293.678692:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735379584 00000100:00100000:0.0:1788528293.678702:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735379584 00000100:00100000:0.0:1788528293.678753:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735379712 00000100:00100000:0.0:1788528293.678757:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735379712 00000100:00100000:0.0:1788528293.678775:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788528293.678783:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+4:6524:x1875407735379584:12345-0@lo:104: 00010000:00010000:0.0:1788528293.678797:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c7687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c768e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.678849:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788528293.678856:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+4:6524:x1875407735379584:12345-0@lo:104: Request processed in 74us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528293.678863:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788528293.678880:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788528293.678886:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+3:6524:x1875407735379712:12345-0@lo:104: 00010000:00010000:0.0:1788528293.678895:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa400/0x892c60dda91c766b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7672 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.678926:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788528293.678931:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+3:6524:x1875407735379712:12345-0@lo:104: Request processed in 46us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528293.678937:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1788528293.678952:0:8438:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788528293.678958:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c7687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c768e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.678966:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c14ab000 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:0.0:1788528293.678970:0:8438:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c7687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c768e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.678980:0:8438:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c7687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c768e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528293.678995:0:8438:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c7687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c768e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528293.679001:0:8438:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788528293.679031:0:8438:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c7687 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c768e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.679038:0:8438:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788528293.679054:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c7687 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c768e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.679061:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c7687 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c768e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.679073:0:8438:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528293.679076:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa400/0x892c60dda91c766b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7672 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.679082:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c14aa400 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:0.0:1788528293.679085:0:8438:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa400/0x892c60dda91c766b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c7672 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.679091:0:8438:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa400/0x892c60dda91c766b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c7672 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528293.679097:0:8438:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa400/0x892c60dda91c766b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c7672 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528293.679102:0:8438:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788528293.679120:0:8438:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa400/0x892c60dda91c766b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7672 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.679127:0:8438:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788528293.679132:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa400/0x892c60dda91c766b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7672 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.679138:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa400/0x892c60dda91c766b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7672 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528293.679163:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528293.679165:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528293.679166:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528293.679257:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528293.679296:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6524:1875407735379584:0@lo:104: 00000100:00100000:1.0:1788528293.679314:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6524:1875407735379712:0@lo:104: 00010000:00010000:1.0:1788528293.679336:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a90f6e16000/0x892c60dda91c777c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528293.679404:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+17:8414:x1875407735379456:12345-0@lo:253: Request processed in 6482us (6784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528293.679414:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788528293.679533:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:8414:1875407735379456:0@lo:253: 10000000:01000000:0.0:1788528293.679543:0:8414:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788528293.679547:0:8414:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788528293.679548:0:8414:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788528293.679550:0:8414:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788528293.679578:0:8414:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788528293.679580:0:8414:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788528293.679581:0:8414:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788528293.679583:0:8414:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788528293.679584:0:8414:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788528293.679586:0:8414:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788528293.679587:0:8414:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788528293.679589:0:8414:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788528293.679601:0:8414:0:(tgt_mount.c:2815:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788528293.680424:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735379840:0@lo:103: 00000100:00100000:2.0:1788528293.680471:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528293.680619:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788528293.680626:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735379968:0@lo:103: 00000100:00100000:2.0:1788528293.680649:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:0.0:1788528293.684785:0:8414:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1788528293.684956:0:8414:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788528293.685177:0:8414:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1788528293.685848:0:8414:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788528293.686060:0:8414:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788528293.686291:0:8414:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:3.0:1788528293.686657:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735379840 00000100:00100000:3.0:1788528293.686667:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735379840 00010000:00010000:3.0:1788528293.686708:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9101850a00/0x892c60dda91c768e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7687 expref: 17 pid: 6500 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528293.686752:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735379968 00000100:00100000:3.0:1788528293.686763:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735379968 00010000:00010000:3.0:1788528293.686780:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c14abc00/0x892c60dda91c7672 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c766b expref: 18 pid: 6500 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528293.686801:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788528293.686810:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+18:3639:x1875407735379840:12345-0@lo:103: 00010000:00010000:3.0:1788528293.686827:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528293.686833:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9101850a00/0x892c60dda91c768e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7687 expref: 18 pid: 6500 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.686846:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9101850a00/0x892c60dda91c768e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c7687 expref: 18 pid: 6500 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.686865:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101850a00/0x892c60dda91c768e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c7687 expref: 18 pid: 6500 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.686879:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528293.686951:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+17:3639:x1875407735379840:12345-0@lo:103: Request processed in 142us (6479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528293.686959:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788528293.686979:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788528293.686986:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+16:3639:x1875407735379968:12345-0@lo:103: 00010000:00010000:3.0:1788528293.686993:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528293.686998:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c14abc00/0x892c60dda91c7672 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c766b expref: 16 pid: 6500 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.687008:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c14abc00/0x892c60dda91c7672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c766b expref: 16 pid: 6500 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.687018:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c14abc00/0x892c60dda91c7672 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c766b expref: 16 pid: 6500 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.687037:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a90f6e16000/0x892c60dda91c777c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.687047:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90f6e16000/0x892c60dda91c777c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788528293.687062:0:6494:0:(mgs_nids.c:693:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008887761s 00010000:00010000:3.0:1788528293.687068:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a90f6e16000/0x892c60dda91c777c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.687074:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a90f6e16000/0x892c60dda91c777c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.687081:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a90f6e16000/0x892c60dda91c777c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.687088:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a90f6e16000/0x892c60dda91c777c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.687094:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16000 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528293.687099:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a90f6e16000/0x892c60dda91c777c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.687108:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a90f6e16000/0x892c60dda91c777c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.687125:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a90f6e16000/0x892c60dda91c777c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528293.687135:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528293.687176:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+15:3639:x1875407735379968:12345-0@lo:103: Request processed in 191us (6526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528293.687183:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788528293.687240:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735379968:0@lo:103: 00000100:00100000:3.0:1788528293.687250:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735379840:0@lo:103: 00010000:00010000:1.0:1788528293.687442:0:6524:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a90f6e16000/0x892c60dda91c777c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528293.687452:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a90f6e16000/0x892c60dda91c777c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528293.687459:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90f6e16000/0x892c60dda91c777c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1788528293.688482:0:8414:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788528293.697024:0:8414:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788528293.697034:0:8414:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788528293.697072:0:8414:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788528293.697091:0:8414:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788528293.700151:0:8414:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788528293.700358:0:8414:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788528294.014717:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528294.080347:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788528294.080373:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735380096:0@lo:41: 00000100:00100000:2.0:1788528294.080443:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528294.080507:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735380096 00000100:00100000:2.0:1788528294.080516:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735380096 00000100:00100000:2.0:1788528294.080583:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788528294.080594:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735380096:12345-0@lo:41: 00000004:00000024:2.0:1788528294.080633:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446547456 avail 1300307968 00000100:00100000:2.0:1788528294.080679:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735380096:12345-0@lo:41: Request processed in 87us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528294.080686:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788528294.080731:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735380096:0@lo:41: 00000020:00000004:1.0:1788528294.448012:0:8503:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788528294.448410:0:8503:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788528295.039043:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528296.064046:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528297.090600:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528297.150770:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735380224:0@lo:41: 00000100:00100000:2.0:1788528297.150890:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528297.151029:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735380224 00000100:00100000:1.0:1788528297.151038:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735380224 00000100:00100000:1.0:1788528297.151097:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788528297.151106:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735380224:12345-0@lo:41: 00000004:00000024:1.0:1788528297.151147:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1788528297.151198:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735380224:12345-0@lo:41: Request processed in 92us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528297.151204:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788528297.151256:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735380224:0@lo:41: 10000000:01000000:1.0:1788528297.663082:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788528297.663090:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff8a90f5add000 from 30 10000000:01000000:1.0:1788528297.663123:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788528297.663170:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7783 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528297.663182:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7783 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528297.663194:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7783 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528297.663217:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735380352:0@lo:101: 00000100:00100000:1.0:1788528297.663283:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528297.663345:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d146e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528297.666478:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735380352 00000100:00100000:3.0:1788528297.666492:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735380352 00000100:00100000:3.0:1788528297.666549:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788528297.666575:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+15:6506:x1875407735380352:12345-0@lo:101: 00010000:00010000:3.0:1788528297.666591:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528297.666609:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c1551a00/0x892c60dda91c778a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7783 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528297.666635:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c1551a00/0x892c60dda91c778a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7783 expref: 16 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528297.666646:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c1551a00/0x892c60dda91c778a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7783 expref: 16 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528297.666655:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c1551a00, rc 0) 00000100:00100000:3.0:1788528297.666724:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+16:6506:x1875407735380352:12345-0@lo:101: Request processed in 152us (3441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528297.666738:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788528297.667122:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735380352:0@lo:101: 00010000:00010000:1.0:1788528297.667141:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7783 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c778a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528297.667152:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7783 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c778a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788528297.667306:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1788528297.669789:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788528297.669983:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788528297.670010:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788528297.670024:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788528297.670037:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788528297.670052:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788528297.670066:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788528297.670237:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788528297.670259:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788528297.670276:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788528297.670302:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788528297.670320:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788528297.670335:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788528297.670347:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788528297.670358:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788528297.670372:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788528297.670386:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788528297.670401:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788528297.670418:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788528297.670432:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788528297.670451:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788528297.670467:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788528297.670481:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788528297.670497:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788528297.670511:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788528297.670523:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1788528297.670536:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1788528297.670549:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1788528297.670589:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1788528297.670615:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1788528297.670622:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788528297.670719:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735380480:0@lo:501: 00000100:00100000:1.0:1788528297.670786:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528297.670824:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d146e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528297.670844:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735380480 00000100:00100000:1.0:1788528297.670851:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735380480 00000100:00100000:1.0:1788528297.670895:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788528297.670904:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+16:6506:x1875407735380480:12345-0@lo:501: 00000100:00100000:1.0:1788528297.671023:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+16:6506:x1875407735380480:12345-0@lo:501: Request processed in 120us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528297.671031:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788528297.671312:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735380480:0@lo:501: 00000100:00100000:1.0:1788528297.671348:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735380608:0@lo:503: 00000100:00100000:1.0:1788528297.671386:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528297.671447:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d146e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528297.671490:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735380608 00000100:00100000:0.0:1788528297.671495:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735380608 00000100:00100000:0.0:1788528297.671577:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788528297.671584:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+16:6506:x1875407735380608:12345-0@lo:503: 00000100:00100000:0.0:1788528297.671676:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+16:6506:x1875407735380608:12345-0@lo:503: Request processed in 91us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528297.671683:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788528297.671785:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735380608:0@lo:503: 00000040:00080000:0.0:1788528297.672264:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788528297.672326:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735380736:0@lo:502: 00000100:00100000:0.0:1788528297.672370:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528297.672472:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ecd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528297.673354:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735380736 00000100:00100000:2.0:1788528297.673364:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735380736 00000100:00100000:1.0:1788528297.673507:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788528297.673519:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+16:6506:x1875407735380736:12345-0@lo:502: 00000100:00100000:1.0:1788528297.673798:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+16:6506:x1875407735380736:12345-0@lo:502: Request processed in 282us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528297.673807:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788528297.674010:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735380736:0@lo:502: 00000040:00080000:0.0:1788528297.674443:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788528297.674479:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788528297.674495:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788528297.674510:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788528297.674523:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788528297.674535:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788528297.674545:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788528297.674985:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788528297.675006:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788528297.675021:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788528297.675035:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788528297.675048:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788528297.677222:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788528297.677411:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788528297.677431:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788528297.677448:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788528297.677461:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788528297.677472:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788528297.677486:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788528297.677497:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788528297.677508:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788528297.677520:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788528297.677533:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788528297.677567:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788528297.677588:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1788528297.677604:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1788528297.677617:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1788528297.677629:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1788528297.677741:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1788528297.677759:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1788528297.677772:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1788528297.677784:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1788528297.677798:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1788528297.677812:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1788528297.677826:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1788528297.677840:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1788528297.677856:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000100:00100000:1.0:1788528297.677906:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735380864:0@lo:502: 00000100:00100000:1.0:1788528297.678423:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528297.678474:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d146ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1788528297.678696:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735380864 00000100:00100000:3.0:1788528297.678704:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735380864 00000100:00100000:3.0:1788528297.678763:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788528297.678773:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+16:6506:x1875407735380864:12345-0@lo:502: 00000100:00100000:3.0:1788528297.679020:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+16:6506:x1875407735380864:12345-0@lo:502: Request processed in 248us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528297.679028:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788528297.679328:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735380864:0@lo:502: 00000040:00080000:0.0:1788528297.679398:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1788528297.679410:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000040:00080000:3.0:1788528297.680302:0:8701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 39 count 39 00000020:01000000:1.0:1788528297.680385:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788528297.680395:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788528297.680405:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7783 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c778a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528297.680415:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7783 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c778a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528297.680425:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788528297.680427:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff8a90f5add000 from 5 10000000:01000000:1.0:1788528297.680430:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788528297.680461:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16400/0x892c60dda91c7791 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528297.680469:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16400/0x892c60dda91c7791 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528297.680478:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16400/0x892c60dda91c7791 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528297.680508:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735380992:0@lo:101: 00000100:00100000:1.0:1788528297.680744:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528297.680791:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cd900 going to sleep for 11 seconds 00000100:00100000:2.0:1788528297.680804:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735380992 00000100:00100000:2.0:1788528297.680811:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735380992 00000100:00100000:2.0:1788528297.680863:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788528297.680871:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+16:6506:x1875407735380992:12345-0@lo:101: 00010000:00010000:2.0:1788528297.680884:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528297.680898:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9101851e00/0x892c60dda91c7798 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7791 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528297.680934:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101851e00/0x892c60dda91c7798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7791 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528297.680945:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9101851e00/0x892c60dda91c7798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7791 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528297.680958:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101851e00, rc 0) 00000100:00100000:2.0:1788528297.680993:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+17:6506:x1875407735380992:12345-0@lo:101: Request processed in 123us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528297.680999:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788528297.681131:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735380992:0@lo:101: 00010000:00010000:1.0:1788528297.681144:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16400/0x892c60dda91c7791 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7798 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528297.681152:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16400/0x892c60dda91c7791 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7798 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528297.681200:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735381120:0@lo:256: 00000100:00100000:1.0:1788528297.681230:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528297.681252:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cd900 going to sleep for 11 seconds 00000100:00100000:2.0:1788528297.681309:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735381120 00000100:00100000:2.0:1788528297.681315:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735381120 00000100:00100000:2.0:1788528297.681344:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788528297.681353:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+17:6506:x1875407735381120:12345-0@lo:256: 20000000:01000000:2.0:1788528297.681367:0:6502:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788528297.681383:0:6502:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788528297.681386:0:6502:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788528297.681487:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735381120:0@lo:256: 10000000:01000000:1.0:1788528297.681526:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788528297.681532:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16400/0x892c60dda91c7791 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7798 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528297.681539:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+17:6506:x1875407735381120:12345-0@lo:256: Request processed in 124us (243us total) trans 0 rc 0/0 00010000:00010000:1.0:1788528297.681543:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16400/0x892c60dda91c7791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7798 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528297.681570:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 10000000:01000000:1.0:1788528297.681583:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788528297.681586:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1788528297.681589:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788528297.681606:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c779f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528297.681622:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c779f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528297.681629:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c779f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528297.681640:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735381248:0@lo:101: 00000100:00100000:1.0:1788528297.681668:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528297.681695:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cd900 going to sleep for 11 seconds 00000100:00100000:2.0:1788528297.681715:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735381248 00000100:00100000:2.0:1788528297.681720:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735381248 00000100:00100000:2.0:1788528297.681748:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788528297.681755:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+17:6506:x1875407735381248:12345-0@lo:101: 00010000:00010000:2.0:1788528297.681763:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528297.681771:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9101851a00/0x892c60dda91c77a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c779f expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528297.681797:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101851a00/0x892c60dda91c77a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c779f expref: 18 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528297.681804:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9101851a00/0x892c60dda91c77a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c779f expref: 18 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528297.681810:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101851a00, rc 0) 00000100:00100000:2.0:1788528297.681908:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735381248:12345-0@lo:101: Request processed in 153us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528297.681914:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788528297.682203:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735381248:0@lo:101: 00010000:00010000:1.0:1788528297.682215:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c779f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c77a6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528297.682222:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c779f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c77a6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788528297.682373:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1788528297.682641:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788528297.682844:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788528297.683661:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 136 off8552 00000040:00080000:1.0:1788528297.683682:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 176 off8728 00000040:00080000:1.0:1788528297.683695:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8952 00000040:00080000:1.0:1788528297.683710:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9176 00000040:00080000:1.0:1788528297.683739:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9296 00000040:00080000:1.0:1788528297.683754:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 112 off9408 00000040:00080000:1.0:1788528297.683767:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 160 off9568 00000040:00080000:1.0:1788528297.683780:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9792 00000040:00080000:1.0:1788528297.683792:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off10016 00000040:00080000:1.0:1788528297.683806:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 88 off10104 00000040:00080000:1.0:1788528297.683830:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 144 off10248 00000040:00080000:1.0:1788528297.683845:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 152 off10400 00000040:00080000:1.0:1788528297.683917:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 168 off10568 00000040:00080000:1.0:1788528297.683940:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 224 off10792 00000040:00080000:1.0:1788528297.684031:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 224 off11016 00000040:00080000:1.0:1788528297.684111:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 80 off11096 00000040:00080000:1.0:1788528297.684139:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11320 00000040:00080000:1.0:1788528297.684155:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 224 off11544 00000040:00080000:1.0:1788528297.684169:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 160 off11704 00000040:00080000:1.0:1788528297.684184:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11928 00000040:00080000:1.0:1788528297.684215:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 224 off12152 00000040:00080000:1.0:1788528297.684232:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 80 off12232 00000040:00080000:1.0:1788528297.684256:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 224 off12456 00000040:00080000:1.0:1788528297.684261:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1788528297.684344:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735381376:0@lo:501: 00000100:00100000:1.0:1788528297.684398:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528297.684438:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cd900 going to sleep for 11 seconds 00000100:00100000:2.0:1788528297.685312:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735381376 00000100:00100000:2.0:1788528297.685321:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735381376 00000100:00100000:2.0:1788528297.685374:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788528297.685384:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735381376:12345-0@lo:501: 00000100:00100000:2.0:1788528297.685583:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735381376:12345-0@lo:501: Request processed in 201us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528297.685592:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788528297.686072:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735381376:0@lo:501: 00000100:00100000:0.0:1788528297.686132:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735381504:0@lo:503: 00000100:00100000:0.0:1788528297.686187:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528297.686220:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ecd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528297.686338:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735381504 00000100:00100000:1.0:1788528297.686343:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735381504 00000100:00100000:1.0:1788528297.686381:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788528297.686388:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735381504:12345-0@lo:503: 00000100:00100000:1.0:1788528297.686483:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735381504:12345-0@lo:503: Request processed in 95us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528297.686489:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788528297.686832:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735381504:0@lo:503: 00000040:00080000:0.0:1788528297.687324:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788528297.687407:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735381632:0@lo:502: 00000100:00100000:0.0:1788528297.687454:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528297.687480:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ecd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528297.687699:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735381632 00000100:00100000:1.0:1788528297.687706:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735381632 00000100:00100000:1.0:1788528297.687744:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788528297.687752:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735381632:12345-0@lo:502: 00000100:00100000:1.0:1788528297.688068:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735381632:12345-0@lo:502: Request processed in 316us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528297.688082:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788528297.688350:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735381632:0@lo:502: 00000040:00080000:0.0:1788528297.688527:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788528297.688587:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 136 off8552 00000040:00080000:0.0:1788528297.688606:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 176 off8728 00000040:00080000:1.0:1788528297.688811:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8952 00000040:00080000:1.0:1788528297.688910:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9176 00000040:00080000:1.0:1788528297.688930:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9296 00000040:00080000:1.0:1788528297.688943:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 112 off9408 00000040:00080000:1.0:1788528297.688957:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 160 off9568 00000040:00080000:1.0:1788528297.688964:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9792 00000040:00080000:1.0:1788528297.688971:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off10016 00000040:00080000:1.0:1788528297.688978:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 88 off10104 00000040:00080000:1.0:1788528297.688985:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 144 off10248 00000040:00080000:1.0:1788528297.688992:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 152 off10400 00000040:00080000:1.0:1788528297.688999:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 168 off10568 00000040:00080000:1.0:1788528297.689006:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 224 off10792 00000040:00080000:1.0:1788528297.689013:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 224 off11016 00000040:00080000:1.0:1788528297.689020:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 80 off11096 00000040:00080000:1.0:1788528297.689026:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11320 00000040:00080000:1.0:1788528297.689033:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 224 off11544 00000040:00080000:1.0:1788528297.689039:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 160 off11704 00000040:00080000:1.0:1788528297.689046:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11928 00000040:00080000:1.0:1788528297.689052:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 224 off12152 00000040:00080000:1.0:1788528297.689072:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 80 off12232 00000040:00080000:1.0:1788528297.689173:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 224 off12456 00000040:00080000:1.0:1788528297.689192:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 224 off12680 00000040:00080000:1.0:1788528297.689205:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 88 off12768 00000040:00080000:1.0:1788528297.689220:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 144 off12912 00000040:00080000:1.0:1788528297.689368:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 152 off13064 00000040:00080000:1.0:1788528297.689388:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 136 off13200 00000040:00080000:1.0:1788528297.689396:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13424 00000040:00080000:1.0:1788528297.689403:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 224 off13648 00000040:00080000:1.0:1788528297.689410:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 80 off13728 00000100:00100000:1.0:1788528297.689438:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735381760:0@lo:502: 00000100:00100000:1.0:1788528297.689492:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528297.689525:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cde40 going to sleep for 11 seconds 00000100:00100000:3.0:1788528297.689638:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735381760 00000100:00100000:3.0:1788528297.689646:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735381760 00000100:00100000:3.0:1788528297.689688:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788528297.689697:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735381760:12345-0@lo:502: 00000100:00100000:3.0:1788528297.689806:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735381760:12345-0@lo:502: Request processed in 109us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528297.689814:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788528297.689873:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735381760:0@lo:502: 00000040:00080000:3.0:1788528297.689926:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 224 off13952 00000040:00080000:3.0:1788528297.689935:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 33 count 34 00000020:01000000:3.0:1788528297.693738:0:8705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788528297.693749:0:8705:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788528297.693756:0:8705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528297.693759:0:8705:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788528297.693764:0:8705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788528297.693770:0:8705:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:3.0:1788528297.693796:0:8705:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788528297.693799:0:8705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788528297.693822:0:8705:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8a90fa60cc80) 00000020:00000080:3.0:1788528297.693844:0:8705:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1788528297.693851:0:8705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788528297.693944:0:8705:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788528297.693964:0:8705:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788528297.693972:0:8705:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x892c60dda91c77b4 00010000:00080000:3.0:1788528297.694003:0:8705:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a8fc1d0a000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.138@tcp at head 00010000:00010000:0.0:1788528297.697208:0:8705:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788528297.708068:0:8705:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788528297.708092:0:8705:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788528297.708327:0:8705:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788528297.708591:0:8705:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788528297.708691:0:8705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788528297.708790:0:8705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788528297.710100:0:8707:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788528297.710107:0:8707:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788528297.710971:0:8705:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788528297.710985:0:8705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788528297.711034:0:8705:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788528297.711060:0:8705:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x892c60dda91c77bb 00000100:00080000:0.0:1788528297.711071:0:8705:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788528297.711077:0:8705:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a8fc1d0a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1788528297.711442:0:8705:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90f5a0fb80 x1875407735381888/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788528297.711511:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735381888:0@lo:8: 00000100:00080000:0.0:1788528297.711537:0:8705:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1788528297.711603:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1788528297.711698:0:8705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528297.711704:0:8705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528297.711706:0:8705:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788528297.711709:0:8705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788528297.711714:0:8705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528297.711716:0:8705:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788528297.711720:0:8705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788528297.711722:0:8705:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788528297.711744:0:8705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528297.711747:0:8705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528297.711748:0:8705:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788528297.711751:0:8705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 34 count 34 00000100:00100000:2.0:1788528297.711789:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735381888 00000020:01000000:3.0:1788528297.711927:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1788528297.711942:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788528297.711952:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c779f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c77a6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528297.712031:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c779f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c77a6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528297.712042:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788528297.712044:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff8a90f5add000 from 1 10000000:01000000:3.0:1788528297.712047:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788528297.712074:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c1551600/0x892c60dda91c77c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528297.712082:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c1551600/0x892c60dda91c77c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528297.712094:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c1551600/0x892c60dda91c77c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528297.712109:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735382016:0@lo:101: 00000100:00100000:3.0:1788528297.712298:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528297.712373:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c67ef240 going to sleep for 11 seconds 00000100:00100000:3.0:1788528297.712400:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735382144:0@lo:400: 00000100:00100000:3.0:1788528297.712434:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528297.712451:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735382528:0@lo:400: 00000100:00100000:3.0:1788528297.712463:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735382656:0@lo:400: 00000100:00100000:3.0:1788528297.712490:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528297.712506:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788528297.712512:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735382272:0@lo:400: 00000100:00100000:3.0:1788528297.712532:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528297.712535:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735381888 00000100:00100000:1.0:1788528297.712581:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528297.712593:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788528297.712601:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1875407735381888:12345-0@lo:8: 00000100:00100000:1.0:1788528297.712604:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788528297.712605:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735382144 00000100:00100000:3.0:1788528297.712611:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735382144 00000100:00100000:1.0:1788528297.712611:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735382400:0@lo:400: 00010000:00080000:2.0:1788528297.712624:0:8421:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 166 last 0 00000100:00100000:1.0:1788528297.712643:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1788528297.712651:0:8421:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x892c60dda91c77c9 00000100:00100000:3.0:1788528297.712658:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735382656 00000100:00100000:3.0:1788528297.712663:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735382656 00000100:00100000:3.0:1788528297.712690:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735382272 00000100:00100000:3.0:1788528297.712693:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735382272 00000100:00100000:3.0:1788528297.712703:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735382528 00000100:00100000:3.0:1788528297.712705:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735382528 00000100:00100000:3.0:1788528297.712719:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788528297.712725:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735382144:12345-0@lo:400: 00000100:00100000:1.0:1788528297.712753:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00002000:00100000:2.0:1788528297.712757:0:8421:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8a8fc2406800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788528297.712762:0:8421:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000100:00100000:1.0:1788528297.712764:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735382656:12345-0@lo:400: 00000001:00000004:2.0:1788528297.712765:0:8421:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1788528297.712780:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735382144:12345-0@lo:400: Request processed in 54us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528297.712788:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788528297.712806:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735382656:12345-0@lo:400: Request processed in 45us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528297.712811:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788528297.712819:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788528297.712824:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735382272:12345-0@lo:400: 00002000:00100000:2.0:1788528297.712829:0:8421:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788528297.712838:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788528297.712846:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735382528:12345-0@lo:400: 00000100:00100000:3.0:1788528297.712864:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735382272:12345-0@lo:400: Request processed in 44us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528297.712870:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788528297.712889:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735382528:12345-0@lo:400: Request processed in 43us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528297.712896:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788528297.712919:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f58c2a00 x1875407735382272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528297.712922:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735382400 00000100:00100000:1.0:1788528297.712926:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735382400 00000100:00100000:3.0:1788528297.712942:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735382272:0@lo:400: 00000100:00100000:1.0:1788528297.712957:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788528297.712963:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735382400:12345-0@lo:400: 00010000:00080000:3.0:1788528297.712973:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f58c2680 x1875407735382656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528297.712983:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735382656:0@lo:400: 00010000:00080000:3.0:1788528297.712997:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f58c0700 x1875407735382144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528297.713001:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735382400:12345-0@lo:400: Request processed in 36us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528297.713018:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735382144:0@lo:400: 00000100:00100000:1.0:1788528297.713018:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788528297.713051:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735382400:0@lo:400: 00010000:00080000:1.0:1788528297.713062:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f58c0a80 x1875407735382528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528297.713078:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735382528:0@lo:400: 00002000:00080000:2.0:1788528297.713342:0:8421:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788528297.713364:0:8421:0:(import.c:65:import_set_state_nolock()) ffff8a8fc2404800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788528297.713416:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1875407735381888:12345-0@lo:8: Request processed in 815us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528297.713423:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788528297.713452:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f5a0fb80 x1875407735381888/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788528307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788528297.713458:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788528297.713464:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788528297.713465:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788528297.713473:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788528297.713481:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788528297.713486:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788528297.713488:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d0a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788528297.713510:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788528297.713515:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735381888:0@lo:8: 00000100:00100000:1.0:1788528297.713604:0:8708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8708:1875407735382784:0@lo:700: 00000100:00100000:0.0:1788528297.713631:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735382016 00000100:00100000:1.0:1788528297.713637:0:8708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528297.713639:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735382016 00000100:00100000:1.0:1788528297.713667:0:8708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788528297.713690:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735382784 00000100:00100000:3.0:1788528297.713695:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735382784 00000100:00100000:0.0:1788528297.713758:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788528297.713766:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735382016:12345-0@lo:101: 00010000:00010000:0.0:1788528297.713775:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528297.713789:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c0031600/0x892c60dda91c77d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c77c2 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528297.713813:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c0031600/0x892c60dda91c77d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c77c2 expref: 19 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528297.713823:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c0031600/0x892c60dda91c77d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c77c2 expref: 19 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528297.713832:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031600, rc 0) 00000100:00100000:0.0:1788528297.713865:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735382016:12345-0@lo:101: Request processed in 101us (1567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528297.713882:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788528297.713925:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735382016:0@lo:101: 00010000:00010000:0.0:1788528297.713939:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c1551600/0x892c60dda91c77c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c77d0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528297.713948:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c1551600/0x892c60dda91c77c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c77d0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528297.714130:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735382912:0@lo:501: 00000100:00100000:0.0:1788528297.714156:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528297.714177:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735382912 00000100:00100000:0.0:1788528297.714181:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735382912 00000100:00100000:0.0:1788528297.714205:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788528297.714211:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735382912:12345-0@lo:501: 00000100:00100000:0.0:1788528297.714267:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735382912:12345-0@lo:501: Request processed in 56us (109us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788528297.714274:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788528297.714303:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d9cf80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528297.714314:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735382912:0@lo:501: 10000000:01000000:0.0:1788528297.714325:0:6506:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.203.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:0.0:1788528297.714352:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735383040:0@lo:501: 00000100:00100000:0.0:1788528297.714374:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528297.714392:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735383040 00000100:00100000:0.0:1788528297.714395:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735383040 00000100:00100000:0.0:1788528297.714419:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788528297.714506:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735383040:12345-0@lo:501: 00000100:00100000:0.0:1788528297.714613:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735383040:12345-0@lo:501: Request processed in 108us (235us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788528297.714620:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788528297.714713:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c7215840 going to sleep for 11 seconds 00000100:00100000:0.0:1788528297.714793:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735383040:0@lo:501: 10000000:01000000:0.0:1788528297.714819:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788528297.714826:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c1551600/0x892c60dda91c77c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c77d0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528297.714835:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c1551600/0x892c60dda91c77c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c77d0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528297.714844:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788528297.714847:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff8a90c7f88000 from 30 10000000:01000000:0.0:1788528297.714849:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788528297.714868:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c77d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528297.714874:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c77d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528297.714883:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c77d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528297.714894:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735383168:0@lo:101: 00000100:00100000:0.0:1788528297.714919:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528297.714947:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c7215840 going to sleep for 11 seconds 00000004:00080000:0.0:1788528297.715023:0:8707:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788528297.715082:0:8707:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 166932527253ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788528297.715096:0:8707:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788528297.715166:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735383168 00000100:00100000:1.0:1788528297.715171:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735383168 00000100:00100000:1.0:1788528297.715198:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788528297.715205:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735383168:12345-0@lo:101: 00010000:00010000:1.0:1788528297.715212:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528297.715221:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90f6e17c00/0x892c60dda91c77de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c77d7 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528297.715239:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90f6e17c00/0x892c60dda91c77de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c77d7 expref: 20 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528297.715247:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90f6e17c00/0x892c60dda91c77de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c77d7 expref: 20 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528297.715254:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e17c00, rc 0) 00000100:00100000:1.0:1788528297.715284:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+20:6506:x1875407735383168:12345-0@lo:101: Request processed in 80us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528297.715290:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788528297.715611:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735383168:0@lo:101: 00010000:00010000:0.0:1788528297.715623:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c77d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c77de expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528297.715631:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c77d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c77de expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528297.716338:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735383296:0@lo:501: 00000100:00100000:0.0:1788528297.716379:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528297.716449:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c7215840 going to sleep for 11 seconds 00000100:00100000:1.0:1788528297.716523:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735383296 00000100:00100000:1.0:1788528297.716529:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735383296 00000100:00080000:2.0:1788528297.716661:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788528297.716932:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788528297.716943:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8708:x1875407735382784:12345-0@lo:700: 00000100:00100000:3.0:1788528297.716995:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8429:1875407735383424:0@lo:700: 00000100:00100000:3.0:1788528297.717031:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528297.717052:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c67ef9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528297.717308:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788528297.717319:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c8116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+20:6506:x1875407735383296:12345-0@lo:501: 00000100:00100000:0.0:1788528297.717445:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c8116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+20:6506:x1875407735383296:12345-0@lo:501: Request processed in 128us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528297.717452:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788528297.717486:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735383424 00000100:00100000:0.0:1788528297.717490:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735383424 00000100:00100000:0.0:1788528297.717515:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788528297.717520:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8429:x1875407735383424:12345-0@lo:700: 00000100:00100000:1.0:1788528297.717707:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735383296:0@lo:501: 00000100:00100000:1.0:1788528297.717866:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735383552:0@lo:503: 00000100:00100000:1.0:1788528297.717923:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528297.717951:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788528297.718049:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735383552 00000100:00100000:0.0:1788528297.718053:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735383552 00000100:00100000:0.0:1788528297.718089:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788528297.718096:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c8116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+20:6506:x1875407735383552:12345-0@lo:503: 00000100:00100000:0.0:1788528297.718196:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c8116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+20:6506:x1875407735383552:12345-0@lo:503: Request processed in 100us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528297.718204:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788528297.718254:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735383552:0@lo:503: 00000004:00080000:1.0:1788528297.723417:0:7440:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1788528297.723924:0:8711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:8711:1875407735383680:0@lo:502: 00000100:00100000:3.0:1788528297.724358:0:8711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528297.724406:0:8711:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c67ef240 going to sleep for 11 seconds 00000100:00100000:0.0:1788528297.724664:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735383680 00000100:00100000:0.0:1788528297.724672:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735383680 00000100:00100000:0.0:1788528297.724717:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788528297.724735:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c8116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+20:8711:x1875407735383680:12345-0@lo:502: 00000100:00100000:0.0:1788528297.724874:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c8116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+20:8711:x1875407735383680:12345-0@lo:502: Request processed in 149us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528297.724882:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788528297.728513:0:8711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:8711:1875407735383680:0@lo:502: 00000100:00100000:3.0:1788528297.728613:0:8711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:8711:1875407735383808:0@lo:502: 00000100:00100000:3.0:1788528297.728683:0:8711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528297.728721:0:8711:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de34b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528297.730880:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735383808 00000100:00100000:1.0:1788528297.730893:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735383808 00000100:00100000:1.0:1788528297.731047:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788528297.731058:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+20:8711:x1875407735383808:12345-0@lo:502: 00000100:00100000:1.0:1788528297.731230:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+20:8711:x1875407735383808:12345-0@lo:502: Request processed in 173us (2546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528297.731248:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788528297.731337:0:8711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:8711:1875407735383808:0@lo:502: 00000040:00080000:3.0:1788528297.731370:0:8711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 40000000:02000000:0.0:1788528297.731595:0:6515:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000020:01000000:3.0:1788528297.731819:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788528297.731830:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788528297.731839:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c77d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c77de expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528297.731850:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c77d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c77de expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528297.731859:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788528297.731861:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff8a90c7f88000 from 5 10000000:01000000:3.0:1788528297.731864:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788528297.731893:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c1551800/0x892c60dda91c77e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528297.731901:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c1551800/0x892c60dda91c77e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528297.731910:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c1551800/0x892c60dda91c77e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528297.731937:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735383936:0@lo:101: 00000100:00100000:3.0:1788528297.732052:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528297.732090:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de34b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528297.733357:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735383936 00000100:00100000:1.0:1788528297.733368:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735383936 00000100:00100000:1.0:1788528297.733412:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788528297.733420:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+20:6506:x1875407735383936:12345-0@lo:101: 00010000:00010000:1.0:1788528297.733435:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528297.733451:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90f6e17400/0x892c60dda91c77ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c77e5 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528297.733475:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90f6e17400/0x892c60dda91c77ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c77e5 expref: 21 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528297.733486:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90f6e17400/0x892c60dda91c77ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c77e5 expref: 21 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528297.733494:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e17400, rc 0) 00000100:00100000:1.0:1788528297.733572:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+21:6506:x1875407735383936:12345-0@lo:101: Request processed in 133us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528297.733579:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788528297.734082:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735383936:0@lo:101: 00010000:00010000:3.0:1788528297.734101:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c1551800/0x892c60dda91c77e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c77ec expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528297.734111:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c1551800/0x892c60dda91c77e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c77ec expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528297.734179:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735384064:0@lo:256: 00000100:00100000:3.0:1788528297.734222:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528297.734315:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de34b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528297.738314:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735384064 00000100:00100000:1.0:1788528297.738330:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735384064 00000100:00100000:1.0:1788528297.738375:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788528297.738384:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+21:6506:x1875407735384064:12345-0@lo:256: 20000000:01000000:1.0:1788528297.738406:0:6500:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788528297.738421:0:6500:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788528297.738425:0:6500:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788528297.739482:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8429:x1875407735383424:12345-0@lo:700: Request processed in 21956us (22445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528297.739493:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788528297.739541:0:8429:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f6ea2d80 x1875407735383424/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788528313 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528297.739580:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8429:1875407735383424:0@lo:700: 40000000:02000000:0.0:1788528297.739591:0:8429:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:1.0:1788528297.740331:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+21:6506:x1875407735384064:12345-0@lo:256: Request processed in 1944us (6105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528297.740341:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788528297.744329:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735384064:0@lo:256: 10000000:01000000:3.0:1788528297.744401:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788528297.744412:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c1551800/0x892c60dda91c77e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c77ec expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528297.744423:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c1551800/0x892c60dda91c77e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c77ec expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528297.744433:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788528297.744436:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788528297.744439:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788528297.744475:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c1551400/0x892c60dda91c77f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528297.744495:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c1551400/0x892c60dda91c77f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528297.744505:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c1551400/0x892c60dda91c77f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528297.744523:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735384192:0@lo:101: 00000100:00100000:3.0:1788528297.744602:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528297.744637:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de34b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528297.745921:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735384192 00000100:00100000:3.0:1788528297.745934:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735384192 00000100:00100000:3.0:1788528297.746065:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788528297.746075:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+21:6506:x1875407735384192:12345-0@lo:101: 00010000:00010000:3.0:1788528297.746090:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528297.746106:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c1550200/0x892c60dda91c77fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c77f3 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528297.746143:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c1550200/0x892c60dda91c77fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c77f3 expref: 22 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528297.746154:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c1550200/0x892c60dda91c77fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c77f3 expref: 22 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528297.746161:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c1550200, rc 0) 00000100:00100000:3.0:1788528297.746222:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+22:6506:x1875407735384192:12345-0@lo:101: Request processed in 149us (1620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528297.746229:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788528297.746927:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735384192:0@lo:101: 00010000:00010000:3.0:1788528297.747069:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c1551400/0x892c60dda91c77f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c77fa expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528297.747081:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c1551400/0x892c60dda91c77f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c77fa expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528297.747140:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735384320:0@lo:501: 00000100:00100000:3.0:1788528297.747183:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528297.747267:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de34b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528297.754304:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735384320 00000100:00100000:1.0:1788528297.754319:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735384320 00000100:00100000:2.0:1788528297.754404:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788528297.754419:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+22:6506:x1875407735384320:12345-0@lo:501: 00000100:00100000:2.0:1788528297.754612:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+22:6506:x1875407735384320:12345-0@lo:501: Request processed in 193us (7428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528297.754620:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788528297.756444:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735384320:0@lo:501: 00000100:00100000:3.0:1788528297.756500:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735384448:0@lo:503: 00000100:00100000:3.0:1788528297.756587:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528297.756628:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de34b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528297.756949:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735384448 00000100:00100000:3.0:1788528297.757023:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735384448 00000100:00100000:3.0:1788528297.757322:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788528297.757334:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+22:6506:x1875407735384448:12345-0@lo:503: 00000100:00100000:3.0:1788528297.757459:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+22:6506:x1875407735384448:12345-0@lo:503: Request processed in 128us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528297.757467:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788528297.758341:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735384448:0@lo:503: 00000001:00100000:1.0:1788528297.760109:0:8416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788528297.765339:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8708:x1875407735382784:12345-0@lo:700: Request processed in 48389us (51692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528297.765357:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788528297.765423:0:8708:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f58c0a80 x1875407735382784/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788528313 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528297.765438:0:8708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8708:1875407735382784:0@lo:700: 00000100:00100000:0.0:1788528297.767075:0:8719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:8719:1875407735384576:0@lo:502: 00000100:00100000:0.0:1788528297.767160:0:8719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528297.767202:0:8719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90cea863c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528297.767438:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735384576 00000100:00100000:2.0:1788528297.767445:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735384576 00000100:00100000:2.0:1788528297.767509:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788528297.767520:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+22:8719:x1875407735384576:12345-0@lo:502: 00000100:00100000:2.0:1788528297.767671:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+22:8719:x1875407735384576:12345-0@lo:502: Request processed in 153us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528297.767679:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788528297.768045:0:8719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:8719:1875407735384576:0@lo:502: 00000020:01000000:0.0:1788528297.768078:0:8719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788528297.768085:0:8719:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788528297.768092:0:8719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528297.768094:0:8719:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788528297.768099:0:8719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788528297.768102:0:8719:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:0.0:1788528297.768143:0:8719:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788528297.768146:0:8719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788528297.768163:0:8719:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8a910195cc80) 00000020:00000080:0.0:1788528297.768185:0:8719:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1788528297.768191:0:8719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788528297.768283:0:8719:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788528297.768289:0:8719:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788528297.768296:0:8719:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x892c60dda91c7808 00010000:00080000:0.0:1788528297.768323:0:8719:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a8fc1f91000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:0.0:1788528297.768603:0:8719:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000004:00080000:0.0:1788528297.778675:0:8708:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788528297.778707:0:8708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8708:1875407735384832:0@lo:7: 00000100:00100000:0.0:1788528297.778856:0:8708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528297.778894:0:8708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c2afd180 going to sleep for 11 seconds 00000100:00100000:2.0:1788528297.779467:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735384704:0@lo:13: 00000100:00100000:2.0:1788528297.779504:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528297.780797:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735384704 00000100:00100000:0.0:1788528297.780809:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735384704 00000100:00100000:0.0:1788528297.780861:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788528297.780870:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735384704:12345-0@lo:13: 00002000:00000024:0.0:1788528297.780910:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1788528297.781269:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735384704:12345-0@lo:13: Request processed in 400us (1763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528297.781277:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788528297.783010:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f5a0dc00 x1875407735384704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528297.783034:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735384704:0@lo:13: 00000100:00100000:0.0:1788528297.787392:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735384832 00000100:00100000:0.0:1788528297.787406:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735384832 00000100:00100000:0.0:1788528297.787459:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788528297.787469:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8708:x1875407735384832:12345-0@lo:7: 00000040:01000000:1.0:1788528297.794213:0:8719:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788528297.794246:0:8719:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788528297.794416:0:8719:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788528297.794604:0:8719:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788528297.794713:0:8719:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00002000:00080000:0.0:1788528297.794792:0:8423:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788528297.794798:0:8423:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788528297.794893:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8708:x1875407735384832:12345-0@lo:7: Request processed in 7423us (16036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528297.794903:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788528297.795355:0:8708:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f5a0e300 x1875407735384832/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788528313 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528297.795378:0:8708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8708:1875407735384832:0@lo:7: 00000004:00080000:2.0:1788528297.795393:0:8708:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788528297.795429:0:8708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e21f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8708:1875407735384960:0@lo:5: 00000100:00100000:2.0:1788528297.795466:0:8708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528297.795510:0:8708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1c8f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788528297.795551:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735384960 00000100:00100000:0.0:1788528297.795586:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735384960 00000040:00080000:1.0:1788528297.795615:0:8719:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000100:00100000:0.0:1788528297.795625:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788528297.795633:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8708:x1875407735384960:12345-0@lo:5: 00002000:00080000:0.0:1788528297.795656:0:8421:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1788528297.795767:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8708:x1875407735384960:12345-0@lo:5: Request processed in 134us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528297.795774:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788528297.795854:0:8708:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f8e21f80 x1875407735384960/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788528313 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528297.795865:0:8708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e21f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8708:1875407735384960:0@lo:5: 00000004:00080000:2.0:1788528297.795873:0:8708:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788528297.795897:0:8708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e21f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8708:1875407735385088:0@lo:5: 00000100:00100000:2.0:1788528297.795920:0:8708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788528297.796710:0:8723:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788528297.796716:0:8723:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1788528297.797379:0:8708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1c8f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788528297.797406:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735385088 00000100:00100000:0.0:1788528297.797413:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735385088 00000100:00100000:0.0:1788528297.797584:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788528297.797593:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8708:x1875407735385088:12345-0@lo:5: 00002000:00080000:0.0:1788528297.797625:0:8423:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000020:00000080:2.0:1788528297.797921:0:8719:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788528297.797933:0:8719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788528297.797970:0:8719:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788528297.797993:0:8719:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x892c60dda91c780f 00000100:00080000:2.0:1788528297.798001:0:8719:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788528297.798006:0:8719:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a8fc1f91000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1788528297.798041:0:8719:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc30adc00 x1875407735385216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788528297.798065:0:8719:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788528297.798122:0:8719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788528297.798126:0:8719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528297.798128:0:8719:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788528297.798132:0:8719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788528297.798142:0:8719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528297.798144:0:8719:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788528297.798147:0:8719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788528297.798149:0:8719:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788528297.798174:0:8719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:8719:1875407735385344:0@lo:502: 00000100:00100000:3.0:1788528297.798337:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735385216:0@lo:8: 00000100:00100000:3.0:1788528297.798373:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528297.798398:0:8422:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788528297.798404:0:8422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788528297.798895:0:8421:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788528297.798911:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735385216 00000100:00100000:1.0:1788528297.798920:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735385216 00000100:00100000:2.0:1788528297.798982:0:8719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528297.799047:0:8719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1c8f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788528297.799096:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735385472:0@lo:400: 00000100:00100000:2.0:1788528297.799178:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735385600:0@lo:400: 00000100:00100000:2.0:1788528297.799210:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528297.799232:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735386112:0@lo:400: 00000100:00100000:2.0:1788528297.799269:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528297.799290:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788528297.799295:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735385984:0@lo:400: 00000100:00100000:2.0:1788528297.799318:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528297.799346:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735385856:0@lo:400: 00000100:00100000:2.0:1788528297.799367:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528297.799384:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788528297.799388:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735385728:0@lo:400: 00000100:00100000:2.0:1788528297.799408:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528297.799432:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735385600 00000100:00100000:2.0:1788528297.799436:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735385600 00000100:00100000:2.0:1788528297.799460:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735385856 00000100:00100000:2.0:1788528297.799462:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735385856 00000100:00100000:2.0:1788528297.799474:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788528297.799481:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735385600:12345-0@lo:400: 00000100:00100000:2.0:1788528297.799529:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735385600:12345-0@lo:400: Request processed in 48us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528297.799536:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788528297.799611:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788528297.799619:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735385856:12345-0@lo:400: 00000100:00100000:2.0:1788528297.799654:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735385856:12345-0@lo:400: Request processed in 36us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528297.799660:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788528297.799678:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735386112 00000100:00100000:2.0:1788528297.799681:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735386112 00000100:00100000:2.0:1788528297.799704:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735385984 00000100:00100000:2.0:1788528297.799707:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735385984 00000100:00100000:2.0:1788528297.799717:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735385728 00000100:00100000:2.0:1788528297.799720:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735385728 00000100:00100000:2.0:1788528297.799732:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788528297.799738:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875407735386112:12345-0@lo:400: 00000100:00100000:2.0:1788528297.799783:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875407735386112:12345-0@lo:400: Request processed in 45us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528297.799790:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788528297.799802:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788528297.799807:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735385984:12345-0@lo:400: 00000100:00100000:2.0:1788528297.799831:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735385984:12345-0@lo:400: Request processed in 25us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528297.799836:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788528297.799846:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788528297.799851:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735385728:12345-0@lo:400: 00000100:00100000:2.0:1788528297.799873:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735385728:12345-0@lo:400: Request processed in 23us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528297.799877:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788528297.799914:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a8fc30adf80 x1875407735385984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528297.799933:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735385984:0@lo:400: 00000100:00100000:2.0:1788528297.799946:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735385600:0@lo:400: 00010000:00080000:2.0:1788528297.799954:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a8fc30aea00 x1875407735386112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528297.799962:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735386112:0@lo:400: 00010000:00080000:2.0:1788528297.799992:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a8fc30ad180 x1875407735385728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528297.799999:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735385728:0@lo:400: 00000100:00100000:2.0:1788528297.800006:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735385856:0@lo:400: 00000100:00100000:0.0:1788528297.802134:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528297.802205:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735385472 00000100:00100000:0.0:1788528297.802214:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735385472 00000100:00100000:0.0:1788528297.802256:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788528297.802263:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735385472:12345-0@lo:400: 00000100:00100000:0.0:1788528297.802312:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735385472:12345-0@lo:400: Request processed in 50us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528297.802319:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788528297.802357:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a8fc30ac000 x1875407735385472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528297.802378:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735385472:0@lo:400: 00000100:00100000:3.0:1788528297.804691:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8708:x1875407735385088:12345-0@lo:5: Request processed in 7092us (8763us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788528297.804706:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788528297.804741:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788528297.804747:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1875407735385216:12345-0@lo:8: 00010000:00080000:2.0:1788528297.805006:0:8708:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f8e21f80 x1875407735385088/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788528313 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528297.805024:0:8708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e21f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8708:1875407735385088:0@lo:5: 00000004:00080000:2.0:1788528297.805037:0:8708:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1788528297.805073:0:8708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8708:1875407735386240:0@lo:900: 00000100:00100000:2.0:1788528297.805108:0:8708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528297.805145:0:8708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1c8f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788528297.805214:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735386240 00000100:00100000:0.0:1788528297.805221:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735386240 00000100:00100000:0.0:1788528297.805260:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788528297.805267:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8708:x1875407735386240:12345-0@lo:900: 00000100:00100000:0.0:1788528297.805316:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8708:x1875407735386240:12345-0@lo:900: Request processed in 49us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528297.805322:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788528297.805350:0:8708:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a8fc30ace00 x1875407735386240/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788528313 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528297.805360:0:8708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8708:1875407735386240:0@lo:900: 00000100:00100000:1.0:1788528297.806367:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735385344 00000100:00100000:1.0:1788528297.806376:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735385344 00010000:00080000:3.0:1788528297.806475:0:8423:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:3.0:1788528297.806503:0:8423:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x892c60dda91c7816 00002000:00100000:3.0:1788528297.806517:0:8423:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8a8fc3024000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788528297.806521:0:8423:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788528297.806524:0:8423:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788528297.806895:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788528297.806903:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+22:8719:x1875407735385344:12345-0@lo:502: 00000100:00100000:0.0:1788528297.807050:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+22:8719:x1875407735385344:12345-0@lo:502: Request processed in 147us (8815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528297.807058:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788528297.807108:0:8719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:8719:1875407735385344:0@lo:502: 00002000:00080000:3.0:1788528297.807121:0:8423:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788528297.807144:0:8423:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3027000 : changing import state from RECOVER to FULL 00000020:01000000:0.0:1788528297.807148:0:8719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528297.807154:0:8719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528297.807157:0:8719:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788528297.807161:0:8719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:3.0:1788528297.807194:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1875407735385216:12345-0@lo:8: Request processed in 2446us (8821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528297.807201:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000000:0.0:1788528297.807269:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788528297.807277:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788528297.807287:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c1551400/0x892c60dda91c77f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c77fa expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528297.807309:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c1551400/0x892c60dda91c77f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c77fa expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528297.807319:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788528297.807322:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff8a90c7f88000 from 1 10000000:01000000:0.0:1788528297.807324:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788528297.807349:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0031a00/0x892c60dda91c781d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528297.807356:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c0031a00/0x892c60dda91c781d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528297.807365:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c0031a00/0x892c60dda91c781d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528297.807379:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735386368:0@lo:101: 00000100:00100000:0.0:1788528297.807411:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528297.807444:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6efdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788528297.807456:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735386368 00000100:00100000:0.0:1788528297.807461:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735386368 00000100:00100000:0.0:1788528297.807486:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788528297.807492:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+22:6506:x1875407735386368:12345-0@lo:101: 00010000:00010000:0.0:1788528297.807500:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528297.807511:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c0031c00/0x892c60dda91c7824 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c781d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528297.807545:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c0031c00/0x892c60dda91c7824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c781d expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528297.807586:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c0031c00/0x892c60dda91c7824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c781d expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528297.807594:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031c00, rc 0) 00000100:00100000:0.0:1788528297.807624:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+23:6506:x1875407735386368:12345-0@lo:101: Request processed in 132us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528297.807629:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788528297.807657:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735386368:0@lo:101: 00010000:00010000:0.0:1788528297.807668:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c0031a00/0x892c60dda91c781d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7824 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528297.807677:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c0031a00/0x892c60dda91c781d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7824 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528297.807703:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735386496:0@lo:501: 00000100:00100000:0.0:1788528297.807726:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528297.807743:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6efdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788528297.807753:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735386496 00000100:00100000:0.0:1788528297.807756:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735386496 00000100:00100000:0.0:1788528297.807773:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788528297.807778:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+23:6506:x1875407735386496:12345-0@lo:501: 00000100:00100000:0.0:1788528297.807853:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+23:6506:x1875407735386496:12345-0@lo:501: Request processed in 74us (125us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788528297.807860:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788528297.807885:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735386496:0@lo:501: 00010000:00080000:1.0:1788528297.807890:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a8fc30adc00 x1875407735385216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788528307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788528297.807895:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00000100:00100000:1.0:1788528297.807900:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00010000:00010000:0.0:1788528297.807903:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0031a00/0x892c60dda91c781d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7824 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788528297.807906:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00010000:00010000:0.0:1788528297.807910:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c0031a00/0x892c60dda91c781d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7824 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788528297.807913:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788528297.807918:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788528297.807921:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1f91000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788528297.807932:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788528297.807937:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735385216:0@lo:8: 00000004:00080000:1.0:1788528297.807957:0:8723:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788528297.808059:0:8723:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 167025504397ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788528297.808065:0:8723:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1788528297.810779:0:6487:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788528297.811365:0:8724:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788528297.811391:0:8724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8724:1875407735386752:0@lo:7: 00000100:00100000:1.0:1788528297.811446:0:8724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528297.811470:0:8724:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788528297.811489:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735386752 00000100:00100000:1.0:1788528297.811494:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735386752 00000100:00100000:1.0:1788528297.811541:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788528297.811549:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8724:x1875407735386752:12345-0@lo:7: 00000100:00100000:0.0:1788528297.811644:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735386624:0@lo:13: 00000100:00100000:0.0:1788528297.811678:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788528297.812618:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788528297.812876:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735386624 00000100:00100000:2.0:1788528297.812884:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735386624 00000100:00100000:2.0:1788528297.814838:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788528297.814854:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1875407735386624:12345-0@lo:13: 00002000:00000024:2.0:1788528297.814877:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:2.0:1788528297.814952:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1875407735386624:12345-0@lo:13: Request processed in 103us (3272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528297.814966:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00002000:00080000:1.0:1788528297.816170:0:8421:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788528297.816179:0:8421:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788528297.816247:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8724:x1875407735386752:12345-0@lo:7: Request processed in 4696us (4797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528297.816255:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788528297.816311:0:8724:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f58c3480 x1875407735386752/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788528313 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528297.816325:0:8724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8724:1875407735386752:0@lo:7: 00000004:00080000:1.0:1788528297.816338:0:8724:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788528297.816370:0:8724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8724:1875407735386880:0@lo:5: 00000100:00100000:1.0:1788528297.816399:0:8724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528297.816417:0:8724:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788528297.816432:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735386880 00000100:00100000:1.0:1788528297.816437:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735386880 00000100:00100000:1.0:1788528297.816475:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788528297.816481:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8724:x1875407735386880:12345-0@lo:5: 00002000:00080000:1.0:1788528297.816502:0:8423:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788528297.816505:0:8423:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00010000:00080000:2.0:1788528297.818722:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f58c0a80 x1875407735386624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528297.818747:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735386624:0@lo:13: 00000001:00080000:1.0:1788528297.822935:0:8416:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00100000:1.0:1788528297.822947:0:8416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788528297.822952:0:8416:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:3.0:1788528297.823480:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8724:x1875407735386880:12345-0@lo:5: Request processed in 6994us (7076us total) trans 4294967298 rc 0/0 00010000:00080000:1.0:1788528297.823497:0:8724:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f58c3480 x1875407735386880/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788528313 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528297.823500:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788528297.823508:0:8724:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788528297.823514:0:8724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8724:1875407735386880:0@lo:5: 00000004:00080000:1.0:1788528297.823527:0:8724:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788528297.823587:0:8724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8724:1875407735387008:0@lo:700: 00000100:00100000:1.0:1788528297.823622:0:8724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528297.823649:0:8724:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788528297.823809:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735387008 00000100:00100000:3.0:1788528297.823816:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735387008 00000100:00100000:3.0:1788528297.823860:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788528297.823868:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8724:x1875407735387008:12345-0@lo:700: 00000100:00100000:0.0:1788528297.834634:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8724:x1875407735387008:12345-0@lo:700: Request processed in 10755us (10999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528297.834653:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788528297.834764:0:8724:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f58c3480 x1875407735387008/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788528313 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528297.834780:0:8724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8724:1875407735387008:0@lo:700: 00000004:02000040:2.0:1788528297.850409:0:8724:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1788528297.858299:0:8724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30aea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8724:1875407735387136:0@lo:5: 00000100:00100000:2.0:1788528297.858365:0:8724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528297.861176:0:8724:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1c8f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528297.861792:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735387136 00000100:00100000:0.0:1788528297.861803:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735387136 00000100:00100000:0.0:1788528297.863861:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788528297.864396:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8724:x1875407735387136:12345-0@lo:5: 00002000:00080000:1.0:1788528297.872310:0:8422:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788528297.872331:0:8422:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1788528297.873927:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8724:x1875407735387136:12345-0@lo:5: Request processed in 10047us (15555us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788528297.873938:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788528297.875346:0:8724:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a8fc30aea00 x1875407735387136/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788528313 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528297.875365:0:8724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30aea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8724:1875407735387136:0@lo:5: 00000004:00080000:0.0:1788528297.875379:0:8724:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:0.0:1788528298.110713:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788528299.125137:0:8802:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788528299.135323:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528299.203250:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735387264:0@lo:41: 00000100:00100000:3.0:1788528299.203318:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528299.203391:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735387264 00000100:00100000:3.0:1788528299.203399:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735387264 00000100:00100000:3.0:1788528299.203444:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788528299.203452:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735387264:12345-0@lo:41: 00000004:00000024:3.0:1788528299.203495:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446502400 avail 1300262912 00000100:00100000:3.0:1788528299.203542:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735387264:12345-0@lo:41: Request processed in 90us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528299.203549:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788528299.203612:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735387264:0@lo:41: 00000020:00000004:3.0:1788528300.112079:0:8854:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788528300.113001:0:8854:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788528300.158944:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788528300.952054:0:8416:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1788528301.182868:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528302.208339:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528302.270869:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735387392:0@lo:41: 00000100:00100000:0.0:1788528302.273271:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528302.275051:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735387392 00000100:00100000:3.0:1788528302.275126:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735387392 00000100:00100000:3.0:1788528302.275182:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788528302.275191:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735387392:12345-0@lo:41: 00000004:00000024:3.0:1788528302.275783:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788528302.275897:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735387392:12345-0@lo:41: Request processed in 707us (2631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528302.275905:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788528302.275964:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735387392:0@lo:41: 00000020:00000004:1.0:1788528302.798491:0:8956:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788528302.798739:0:8956:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788528303.230797:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528303.295912:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735387520:0@lo:13: 00000100:00100000:0.0:1788528303.295997:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528303.296793:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735387904:0@lo:400: 00000100:00100000:3.0:1788528303.296835:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528303.296860:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735388416:0@lo:400: 00000100:00100000:3.0:1788528303.296882:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528303.296903:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788528303.296909:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735388032:0@lo:400: 00000100:00100000:3.0:1788528303.296946:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528303.296966:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735388544:0@lo:400: 00000100:00100000:3.0:1788528303.296989:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528303.297023:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735387648:0@lo:13: 00000100:00100000:3.0:1788528303.297049:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528303.297084:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735388160:0@lo:400: 00000100:00100000:3.0:1788528303.297107:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528303.297123:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735388672:0@lo:400: 00000100:00100000:3.0:1788528303.297144:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528303.297164:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788528303.297170:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735387776:0@lo:400: 00000100:00100000:3.0:1788528303.297198:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528303.297219:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735388288:0@lo:400: 00000100:00100000:3.0:1788528303.297259:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528303.297295:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735387520 00000100:00100000:3.0:1788528303.297303:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735387520 00000100:00100000:3.0:1788528303.297344:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735387648 00000100:00100000:3.0:1788528303.297347:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735387648 00000100:00100000:3.0:1788528303.297364:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788528303.297372:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735387520:12345-0@lo:13: 00002000:00000024:3.0:1788528303.297400:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788528303.297485:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735387520:12345-0@lo:13: Request processed in 113us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528303.297492:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788528303.297509:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788528303.297516:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735387648:12345-0@lo:13: 00002000:00000024:3.0:1788528303.297526:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788528303.297578:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735387648:12345-0@lo:13: Request processed in 63us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528303.297585:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788528303.297624:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735387904 00000100:00100000:3.0:1788528303.297628:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735387904 00000100:00100000:3.0:1788528303.297647:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735388416 00000100:00100000:3.0:1788528303.297650:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735388416 00000100:00100000:3.0:1788528303.297662:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735388544 00000100:00100000:3.0:1788528303.297664:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735388544 00000100:00100000:3.0:1788528303.297674:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735388160 00000100:00100000:3.0:1788528303.297677:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735388160 00000100:00100000:3.0:1788528303.297689:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788528303.297695:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735387904:12345-0@lo:400: 00000100:00100000:3.0:1788528303.297731:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735387904:12345-0@lo:400: Request processed in 36us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528303.297737:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788528303.297749:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788528303.297755:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735388416:12345-0@lo:400: 00000100:00100000:3.0:1788528303.297782:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735388416:12345-0@lo:400: Request processed in 27us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528303.297787:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788528303.297798:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788528303.297803:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735388544:12345-0@lo:400: 00000100:00100000:3.0:1788528303.297827:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735388544:12345-0@lo:400: Request processed in 24us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528303.297832:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788528303.297841:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788528303.297847:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735388160:12345-0@lo:400: 00000100:00100000:3.0:1788528303.297887:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735388160:12345-0@lo:400: Request processed in 39us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528303.297893:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788528303.297922:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735388032 00000100:00100000:3.0:1788528303.297926:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735388032 00000100:00100000:3.0:1788528303.297942:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735388288 00000100:00100000:3.0:1788528303.297945:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735388288 00000100:00100000:3.0:1788528303.297958:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788528303.297964:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735388032:12345-0@lo:400: 00000100:00100000:3.0:1788528303.297997:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735388032:12345-0@lo:400: Request processed in 33us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528303.298003:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788528303.298015:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788528303.298021:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735388288:12345-0@lo:400: 00000100:00100000:3.0:1788528303.298048:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735388288:12345-0@lo:400: Request processed in 27us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528303.298054:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788528303.298094:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735387776 00000100:00100000:3.0:1788528303.298098:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735387776 00000100:00100000:3.0:1788528303.298121:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788528303.298126:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+23:3639:x1875407735387776:12345-0@lo:400: 00000100:00100000:3.0:1788528303.298156:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+23:3639:x1875407735387776:12345-0@lo:400: Request processed in 29us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528303.298162:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:3.0:1788528303.298188:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788528303.298192:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788528303.298194:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788528303.298222:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735388032:0@lo:400: 00010000:00080000:3.0:1788528303.298235:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f6ea3480 x1875407735388544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528303.298244:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735388544:0@lo:400: 00010000:00080000:3.0:1788528303.298264:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f6ea0a80 x1875407735387904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528303.298272:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735387904:0@lo:400: 00010000:00080000:3.0:1788528303.298279:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f6ea2d80 x1875407735388416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528303.298286:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735388416:0@lo:400: 00000100:00100000:3.0:1788528303.298321:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735387776:0@lo:400: 00000100:00100000:3.0:1788528303.298330:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735388288:0@lo:400: 00010000:00080000:3.0:1788528303.298339:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f5a0dc00 x1875407735387648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528303.298345:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788528303.298360:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735387648:0@lo:13: 00010000:00080000:3.0:1788528303.298371:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f6ea3100 x1875407735388160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528303.298378:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735388160:0@lo:400: 00010000:00080000:0.0:1788528303.298655:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f5a0e300 x1875407735387520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528303.298664:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1788528303.298677:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735387520:0@lo:13: 00000100:00100000:0.0:1788528303.298728:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735388672 00000100:00100000:0.0:1788528303.298732:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735388672 00000100:00100000:0.0:1788528303.298764:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788528303.298771:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735388672:12345-0@lo:400: 00000100:00100000:0.0:1788528303.298809:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735388672:12345-0@lo:400: Request processed in 39us (1664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528303.298823:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788528303.300159:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f5a0ad80 x1875407735388672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528303.300174:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735388672:0@lo:400: 00000020:00000004:2.0:1788528303.706011:0:9004:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788528303.708948:0:9004:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1788528304.255408:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528304.318920:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735388800:0@lo:41: 00000100:00100000:1.0:1788528304.319020:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528304.319254:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735388800 00000100:00100000:3.0:1788528304.319264:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735388800 00000100:00100000:3.0:1788528304.319333:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788528304.319362:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735388800:12345-0@lo:41: 00000004:00000024:3.0:1788528304.319406:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446502400 avail 1300262912 00000100:00100000:3.0:1788528304.327515:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735388800:12345-0@lo:41: Request processed in 8145us (8486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528304.327528:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788528304.328548:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735388800:0@lo:41: 00010000:00010000:3.0:1788528305.281504:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528306.303601:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528307.326811:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528307.394669:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788528307.394716:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735388928:0@lo:41: 00000100:00100000:0.0:1788528307.394809:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528307.395014:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735388928 00000100:00100000:1.0:1788528307.395025:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735388928 00000100:00100000:1.0:1788528307.395105:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788528307.395117:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735388928:12345-0@lo:41: 00000004:00000024:1.0:1788528307.395173:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788528307.395233:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735388928:12345-0@lo:41: Request processed in 117us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528307.395241:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788528307.395293:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735388928:0@lo:41: 00010000:00010000:0.0:1788528308.352959:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528308.414828:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735389056:0@lo:13: 00000100:00100000:1.0:1788528308.414902:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528308.416321:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735389056 00000100:00100000:3.0:1788528308.416332:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735389056 00000100:00100000:3.0:1788528308.416403:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788528308.416415:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735389056:12345-0@lo:13: 00002000:00000024:3.0:1788528308.416444:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788528308.416507:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735389056:12345-0@lo:13: Request processed in 95us (1605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528308.416515:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788528308.416598:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788528308.416680:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f6f09500 x1875407735389056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528308.416701:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735389056:0@lo:13: 00000100:00100000:1.0:1788528308.416842:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735389440:0@lo:400: 00000100:00100000:1.0:1788528308.416885:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528308.416910:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735389952:0@lo:400: 00000100:00100000:1.0:1788528308.416938:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528308.416959:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788528308.416965:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735389568:0@lo:400: 00000100:00100000:1.0:1788528308.416988:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528308.417004:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735390080:0@lo:400: 00000100:00100000:1.0:1788528308.417026:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528308.417070:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735389440 00000100:00100000:1.0:1788528308.417075:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735389440 00000100:00100000:1.0:1788528308.417106:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788528308.417113:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735389440:12345-0@lo:400: 00000100:00100000:1.0:1788528308.417151:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735389440:12345-0@lo:400: Request processed in 38us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528308.417158:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788528308.417259:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735389184:0@lo:400: 00000100:00100000:2.0:1788528308.417293:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528308.417315:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735389696:0@lo:400: 00000100:00100000:2.0:1788528308.417336:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528308.417348:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788528308.417354:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735389312:0@lo:400: 00000100:00100000:2.0:1788528308.417373:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528308.417391:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1875407735389824:0@lo:400: 00000100:00100000:2.0:1788528308.417411:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528308.417434:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735389952 00000100:00100000:2.0:1788528308.417444:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735389952 00000100:00100000:2.0:1788528308.417472:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735389568 00000100:00100000:2.0:1788528308.417475:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735389568 00000100:00100000:2.0:1788528308.417485:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735389312 00000100:00100000:2.0:1788528308.417487:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735389312 00000100:00100000:2.0:1788528308.417496:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735389824 00000100:00100000:2.0:1788528308.417498:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735389824 00000100:00100000:2.0:1788528308.417511:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788528308.417517:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735389952:12345-0@lo:400: 00000100:00100000:2.0:1788528308.417547:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735389952:12345-0@lo:400: Request processed in 31us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528308.417578:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788528308.417591:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788528308.417597:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735389568:12345-0@lo:400: 00000100:00100000:2.0:1788528308.417625:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735389568:12345-0@lo:400: Request processed in 28us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528308.417630:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788528308.417639:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788528308.417644:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735389312:12345-0@lo:400: 00000100:00100000:2.0:1788528308.417673:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735389312:12345-0@lo:400: Request processed in 28us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528308.417679:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788528308.417690:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788528308.417696:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875407735389824:12345-0@lo:400: 00000100:00100000:2.0:1788528308.417720:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875407735389824:12345-0@lo:400: Request processed in 25us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528308.417726:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1788528308.417742:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788528308.417750:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788528308.417769:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f58c2680 x1875407735389312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528308.417781:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735389312:0@lo:400: 00010000:00080000:2.0:1788528308.417791:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f6fef100 x1875407735389824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528308.417799:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1875407735389824:0@lo:400: 00000100:00100000:0.0:1788528308.418212:0:6514:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788528308.418221:0:6514:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1788528308.418237:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735390080 00000100:00100000:0.0:1788528308.418242:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735390080 00000100:00100000:0.0:1788528308.418277:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788528308.418283:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6feca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735390080:12345-0@lo:400: 00000100:00100000:0.0:1788528308.418320:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6feca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735390080:12345-0@lo:400: Request processed in 38us (1292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528308.418327:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788528308.418419:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735389696 00000100:00100000:0.0:1788528308.418422:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735389696 00000100:00100000:3.0:1788528308.418489:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788528308.418501:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735390208:0@lo:13: 00000100:00100000:3.0:1788528308.418533:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528308.418581:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735389184 00000100:00100000:3.0:1788528308.418585:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735389184 00000100:00100000:3.0:1788528308.418612:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788528308.418618:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+23:3639:x1875407735389184:12345-0@lo:400: 00000100:00100000:3.0:1788528308.418647:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+23:3639:x1875407735389184:12345-0@lo:400: Request processed in 30us (1353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528308.418653:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788528308.418743:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735390208 00000100:00100000:3.0:1788528308.418747:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735390208 00000100:00100000:3.0:1788528308.418768:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788528308.418775:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735390208:12345-0@lo:13: 00002000:00000024:3.0:1788528308.418796:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788528308.418828:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735390208:12345-0@lo:13: Request processed in 53us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528308.418834:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788528308.418866:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f6f0a680 x1875407735390208/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528308.418881:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735390208:0@lo:13: 00000100:00080000:2.0:1788528308.419009:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788528308.419028:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735389184:0@lo:400: 00010000:00080000:1.0:1788528308.419142:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f58c3480 x1875407735389568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528308.419153:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735389568:0@lo:400: 00000100:00100000:0.0:1788528308.419255:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788528308.419270:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735389696:12345-0@lo:400: 00000100:00100000:0.0:1788528308.419316:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735389696:12345-0@lo:400: Request processed in 48us (1979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528308.419323:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788528308.419485:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f6fed880 x1875407735390080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528308.419494:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735390080:0@lo:400: 00000100:00100000:1.0:1788528308.419506:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735389440:0@lo:400: 00010000:00080000:1.0:1788528308.419517:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f6fefb80 x1875407735389952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528308.419526:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735389952:0@lo:400: 00000100:00100000:3.0:1788528308.419634:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735389696:0@lo:400: 00010000:00010000:3.0:1788528309.377707:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528309.439693:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735390336:0@lo:41: 00000100:00100000:1.0:1788528309.439762:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528309.439852:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735390336 00000100:00100000:1.0:1788528309.439859:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735390336 00000100:00100000:1.0:1788528309.439905:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788528309.439914:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735390336:12345-0@lo:41: 00000004:00000024:1.0:1788528309.439946:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446502400 avail 1300262912 00000100:00100000:1.0:1788528309.440020:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735390336:12345-0@lo:41: Request processed in 107us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528309.440026:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788528309.440087:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735390336:0@lo:41: 00010000:00010000:1.0:1788528310.400395:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528311.422929:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528312.446743:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528312.512218:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788528312.512246:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735390464:0@lo:41: 00000100:00100000:3.0:1788528312.512313:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528312.515957:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735390464 00000100:00100000:1.0:1788528312.515969:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735390464 00000100:00100000:1.0:1788528312.516048:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788528312.516058:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735390464:12345-0@lo:41: 00000004:00000024:1.0:1788528312.516094:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788528312.516256:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735390464:12345-0@lo:41: Request processed in 200us (3942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528312.516264:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788528312.516328:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735390464:0@lo:41: 00000020:01000004:2.0:1788528312.975928:0:9504:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:2.0:1788528312.975933:0:9504:0:(obd_mount.c:928:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788528312.975935:0:9504:0:(obd_mount.c:931:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788528312.976063:0:9504:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a8fc1fe4800 00000020:01000004:2.0:1788528312.976079:0:9504:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788528312.976092:0:9504:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788528312.976106:0:9504:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8a90f6c49980) 00000020:00000080:2.0:1788528312.976135:0:9504:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788528313.027846:0:9504:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788528313.027900:0:9504:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1788528313.050769:0:9504:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788528313.051295:0:9504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788528313.051310:0:9504:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788528313.051321:0:9504:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x892c60dda91c7832 00000020:01000004:0.0:1788528313.051327:0:9504:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788528313.051352:0:9504:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.138@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788528313.051355:0:9504:0:(mgc_request.c:1317:mgc_set_info_async()) InitRecov MGC192.168.203.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788528313.051361:0:9504:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788528313.051396:0:9504:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.138@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1788528313.051400:0:9504:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788528313.051401:0:9504:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788528313.051402:0:9504:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788528313.051403:0:9504:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788528313.051404:0:9504:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788528313.051406:0:9504:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788528313.051408:0:9504:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788528313.051409:0:9504:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788528313.051410:0:9504:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788528313.051412:0:9504:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788528313.051413:0:9504:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788528313.051416:0:9504:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1788528313.051418:0:9504:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788528313.051419:0:9504:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788528313.051420:0:9504:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788528313.051425:0:9504:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788528313.051426:0:9504:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788528313.051427:0:9504:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788528313.051428:0:9504:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788528313.051429:0:9504:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788528313.051430:0:9504:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788528313.051431:0:9504:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788528313.051431:0:9504:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788528313.051454:0:9504:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788528313.051472:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f0b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735390592:0@lo:253: 00000100:00100000:0.0:1788528313.051542:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528313.051937:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3164c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788528313.052056:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735390592 00000100:00100000:2.0:1788528313.052064:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735390592 00000100:00100000:2.0:1788528313.052152:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788528313.052162:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+23:9504:x1875407735390592:12345-0@lo:253: 20000000:01000000:2.0:1788528313.052190:0:6501:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788528313.052194:0:6501:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1788528313.052199:0:6501:0:(mgs_llog.c:875:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1788528313.052202:0:6501:0:(mgs_llog.c:3868:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1788528313.052453:0:6501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788528313.052603:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:2.0:1788528313.052618:0:6501:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1788528313.052645:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:2.0:1788528313.052656:0:6501:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1788528313.052669:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:2.0:1788528313.052684:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:2.0:1788528313.052766:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:2.0:1788528313.052779:0:6501:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.203.138@tcp 20000000:01000000:2.0:1788528313.052781:0:6501:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.203.138@tcp (null) (null) (null) 00000040:00080000:2.0:1788528313.052792:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:2.0:1788528313.052797:0:6501:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788528313.052808:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:2.0:1788528313.052812:0:6501:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.138@tcp (null) (null) 00000040:00080000:2.0:1788528313.052823:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:2.0:1788528313.052828:0:6501:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788528313.052839:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:2.0:1788528313.052851:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:2.0:1788528313.053055:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:2.0:1788528313.053066:0:6501:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.203.138@tcp 20000000:01000000:2.0:1788528313.053068:0:6501:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.203.138@tcp (null) (null) (null) 00000040:00080000:2.0:1788528313.053079:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:2.0:1788528313.053084:0:6501:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788528313.053095:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:2.0:1788528313.053099:0:6501:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.138@tcp (null) (null) 00000040:00080000:2.0:1788528313.053112:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:2.0:1788528313.053118:0:6501:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788528313.053189:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:2.0:1788528313.053209:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:2.0:1788528313.053606:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:2.0:1788528313.053618:0:6501:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.203.138@tcp 20000000:01000000:2.0:1788528313.053620:0:6501:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.203.138@tcp (null) (null) (null) 00000040:00080000:2.0:1788528313.053648:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:2.0:1788528313.053655:0:6501:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788528313.053667:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:2.0:1788528313.053678:0:6501:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.138@tcp (null) (null) 00000040:00080000:2.0:1788528313.053692:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:2.0:1788528313.053697:0:6501:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788528313.053707:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:2.0:1788528313.053720:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:2.0:1788528313.053732:0:6501:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788528313.053735:0:6501:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788528313.053738:0:6501:0:(mgs_llog.c:4187:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788528313.053777:0:6501:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788528313.053780:0:6501:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788528313.055732:0:9510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1788528313.056080:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1788528313.056106:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1788528313.056138:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:2.0:1788528313.056149:0:6501:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788528313.056152:0:6501:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788528313.057115:0:9511:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1788528313.057160:0:9511:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1788528313.057176:0:9511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1788528313.057343:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1788528313.057365:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1788528313.057378:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1788528313.057390:0:6501:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788528313.057392:0:6501:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788528313.057745:0:9512:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1788528313.057770:0:9512:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1788528313.057785:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1788528313.057958:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1788528313.057976:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1788528313.057989:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:0.0:1788528313.057999:0:6501:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788528313.058000:0:6501:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788528313.058416:0:9513:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1788528313.058443:0:9513:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1788528313.058455:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788528313.058832:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788528313.058854:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1788528313.058868:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1788528313.058879:0:6501:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788528313.058881:0:6501:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788528313.059416:0:9514:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1788528313.059438:0:9514:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1788528313.059452:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1788528313.059648:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1788528313.059667:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1788528313.059681:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:3.0:1788528313.059699:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788528313.059717:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c7839 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.059735:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c7713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c770c expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.059744:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9101851c00/0x892c60dda91c7721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c771a expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.059757:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c0031800/0x892c60dda91c774b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7744 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.059764:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c1551a00/0x892c60dda91c778a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7783 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.059770:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9101851a00/0x892c60dda91c77a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c779f expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.059777:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c0031600/0x892c60dda91c77d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c77c2 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.059784:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90f6e17c00/0x892c60dda91c77de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c77d7 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.059791:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c1550200/0x892c60dda91c77fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c77f3 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.059797:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c0031c00/0x892c60dda91c7824 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c781d expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.059804:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c7839 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.059840:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c0031c00/0x892c60dda91c7824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c781d expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.059853:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a90c0031c00/0x892c60dda91c7824 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c781d expref: 23 pid: 6502 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528313.059879:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6501:1875407735390720:0@lo:104: 00000100:00100000:3.0:1788528313.060055:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788528313.060212:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c1550200/0x892c60dda91c77fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c77f3 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.060222:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a90c1550200/0x892c60dda91c77fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c77f3 expref: 23 pid: 6501 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528313.060230:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6501:1875407735390848:0@lo:104: 00000100:00100000:3.0:1788528313.060252:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788528313.060320:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90f6e17c00/0x892c60dda91c77de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c77d7 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.060328:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a90f6e17c00/0x892c60dda91c77de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c77d7 expref: 23 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528313.060337:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6501:1875407735390976:0@lo:104: 00000100:00100000:3.0:1788528313.060357:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528313.060375:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735390720 00000100:00100000:2.0:1788528313.060382:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735390720 00000100:00100000:2.0:1788528313.060418:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735390848 00000100:00100000:2.0:1788528313.060421:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735390848 00000100:00100000:0.0:1788528313.060428:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788528313.060443:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+4:6501:x1875407735390720:12345-0@lo:104: 00010000:00010000:0.0:1788528313.060456:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c0031a00/0x892c60dda91c781d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7824 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.060459:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c0031600/0x892c60dda91c77d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c77c2 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.060467:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a90c0031600/0x892c60dda91c77d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c77c2 expref: 23 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528313.060473:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6501:1875407735391104:0@lo:104: 00000100:00100000:3.0:1788528313.060490:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788528313.060500:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1788528313.060503:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9101851a00/0x892c60dda91c77a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c779f expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528313.060506:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+4:6501:x1875407735390720:12345-0@lo:104: Request processed in 70us (451us total) trans 0 rc 0/0 00010000:00010000:3.0:1788528313.060521:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9101851a00/0x892c60dda91c77a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c779f expref: 23 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528313.060529:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6501:1875407735391232:0@lo:104: 00000100:00100000:3.0:1788528313.060593:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788528313.060612:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c1551a00/0x892c60dda91c778a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c7783 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.060621:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a90c1551a00/0x892c60dda91c778a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c7783 expref: 23 pid: 6501 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528313.060628:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6501:1875407735391360:0@lo:104: 00010000:00010000:3.0:1788528313.060651:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c0031800/0x892c60dda91c774b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c7744 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.060658:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a90c0031800/0x892c60dda91c774b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c7744 expref: 23 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528313.060665:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6501:1875407735391488:0@lo:104: 00010000:00010000:3.0:1788528313.060686:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9101851c00/0x892c60dda91c7721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c771a expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.060693:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9101851c00/0x892c60dda91c7721 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c771a expref: 23 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528313.060700:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6501:1875407735391616:0@lo:104: 00010000:00010000:3.0:1788528313.060722:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c7713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c770c expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.060740:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c7713 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c770c expref: 23 pid: 6501 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528313.060748:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6501:1875407735391744:0@lo:104: 00000100:00100000:3.0:1788528313.060768:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90fbeae900 going to sleep for 11 seconds 00000100:00100000:3.0:1788528313.060786:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6501:1875407735390720:0@lo:104: 00000100:00100000:2.0:1788528313.060847:0:6491:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788528313.060863:0:6491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528313.060876:0:6491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528313.060884:0:6491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528313.060892:0:6491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528313.060898:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735390976 00000100:00100000:2.0:1788528313.060902:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735390976 00000100:00100000:2.0:1788528313.060929:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735391104 00000100:00100000:2.0:1788528313.060932:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735391104 00000100:00100000:2.0:1788528313.060941:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735391232 00000100:00100000:2.0:1788528313.060944:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735391232 00000100:00100000:2.0:1788528313.060963:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735391360 00000100:00100000:2.0:1788528313.060966:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735391360 00000100:00100000:2.0:1788528313.060974:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735391488 00000100:00100000:2.0:1788528313.060976:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735391488 00000100:00100000:2.0:1788528313.060983:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735391616 00000100:00100000:2.0:1788528313.060985:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735391616 00000100:00100000:0.0:1788528313.060992:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788528313.061021:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735391744 00000100:00100000:0.0:1788528313.061030:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735391744 00000100:00100000:2.0:1788528313.061059:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788528313.061067:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+10:6501:x1875407735390848:12345-0@lo:104: 00010000:00010000:2.0:1788528313.061075:0:6491:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c1551400/0x892c60dda91c77f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c77fa expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.061228:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788528313.061234:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+10:6501:x1875407735390848:12345-0@lo:104: Request processed in 169us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528313.061242:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788528313.061254:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788528313.061260:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+9:6501:x1875407735390976:12345-0@lo:104: 00010000:00010000:2.0:1788528313.061268:0:6491:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c77d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c77de expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.061300:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788528313.061305:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+9:6501:x1875407735390976:12345-0@lo:104: Request processed in 46us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528313.061311:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788528313.061323:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788528313.061328:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+8:6501:x1875407735391104:12345-0@lo:104: 00010000:00010000:2.0:1788528313.061335:0:6491:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c1551600/0x892c60dda91c77c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c77d0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.061375:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788528313.061380:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+8:6501:x1875407735391104:12345-0@lo:104: Request processed in 53us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528313.061387:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788528313.061398:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788528313.061404:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fc34c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+7:6501:x1875407735391232:12345-0@lo:104: 00010000:00010000:2.0:1788528313.061411:0:6491:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c779f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c77a6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.061442:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788528313.061447:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fc34c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+7:6501:x1875407735391232:12345-0@lo:104: Request processed in 44us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528313.061452:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788528313.061477:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788528313.061483:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+6:6501:x1875407735391360:12345-0@lo:104: 00010000:00010000:2.0:1788528313.061490:0:6491:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7783 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c778a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.061515:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788528313.061520:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+6:6501:x1875407735391360:12345-0@lo:104: Request processed in 37us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528313.061525:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788528313.061536:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788528313.061541:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+5:6501:x1875407735391488:12345-0@lo:104: 00010000:00010000:2.0:1788528313.061548:0:6491:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c774b expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.061597:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788528313.061602:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+5:6501:x1875407735391488:12345-0@lo:104: Request processed in 61us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528313.061608:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788528313.061621:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788528313.061626:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+4:6501:x1875407735391616:12345-0@lo:104: 00010000:00010000:2.0:1788528313.061634:0:6491:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c0030800/0x892c60dda91c771a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7721 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.061657:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:2.0:1788528313.061662:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+4:6501:x1875407735391616:12345-0@lo:104: Request processed in 36us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528313.061667:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788528313.061733:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6501:1875407735390848:0@lo:104: 00010000:00010000:3.0:1788528313.061743:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1788528313.061748:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c0031a00/0x892c60dda91c781d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7824 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.061755:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031a00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:3.0:1788528313.061759:0:6497:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0031a00/0x892c60dda91c781d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c7824 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.061768:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c0031a00/0x892c60dda91c781d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c7824 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788528313.061775:0:6497:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0031a00/0x892c60dda91c781d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c7824 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528313.061780:0:6497:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788528313.061845:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c0031a00/0x892c60dda91c781d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7824 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.061852:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788528313.061870:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c0031a00/0x892c60dda91c781d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7824 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.061886:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c0031a00/0x892c60dda91c781d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7824 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.061897:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788528313.061899:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c1551400/0x892c60dda91c77f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c77fa expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.061905:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c1551400 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:3.0:1788528313.061908:0:6497:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c1551400/0x892c60dda91c77f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c77fa expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.061925:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c1551400/0x892c60dda91c77f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c77fa expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788528313.061931:0:6497:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c1551400/0x892c60dda91c77f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c77fa expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528313.061937:0:6497:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788528313.062077:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c1551400/0x892c60dda91c77f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c77fa expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.062083:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788528313.062183:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c1551400/0x892c60dda91c77f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c77fa expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.062191:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c1551400/0x892c60dda91c77f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c77fa expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.062201:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788528313.062209:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c77d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c77de expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.062214:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031400 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:3.0:1788528313.062217:0:6497:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c77d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c77de expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.062223:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c77d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c77de expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788528313.062229:0:6497:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c77d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c77de expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528313.062234:0:6497:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788528313.062397:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788528313.062403:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c1551600/0x892c60dda91c77c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c77d0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.062410:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c1551600 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528313.062413:0:8440:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c1551600/0x892c60dda91c77c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c77d0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.062419:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c1551600/0x892c60dda91c77c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c77d0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528313.062425:0:8440:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c1551600/0x892c60dda91c77c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c77d0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528313.062430:0:8440:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788528313.062450:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c1551600/0x892c60dda91c77c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c77d0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.062456:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528313.062461:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c1551600/0x892c60dda91c77c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c77d0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.062468:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c1551600/0x892c60dda91c77c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c77d0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.062477:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788528313.062480:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c779f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c77a6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.062494:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17800 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528313.062497:0:8440:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c779f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c77a6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.062504:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c779f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c77a6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528313.062509:0:8440:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c779f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c77a6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528313.062515:0:8440:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788528313.062528:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c779f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c77a6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.062534:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528313.062539:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c779f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c77a6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.062546:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c779f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c77a6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.062573:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788528313.062576:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7783 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c778a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.062583:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16e00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528313.062586:0:8440:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7783 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c778a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.062602:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c778a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528313.062609:0:8440:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c778a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528313.062614:0:8440:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788528313.062627:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7783 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c778a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.062632:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528313.062636:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7783 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c778a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.062642:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7783 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c778a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.062650:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788528313.062653:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c774b expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.062658:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850800 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528313.062661:0:8440:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c774b expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.062667:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c774b expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528313.062673:0:8440:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c774b expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528313.062684:0:8440:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788528313.062697:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7744 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c774b expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.062702:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528313.062706:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7744 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c774b expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.062713:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7744 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c774b expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.062722:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528313.062725:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c0030800/0x892c60dda91c771a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7721 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.062730:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030800 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528313.062733:0:8440:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0030800/0x892c60dda91c771a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c7721 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.062739:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c0030800/0x892c60dda91c771a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c7721 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.062745:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c77d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c77de expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528313.062745:0:8440:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0030800/0x892c60dda91c771a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c7721 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.062752:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:1.0:1788528313.062752:0:8440:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788528313.062756:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c77d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c77de expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.062761:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c0030800/0x892c60dda91c771a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7721 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.062763:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c77d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c77de expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.062766:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788528313.062771:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528313.062773:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528313.062775:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528313.062775:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c0030800/0x892c60dda91c771a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7721 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.062781:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c0030800/0x892c60dda91c771a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7721 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528313.062788:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735392256:0@lo:103: 00010000:00010000:1.0:1788528313.062790:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528313.062791:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528313.062793:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528313.062827:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528313.062897:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6feed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735392768:0@lo:103: 00000100:00100000:3.0:1788528313.062939:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528313.063322:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788528313.063330:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735391872:0@lo:103: 00000100:00100000:3.0:1788528313.063351:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528313.063373:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735392256 00000100:00100000:2.0:1788528313.063584:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735392256 00010000:00010000:2.0:1788528313.063613:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9101851a00/0x892c60dda91c77a6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c779f expref: 24 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528313.063638:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735392768 00000100:00100000:2.0:1788528313.063641:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735392768 00010000:00010000:2.0:1788528313.063653:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9101851c00/0x892c60dda91c7721 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c771a expref: 25 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528313.063669:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788528313.063676:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+25:3637:x1875407735392256:12345-0@lo:103: 00010000:00010000:2.0:1788528313.063688:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528313.063692:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9101851a00/0x892c60dda91c77a6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c779f expref: 25 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.063709:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9101851a00/0x892c60dda91c77a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c779f expref: 25 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.063728:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528313.063758:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+25:3637:x1875407735392256:12345-0@lo:103: Request processed in 81us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528313.063765:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788528313.063781:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788528313.063787:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+24:3637:x1875407735392768:12345-0@lo:103: 00010000:00010000:2.0:1788528313.063795:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528313.063799:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9101851c00/0x892c60dda91c7721 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c771a expref: 24 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.063808:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9101851c00/0x892c60dda91c7721 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c771a expref: 24 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.063818:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528313.063910:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+24:3637:x1875407735392768:12345-0@lo:103: Request processed in 122us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528313.063980:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788528313.063999:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788528313.064018:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+3:6501:x1875407735391744:12345-0@lo:104: 00010000:00010000:0.0:1788528313.064028:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c770c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7713 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528313.064067:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788528313.064072:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+3:6501:x1875407735391744:12345-0@lo:104: Request processed in 67us (3179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528313.064078:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788528313.064096:0:6496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528313.064101:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c770c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7713 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528313.064108:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030a00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:0.0:1788528313.064112:0:6496:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c770c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c7713 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528313.064119:0:6496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c770c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c7713 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528313.064125:0:6496:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c770c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c7713 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528313.064162:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735392384:0@lo:103: 00000100:00100000:3.0:1788528313.064187:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1788528313.064330:0:6496:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788528313.064345:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735392256:0@lo:103: 00010000:00010000:0.0:1788528313.064349:0:6496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c770c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7713 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528313.064354:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6feed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735392768:0@lo:103: 00010000:00010000:0.0:1788528313.064355:0:6496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788528313.064362:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c770c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7713 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528313.064367:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788528313.064373:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735392896:0@lo:103: 00010000:00010000:0.0:1788528313.064375:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c770c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7713 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528313.064388:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528313.064390:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528313.064391:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528313.064393:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788528313.064397:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528313.064402:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528313.064411:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735391872 00000100:00100000:2.0:1788528313.064415:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735391872 00010000:00010000:2.0:1788528313.064430:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c0031c00/0x892c60dda91c7824 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c781d expref: 24 pid: 6502 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528313.064435:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735392384 00000100:00100000:0.0:1788528313.064438:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735392384 00000100:00100000:2.0:1788528313.064444:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788528313.064450:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+25:3637:x1875407735391872:12345-0@lo:103: 00010000:00010000:0.0:1788528313.064450:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c1551a00/0x892c60dda91c778a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7783 expref: 25 pid: 6501 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.064457:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788528313.064463:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1788528313.064466:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c0031c00/0x892c60dda91c7824 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c781d expref: 25 pid: 6502 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528313.064467:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd052447-840d-4bcc-891b-140c465c7625+25:3637:x1875407735392384:12345-0@lo:103: 00010000:00010000:0.0:1788528313.064474:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528313.064476:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c0031c00/0x892c60dda91c7824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c781d expref: 25 pid: 6502 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528313.064477:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c1551a00/0x892c60dda91c778a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7783 expref: 25 pid: 6501 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.064486:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c0031c00/0x892c60dda91c7824 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c781d expref: 25 pid: 6502 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528313.064487:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c1551a00/0x892c60dda91c778a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c7783 expref: 25 pid: 6501 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.064496:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788528313.064496:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528313.064518:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+24:3637:x1875407735391872:12345-0@lo:103: Request processed in 69us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528313.064518:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd052447-840d-4bcc-891b-140c465c7625+24:3637:x1875407735392384:12345-0@lo:103: Request processed in 50us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528313.064524:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788528313.064591:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735391872:0@lo:103: 00000100:00100000:3.0:1788528313.064598:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735392384:0@lo:103: 00000100:00100000:3.0:1788528313.064618:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735392000:0@lo:103: 00000100:00100000:3.0:1788528313.064639:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528313.064650:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6feea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735392512:0@lo:103: 00000100:00100000:3.0:1788528313.064665:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528313.064676:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788528313.064680:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735392128:0@lo:103: 00000100:00100000:3.0:1788528313.064708:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528313.064720:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735392640:0@lo:103: 00000100:00100000:3.0:1788528313.064738:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528313.064783:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735392896 00000100:00100000:1.0:1788528313.064787:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735392896 00010000:00010000:1.0:1788528313.064802:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c7713 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c770c expref: 24 pid: 6501 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528313.064849:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735392000 00000100:00100000:2.0:1788528313.064853:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735392000 00010000:00010000:2.0:1788528313.064865:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c1550200/0x892c60dda91c77fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c77f3 expref: 25 pid: 6501 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528313.064943:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788528313.064959:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735392512 00000100:00100000:0.0:1788528313.064962:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735392512 00010000:00010000:0.0:1788528313.064981:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c0031800/0x892c60dda91c774b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7744 expref: 25 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528313.064993:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735392128 00000100:00100000:0.0:1788528313.064995:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735392128 00010000:00010000:0.0:1788528313.065004:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c0031600/0x892c60dda91c77d0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c77c2 expref: 26 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528313.065024:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735392640 00000100:00100000:0.0:1788528313.065027:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735392640 00010000:00010000:0.0:1788528313.065036:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90f6e17c00/0x892c60dda91c77de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c77d7 expref: 27 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528313.065047:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788528313.065052:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd052447-840d-4bcc-891b-140c465c7625+27:3639:x1875407735392512:12345-0@lo:103: 00010000:00010000:0.0:1788528313.065059:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528313.065063:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c0031800/0x892c60dda91c774b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7744 expref: 27 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528313.065072:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c0031800/0x892c60dda91c774b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c7744 expref: 27 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528313.065081:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528313.065110:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd052447-840d-4bcc-891b-140c465c7625+27:3639:x1875407735392512:12345-0@lo:103: Request processed in 58us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528313.065116:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788528313.065593:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788528313.065603:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+27:3639:x1875407735392128:12345-0@lo:103: 00010000:00010000:2.0:1788528313.065613:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788528313.065616:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6501:1875407735390976:0@lo:104: 00000100:00100000:1.0:1788528313.065635:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788528313.065639:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6501:1875407735391104:0@lo:104: 00000100:00100000:1.0:1788528313.065643:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd052447-840d-4bcc-891b-140c465c7625+27:3639:x1875407735392640:12345-0@lo:103: 00010000:00010000:3.0:1788528313.065648:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101851a00/0x892c60dda91c77a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c779f expref: 27 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.065650:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528313.065655:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90f6e17c00/0x892c60dda91c77de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c77d7 expref: 27 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528313.065657:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6501:1875407735391232:0@lo:104: 00010000:00010000:1.0:1788528313.065663:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90f6e17c00/0x892c60dda91c77de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c77d7 expref: 26 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.065666:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c1551a00/0x892c60dda91c778a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c7783 expref: 26 pid: 6501 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528313.065674:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6501:1875407735391360:0@lo:104: 00010000:00010000:1.0:1788528313.065674:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90f6e17c00/0x892c60dda91c77de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c77d7 expref: 25 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.065682:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788528313.065683:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c0031800/0x892c60dda91c774b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c7744 expref: 24 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.065688:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c0031600/0x892c60dda91c77d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c77c2 expref: 24 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528313.065694:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6501:1875407735391488:0@lo:104: 00010000:00010000:2.0:1788528313.065706:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c0031600/0x892c60dda91c77d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c77c2 expref: 23 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.065711:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101851c00/0x892c60dda91c7721 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c771a expref: 23 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528313.065711:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd052447-840d-4bcc-891b-140c465c7625+23:3639:x1875407735392640:12345-0@lo:103: Request processed in 69us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528313.065722:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788528313.065726:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6501:1875407735391616:0@lo:104: 00010000:00010000:2.0:1788528313.065731:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c0031600/0x892c60dda91c77d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c77c2 expref: 22 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528313.065736:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6501:1875407735391744:0@lo:104: 00000100:00100000:1.0:1788528313.065738:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1788528313.065750:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528313.065750:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd052447-840d-4bcc-891b-140c465c7625+20:3639:x1875407735392000:12345-0@lo:103: 00010000:00010000:1.0:1788528313.065757:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528313.065763:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c1550200/0x892c60dda91c77fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c77f3 expref: 20 pid: 6501 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.065772:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c1550200/0x892c60dda91c77fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c77f3 expref: 20 pid: 6501 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.065789:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c7839 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528313.065800:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+20:3639:x1875407735392128:12345-0@lo:103: Request processed in 197us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528313.065808:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788528313.065825:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788528313.065839:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90efa86450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd052447-840d-4bcc-891b-140c465c7625+18:3637:x1875407735392896:12345-0@lo:103: 00010000:00010000:0.0:1788528313.065847:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528313.065852:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c7713 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c770c expref: 18 pid: 6501 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528313.065868:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c7713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c770c expref: 18 pid: 6501 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528313.065998:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c7713 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c770c expref: 18 pid: 6501 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528313.066014:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788528313.066040:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c1550200/0x892c60dda91c77fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c77f3 expref: 17 pid: 6501 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.066051:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c7839 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528313.066057:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90efa86450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd052447-840d-4bcc-891b-140c465c7625+16:3637:x1875407735392896:12345-0@lo:103: Request processed in 226us (1663us total) trans 0 rc 0/0 00010000:00010000:1.0:1788528313.066059:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c7839 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528313.066063:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1788528313.066072:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c7839 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.066079:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c7839 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.066085:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c7839 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.066091:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c7839 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.066170:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c13fda00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528313.066175:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c7839 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.066188:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c7839 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.066216:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c7839 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528313.066223:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735392896:0@lo:103: 00010000:00010000:1.0:1788528313.066225:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528313.066247:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd052447-840d-4bcc-891b-140c465c7625+15:3639:x1875407735392000:12345-0@lo:103: Request processed in 499us (1607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528313.066254:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1788528313.066384:0:6501:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c7839 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.066394:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c7839 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.066401:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c7839 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788528313.066414:0:6501:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:3.0:1788528313.066655:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528313.069515:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735392128:0@lo:103: 00000100:00100000:0.0:1788528313.069530:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735392640:0@lo:103: 00000100:00100000:0.0:1788528313.069538:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735392000:0@lo:103: 00000100:00100000:0.0:1788528313.069546:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6feea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735392512:0@lo:103: 00000100:00100000:3.0:1788528313.071135:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+14:9504:x1875407735390592:12345-0@lo:253: Request processed in 18970us (19588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528313.071148:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788528313.071287:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f0b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735390592:0@lo:253: 10000000:01000000:1.0:1788528313.071300:0:9504:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788528313.071303:0:9504:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788528313.071304:0:9504:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788528313.071305:0:9504:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788528313.071305:0:9504:0:(tgt_mount.c:1242:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1788528313.071306:0:9504:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788528313.071307:0:9504:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788528313.071308:0:9504:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788528313.071309:0:9504:0:(tgt_mount.c:1260:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788528313.071310:0:9504:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788528313.071311:0:9504:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788528313.071325:0:9504:0:(tgt_mount.c:115:server_register_mount()) register mount ffff8a8fc1fe4800 from lustre-OST0001 10000000:01000000:1.0:1788528313.071349:0:9504:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788528313.071351:0:9504:0:(mgc_request.c:423:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788528313.071358:0:9504:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8a8fc1fe4800 10000000:01000000:1.0:1788528313.071364:0:9504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788528313.071381:0:9504:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-OST0001-osd 00000040:01000000:1.0:1788528313.078421:0:9504:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788528313.093048:0:9504:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788528313.093070:0:9504:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff8a8fc1fe4800 from 1 10000000:01000000:2.0:1788528313.093074:0:9504:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788528313.093114:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7840 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.093125:0:9504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7840 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.093135:0:9504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7840 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528313.093156:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735393024:0@lo:101: 00000100:00100000:2.0:1788528313.093217:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528313.093260:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1fd6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788528313.093327:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735393024 00000100:00100000:3.0:1788528313.093342:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735393024 00000100:00100000:3.0:1788528313.093399:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788528313.093410:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+14:9504:x1875407735393024:12345-0@lo:101: 00010000:00010000:3.0:1788528313.093422:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528313.093436:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c13fce00/0x892c60dda91c7847 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7840 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.093471:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c13fce00/0x892c60dda91c7847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7840 expref: 15 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.093483:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c13fce00/0x892c60dda91c7847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7840 expref: 15 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.093491:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c13fce00, rc 0) 00000100:00100000:3.0:1788528313.093546:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+15:9504:x1875407735393024:12345-0@lo:101: Request processed in 138us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528313.093586:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788528313.093809:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735393024:0@lo:101: 00010000:00010000:2.0:1788528313.093825:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7840 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7847 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.093842:0:9504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7840 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7847 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528313.093959:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735393152:0@lo:501: 00000100:00100000:2.0:1788528313.093986:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528313.094025:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1fd6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788528313.094043:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735393152 00000100:00100000:3.0:1788528313.094049:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735393152 00000100:00100000:3.0:1788528313.094082:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788528313.094089:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+15:9504:x1875407735393152:12345-0@lo:501: 00000100:00100000:3.0:1788528313.094156:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+15:9504:x1875407735393152:12345-0@lo:501: Request processed in 66us (168us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788528313.094162:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788528313.094714:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735393152:0@lo:501: 10000000:01000000:2.0:1788528313.094729:0:9504:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.203.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:2.0:1788528313.094768:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735393280:0@lo:501: 00000100:00100000:2.0:1788528313.094796:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528313.094825:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1fd6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788528313.094897:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735393280 00000100:00100000:3.0:1788528313.094902:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735393280 00000100:00100000:3.0:1788528313.094938:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788528313.094945:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+15:9504:x1875407735393280:12345-0@lo:501: 00000100:00100000:3.0:1788528313.095016:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+15:9504:x1875407735393280:12345-0@lo:501: Request processed in 63us (210us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788528313.095032:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788528313.095195:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735393280:0@lo:501: 10000000:01000000:1.0:1788528313.095224:0:9504:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788528313.095329:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7840 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7847 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.095341:0:9504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7840 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7847 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528313.095353:0:9504:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff8a8fc1fe4800 10000000:01000000:1.0:1788528313.095359:0:9504:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788528313.095391:0:9504:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-OST0001-osd 00000040:01000000:1.0:1788528313.095463:0:9504:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:1.0:1788528313.095471:0:9504:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:1.0:1788528313.095478:0:9504:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788528313.095482:0:9504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788528313.095506:0:9504:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-OST0001-osd 00000040:01000000:1.0:1788528313.095545:0:9504:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:1.0:1788528313.095550:0:9504:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:1.0:1788528313.095588:0:9504:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788528313.095591:0:9504:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788528313.095612:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c784e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.095620:0:9504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c784e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.095629:0:9504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c784e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528313.095644:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735393408:0@lo:101: 00000100:00100000:1.0:1788528313.095673:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528313.095696:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c2b57300 going to sleep for 11 seconds 00000100:00100000:0.0:1788528313.095720:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735393408 00000100:00100000:0.0:1788528313.095726:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735393408 00000100:00100000:0.0:1788528313.095759:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788528313.095766:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+15:9504:x1875407735393408:12345-0@lo:101: 00010000:00010000:0.0:1788528313.095775:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528313.095787:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc26e3c00/0x892c60dda91c7855 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c784e expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528313.095808:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc26e3c00/0x892c60dda91c7855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c784e expref: 16 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528313.095817:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc26e3c00/0x892c60dda91c7855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c784e expref: 16 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528313.095831:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e3c00, rc 0) 00000100:00100000:0.0:1788528313.095870:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+16:9504:x1875407735393408:12345-0@lo:101: Request processed in 104us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528313.095876:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788528313.096025:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735393408:0@lo:101: 00010000:00010000:1.0:1788528313.096044:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c784e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7855 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.096053:0:9504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c784e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7855 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528313.096099:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735393536:0@lo:501: 00000100:00100000:1.0:1788528313.096125:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528313.096147:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c2b57300 going to sleep for 11 seconds 00000100:00100000:3.0:1788528313.096195:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735393536 00000100:00100000:3.0:1788528313.096200:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735393536 00000100:00100000:3.0:1788528313.096230:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788528313.096244:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+16:9504:x1875407735393536:12345-0@lo:501: 00000100:00100000:3.0:1788528313.096331:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+16:9504:x1875407735393536:12345-0@lo:501: Request processed in 94us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528313.096338:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788528313.096396:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735393536:0@lo:501: 00000100:00100000:1.0:1788528313.096432:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735393664:0@lo:503: 00000100:00100000:1.0:1788528313.096466:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528313.096487:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c2b57300 going to sleep for 11 seconds 00000100:00100000:3.0:1788528313.096789:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735393664 00000100:00100000:3.0:1788528313.096794:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735393664 00000100:00100000:3.0:1788528313.096823:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788528313.096830:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+16:9504:x1875407735393664:12345-0@lo:503: 00000100:00100000:3.0:1788528313.096909:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+16:9504:x1875407735393664:12345-0@lo:503: Request processed in 79us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528313.096916:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788528313.096939:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735393664:0@lo:503: 00000040:00080000:2.0:1788528313.097314:0:9504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788528313.097519:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735393792:0@lo:502: 00000100:00100000:2.0:1788528313.097585:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528313.097619:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1fd6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788528313.097707:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735393792 00000100:00100000:3.0:1788528313.097713:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735393792 00000100:00100000:3.0:1788528313.097783:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788528313.097791:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+16:9504:x1875407735393792:12345-0@lo:502: 00000100:00100000:3.0:1788528313.097886:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+16:9504:x1875407735393792:12345-0@lo:502: Request processed in 95us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528313.097892:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788528313.097960:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735393792:0@lo:502: 00000040:00080000:2.0:1788528313.098179:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788528313.098217:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788528313.098231:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788528313.098250:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788528313.098267:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788528313.098295:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788528313.098315:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735393920:0@lo:502: 00000100:00100000:2.0:1788528313.098349:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528313.099376:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1fd6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788528313.099788:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735393920 00000100:00100000:1.0:1788528313.099796:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735393920 00000100:00100000:1.0:1788528313.099875:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788528313.100018:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+16:9504:x1875407735393920:12345-0@lo:502: 00000100:00100000:1.0:1788528313.100384:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+16:9504:x1875407735393920:12345-0@lo:502: Request processed in 501us (2033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528313.100391:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788528313.100672:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735393920:0@lo:502: 00000040:00080000:2.0:1788528313.100742:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788528313.100754:0:9504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:0.0:1788528313.101450:0:9515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788528313.101459:0:9515:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1788528313.101548:0:9515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528313.101551:0:9515:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788528313.101590:0:9515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788528313.101604:0:9515:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8a9101958000) 00000020:00000080:0.0:1788528313.101704:0:9515:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788528313.101817:0:9515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788528313.101890:0:9515:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a8fc1fe4800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788528313.102026:0:9515:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788528313.102033:0:9515:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x892c60dda91c7863 00010000:00010000:1.0:1788528313.106205:0:9515:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1788528313.106476:0:9515:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788528313.109099:0:9515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788528313.109400:0:9515:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788528313.111879:0:9515:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1788528313.112030:0:9515:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1788528313.116295:0:9515:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1788528313.117619:0:9515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788528313.117633:0:9515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788528313.117640:0:9515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528313.117642:0:9515:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788528313.117646:0:9515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788528313.117656:0:9515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528313.117658:0:9515:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788528313.117661:0:9515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788528313.117663:0:9515:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788528313.117685:0:9515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788528313.117687:0:9515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528313.117689:0:9515:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788528313.117692:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788528313.119923:0:9504:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788528313.119950:0:9504:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788528313.119970:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c784e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7855 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.119982:0:9504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c784e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7855 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528313.119990:0:9504:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a8fc1fe4800 from 1 10000000:01000000:1.0:1788528313.119993:0:9504:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788528313.120040:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c786a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.120048:0:9504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c786a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.120059:0:9504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c786a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528313.120080:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735394048:0@lo:101: 00000100:00100000:1.0:1788528313.120142:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528313.120179:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ecd000 going to sleep for 11 seconds 00000100:00100000:0.0:1788528313.122245:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735394048 00000100:00100000:0.0:1788528313.122258:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735394048 00000100:00100000:0.0:1788528313.122316:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788528313.122326:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+16:9504:x1875407735394048:12345-0@lo:101: 00010000:00010000:0.0:1788528313.122341:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528313.122357:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7871 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c786a expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528313.122383:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7871 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c786a expref: 17 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528313.122395:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7871 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c786a expref: 17 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528313.122415:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e3800, rc 0) 00000100:00100000:0.0:1788528313.122478:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+17:9504:x1875407735394048:12345-0@lo:101: Request processed in 154us (2335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528313.122484:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788528313.122839:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735394048:0@lo:101: 00010000:00010000:1.0:1788528313.122859:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c786a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7871 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.122869:0:9504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c786a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7871 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528313.122963:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735394176:0@lo:501: 00000100:00100000:1.0:1788528313.123017:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528313.123053:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ecd000 going to sleep for 11 seconds 00000100:00100000:2.0:1788528313.124706:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735394176 00000100:00100000:2.0:1788528313.124720:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735394176 00000100:00100000:2.0:1788528313.124770:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788528313.124780:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+17:9504:x1875407735394176:12345-0@lo:501: 00000100:00100000:2.0:1788528313.124921:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+17:9504:x1875407735394176:12345-0@lo:501: Request processed in 142us (1913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528313.124941:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788528313.125461:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735394176:0@lo:501: 00000100:00100000:1.0:1788528313.125505:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735394304:0@lo:503: 00000100:00100000:1.0:1788528313.125584:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528313.125614:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ecd000 going to sleep for 11 seconds 00000100:00100000:2.0:1788528313.125673:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735394304 00000100:00100000:2.0:1788528313.125678:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735394304 00000100:00100000:2.0:1788528313.125715:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788528313.125722:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+17:9504:x1875407735394304:12345-0@lo:503: 00000100:00100000:2.0:1788528313.125806:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+17:9504:x1875407735394304:12345-0@lo:503: Request processed in 85us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528313.125813:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788528313.125885:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735394304:0@lo:503: 00000040:00080000:1.0:1788528313.126906:0:9504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788528313.126986:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735394432:0@lo:502: 00000100:00100000:1.0:1788528313.127048:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528313.127124:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ecd000 going to sleep for 11 seconds 00000100:00100000:2.0:1788528313.129484:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735394432 00000100:00100000:2.0:1788528313.129499:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735394432 00000100:00100000:3.0:1788528313.129644:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788528313.129655:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+17:9504:x1875407735394432:12345-0@lo:502: 00000100:00100000:3.0:1788528313.129834:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+17:9504:x1875407735394432:12345-0@lo:502: Request processed in 180us (2785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528313.129842:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788528313.129963:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735394432:0@lo:502: 00000040:00080000:2.0:1788528313.130202:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788528313.130231:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788528313.130262:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735394560:0@lo:502: 00000100:00100000:2.0:1788528313.130306:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528313.130344:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c67ef000 going to sleep for 11 seconds 00000100:00100000:3.0:1788528313.130668:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735394560 00000100:00100000:3.0:1788528313.130674:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735394560 00000100:00100000:3.0:1788528313.130698:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788528313.130704:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+17:9504:x1875407735394560:12345-0@lo:502: 00000100:00100000:3.0:1788528313.130787:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+17:9504:x1875407735394560:12345-0@lo:502: Request processed in 81us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528313.130793:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788528313.130925:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735394560:0@lo:502: 00000040:00080000:2.0:1788528313.130974:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788528313.130982:0:9504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788528313.131952:0:9519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788528313.131963:0:9519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528313.131965:0:9519:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788528313.131973:0:9519:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a8fc1fe4800 00000020:00000080:0.0:1788528313.131975:0:9519:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788528313.131986:0:9519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528313.131989:0:9519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528313.131990:0:9519:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788528313.131993:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788528313.132141:0:9504:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788528313.132152:0:9504:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788528313.132203:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c786a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7871 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.132214:0:9504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c786a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7871 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528313.132260:0:9504:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788528313.132262:0:9504:0:(mgc_request.c:423:config_log_add()) add config log lustre-client-ffff8a8fc1fe4800 10000000:01000000:2.0:1788528313.132265:0:9504:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff8a8fc1fe4800 10000000:01000000:2.0:1788528313.132269:0:9504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788528313.132283:0:9504:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-OST0001-osd 00000040:01000000:2.0:1788528313.132322:0:9504:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788528313.132329:0:9504:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788528313.132341:0:9504:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff8a8fc1fe4800 from 1 10000000:01000000:2.0:1788528313.132344:0:9504:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788528313.132371:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7878 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.132378:0:9504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7878 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.132385:0:9504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7878 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528313.132403:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735394688:0@lo:101: 00000100:00100000:2.0:1788528313.132454:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528313.132502:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d01b30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528313.132550:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735394688 00000100:00100000:3.0:1788528313.132633:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735394688 00000100:00100000:3.0:1788528313.132840:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788528313.132882:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+17:9504:x1875407735394688:12345-0@lo:101: 00010000:00010000:3.0:1788528313.132896:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528313.132910:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c787f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7878 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.132932:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c787f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7878 expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.132950:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c787f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7878 expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.132959:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c13fda00, rc 0) 00000100:00100000:3.0:1788528313.133052:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+18:9504:x1875407735394688:12345-0@lo:101: Request processed in 203us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528313.133058:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788528313.133120:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735394688:0@lo:101: 00010000:00010000:2.0:1788528313.133135:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7878 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c787f expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.133143:0:9504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7878 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c787f expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528313.133194:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735394816:0@lo:501: 00000100:00100000:2.0:1788528313.133217:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528313.133242:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d01b30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528313.133283:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735394816 00000100:00100000:0.0:1788528313.133288:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735394816 00000100:00100000:0.0:1788528313.133318:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788528313.133325:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+18:9504:x1875407735394816:12345-0@lo:501: 00000100:00100000:0.0:1788528313.133412:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+18:9504:x1875407735394816:12345-0@lo:501: Request processed in 88us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528313.133418:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788528313.133501:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735394816:0@lo:501: 00000100:00100000:2.0:1788528313.133524:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735394944:0@lo:503: 00000100:00100000:2.0:1788528313.133708:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528313.133879:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735394944 00000100:00100000:3.0:1788528313.133883:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735394944 00000100:00100000:3.0:1788528313.133907:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788528313.133918:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d9d54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+18:9504:x1875407735394944:12345-0@lo:503: 00000100:00100000:3.0:1788528313.133995:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d9d54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+18:9504:x1875407735394944:12345-0@lo:503: Request processed in 77us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528313.134001:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788528313.134049:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d01b30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528313.134061:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735394944:0@lo:503: 00000040:00080000:3.0:1788528313.134435:0:9504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788528313.134495:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735395072:0@lo:502: 00000100:00100000:3.0:1788528313.134529:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528313.134573:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3d493c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528313.134630:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735395072 00000100:00100000:1.0:1788528313.134635:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735395072 00000100:00100000:1.0:1788528313.134663:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788528313.134670:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+18:9504:x1875407735395072:12345-0@lo:502: 00000100:00100000:1.0:1788528313.134754:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+18:9504:x1875407735395072:12345-0@lo:502: Request processed in 85us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528313.134761:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788528313.135209:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735395072:0@lo:502: 00000040:00080000:3.0:1788528313.135447:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788528313.135475:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788528313.135491:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788528313.135505:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788528313.135518:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788528313.135542:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788528313.135903:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788528313.135924:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788528313.135936:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788528313.135949:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788528313.135962:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788528313.135977:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788528313.135990:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788528313.136004:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788528313.136030:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788528313.136044:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788528313.136057:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788528313.136070:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788528313.136084:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788528313.136098:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788528313.136111:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788528313.136123:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788528313.136135:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788528313.136147:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788528313.136158:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788528313.136169:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788528313.136180:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788528313.136191:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1788528313.136202:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788528313.136214:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1788528313.136225:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1788528313.136235:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1788528313.136246:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1788528313.136256:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1788528313.136267:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1788528313.136278:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1788528313.136290:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1788528313.136301:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1788528313.136325:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1788528313.136338:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1788528313.136350:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1788528313.136362:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1788528313.136374:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1788528313.136387:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1788528313.136401:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1788528313.136413:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1788528313.136445:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735395200:0@lo:502: 00000100:00100000:3.0:1788528313.136503:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528313.136602:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d01b30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528313.138895:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735395200 00000100:00100000:0.0:1788528313.138908:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735395200 00000100:00100000:0.0:1788528313.139025:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788528313.139036:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+18:9504:x1875407735395200:12345-0@lo:502: 00000100:00100000:0.0:1788528313.139202:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+18:9504:x1875407735395200:12345-0@lo:502: Request processed in 169us (2699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528313.139210:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788528313.139301:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735395200:0@lo:502: 00000040:00080000:3.0:1788528313.139378:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1788528313.139392:0:9504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1788528313.140153:0:9520:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788528313.140167:0:9520:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8a90fa608000) 00000020:00000080:3.0:1788528313.140189:0:9520:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1788528313.140286:0:9520:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a8fc1fe4800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788528313.140290:0:9520:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8a8fc1fe4800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788528313.140293:0:9520:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a8fc1fe4800 3 00010000:00080000:3.0:1788528313.140319:0:9520:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a8fc34cd800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.138@tcp at head 00010000:00010000:3.0:1788528313.142108:0:9520:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1788528313.142369:0:9520:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788528313.142409:0:9520:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788528313.142421:0:9520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x892c60dda91c788d 00000100:00080000:3.0:1788528313.142430:0:9520:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788528313.142435:0:9520:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a8fc34cd800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528313.142468:0:9520:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc327e680 x1875407735395328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788528313.142511:0:9520:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788528313.142642:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735395456:0@lo:400: 00000100:00100000:3.0:1788528313.142701:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528313.142733:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1875407735395968:0@lo:400: 00000100:00100000:3.0:1788528313.142754:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528313.142774:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788528313.142780:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735395584:0@lo:400: 00000100:00100000:3.0:1788528313.142804:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528313.142822:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735396096:0@lo:400: 00000100:00100000:3.0:1788528313.142841:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528313.142865:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735395712:0@lo:400: 00000100:00100000:3.0:1788528313.142900:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528313.142918:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735396224:0@lo:400: 00000100:00100000:3.0:1788528313.142939:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528313.142959:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788528313.142965:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735395840:0@lo:400: 00000100:00100000:3.0:1788528313.142985:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528313.143002:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735396352:0@lo:400: 00000100:00100000:3.0:1788528313.143036:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528313.143067:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735395456 00000100:00100000:3.0:1788528313.143074:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735395456 00000100:00100000:3.0:1788528313.143149:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735395968 00000100:00100000:3.0:1788528313.143152:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735395968 00000100:00100000:3.0:1788528313.143175:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735396096 00000100:00100000:3.0:1788528313.143178:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735396096 00000100:00100000:3.0:1788528313.143202:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735395712 00000100:00100000:3.0:1788528313.143205:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735395712 00000100:00100000:3.0:1788528313.143219:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788528313.143226:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735395456:12345-0@lo:400: 00000100:00100000:3.0:1788528313.143270:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735395456:12345-0@lo:400: Request processed in 44us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528313.143277:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788528313.143289:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788528313.143295:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875407735395968:12345-0@lo:400: 00000100:00100000:3.0:1788528313.143319:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875407735395968:12345-0@lo:400: Request processed in 24us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528313.143324:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788528313.143334:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788528313.143339:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735396096:12345-0@lo:400: 00000100:00100000:3.0:1788528313.143361:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735396096:12345-0@lo:400: Request processed in 23us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528313.143367:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788528313.143377:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788528313.143382:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735395712:12345-0@lo:400: 00000100:00100000:3.0:1788528313.143410:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735395712:12345-0@lo:400: Request processed in 27us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528313.143416:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788528313.143434:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735395584 00000100:00100000:3.0:1788528313.143437:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735395584 00000100:00100000:3.0:1788528313.143457:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735395840 00000100:00100000:3.0:1788528313.143459:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735395840 00000100:00100000:3.0:1788528313.143469:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788528313.143474:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735395584:12345-0@lo:400: 00000100:00100000:3.0:1788528313.143511:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735395584:12345-0@lo:400: Request processed in 36us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528313.143517:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788528313.143527:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788528313.143532:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735395840:12345-0@lo:400: 00000100:00100000:3.0:1788528313.143577:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735395840:12345-0@lo:400: Request processed in 45us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528313.143582:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788528313.143606:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735396224 00000100:00100000:3.0:1788528313.143610:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735396224 00000100:00100000:3.0:1788528313.143633:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735396352 00000100:00100000:3.0:1788528313.143636:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735396352 00000100:00100000:3.0:1788528313.143654:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788528313.143660:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735396224:12345-0@lo:400: 00000100:00100000:3.0:1788528313.143687:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735396224:12345-0@lo:400: Request processed in 27us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528313.143693:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788528313.143703:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788528313.143708:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735396352:12345-0@lo:400: 00000100:00100000:3.0:1788528313.143731:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735396352:12345-0@lo:400: Request processed in 24us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528313.143736:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788528313.143757:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788528313.143761:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788528313.143763:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788528313.143796:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735395840:0@lo:400: 00010000:00080000:3.0:1788528313.143808:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a8fc327dc00 x1875407735396352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528313.143824:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735396352:0@lo:400: 00010000:00080000:3.0:1788528313.143835:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a8fc327f480 x1875407735395712/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528313.143842:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735395712:0@lo:400: 00010000:00080000:3.0:1788528313.143849:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a8fc327d880 x1875407735396224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528313.143857:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735396224:0@lo:400: 00000100:00100000:3.0:1788528313.143888:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735395584:0@lo:400: 00010000:00080000:3.0:1788528313.143896:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a8fc327fb80 x1875407735396096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528313.143903:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735396096:0@lo:400: 00010000:00080000:3.0:1788528313.143911:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a8fc327f800 x1875407735395456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528313.143919:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735395456:0@lo:400: 00010000:00080000:3.0:1788528313.143927:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a8fc327f100 x1875407735395968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528313.143934:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1875407735395968:0@lo:400: 00000100:00100000:0.0:1788528313.144087:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1875407735395328:0@lo:38: 00000100:00100000:0.0:1788528313.144123:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528313.145629:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735395328 00000100:00100000:3.0:1788528313.145640:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735395328 00000100:00100000:3.0:1788528313.145675:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788528313.145681:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1875407735395328:12345-0@lo:38: 00010000:00080000:3.0:1788528313.145708:0:6509:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:3.0:1788528313.145747:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x892c60dda91c7894 00000004:00100000:3.0:1788528313.145761:0:6509:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788528313.145793:0:6509:0:(import.c:65:import_set_state_nolock()) ffff8a8fc34cc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788528313.145860:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875407735395328:12345-0@lo:38: Request processed in 178us (1736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528313.145867:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788528313.145923:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a8fc327e680 x1875407735395328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788528323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528313.145935:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788528313.145942:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788528313.145950:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788528313.145955:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788528313.145957:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc34cd800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788528313.145962:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1875407735395328:0@lo:38: 00000020:01000004:3.0:1788528313.146617:0:9520:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788528313.146640:0:9520:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8a8fc35e4c80) 00000020:00000080:3.0:1788528313.146660:0:9520:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:3.0:1788528313.146744:0:9520:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a8fc1fe4800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788528313.146748:0:9520:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8a8fc1fe4800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788528313.146751:0:9520:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a8fc1fe4800 3 00010000:00080000:3.0:1788528313.146777:0:9520:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a8fc34cf800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.138@tcp at head 00010000:00010000:3.0:1788528313.148925:0:9520:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000100:00100000:2.0:1788528313.150923:0:9521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9521:1875407735396480:0@lo:901: 00000100:00100000:2.0:1788528313.150988:0:9521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528313.151035:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735396480 00000100:00100000:2.0:1788528313.151037:0:9521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3a94cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528313.151043:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735396480 00000100:00080000:2.0:1788528313.151074:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788528313.151096:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788528313.151105:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9521:x1875407735396480:12345-0@lo:901: 00000100:00100000:0.0:1788528313.151190:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9521:x1875407735396480:12345-0@lo:901: Request processed in 86us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528313.151196:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:00000080:3.0:1788528313.151519:0:9520:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788528313.151577:0:9520:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788528313.151587:0:9520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x892c60dda91c78a2 00000100:00080000:3.0:1788528313.151594:0:9520:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788528313.151598:0:9520:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8a8fc34cf800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528313.151625:0:9520:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90f5a0e300 x1875407735396608/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788528313.151645:0:9520:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788528313.152218:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1875407735396608:0@lo:38: 00000100:00100000:2.0:1788528313.152270:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528313.152368:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735396608 00000100:00100000:3.0:1788528313.152373:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735396608 00000100:00100000:3.0:1788528313.152436:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788528313.152441:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1875407735396608:12345-0@lo:38: 00010000:00080000:3.0:1788528313.152462:0:6508:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:3.0:1788528313.152500:0:6508:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x892c60dda91c78a9 00000004:00100000:3.0:1788528313.152515:0:6508:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788528313.152542:0:6508:0:(import.c:65:import_set_state_nolock()) ffff8a8fc34cc800 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1788528313.152571:0:9521:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a8fc30ace00 x1875407735396480/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788528329 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528313.152585:0:9521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9521:1875407735396480:0@lo:901: 00000100:00100000:3.0:1788528313.152601:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875407735396608:12345-0@lo:38: Request processed in 158us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528313.152607:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788528313.152692:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f5a0e300 x1875407735396608/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788528323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528313.152699:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788528313.152705:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788528313.152711:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788528313.152715:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788528313.152717:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc34cf800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788528313.152722:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1875407735396608:0@lo:38: 00000040:00080000:3.0:1788528313.152821:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:0.0:1788528313.152940:0:9504:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1788528313.152954:0:9504:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788528313.152967:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7878 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c787f expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528313.152977:0:9504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7878 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c787f expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788528313.153034:0:9504:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788528313.153036:0:9504:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788528313.153038:0:9504:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788528313.153039:0:9504:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788528313.153040:0:9504:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788528313.153042:0:9504:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788528313.153044:0:9504:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788528313.153045:0:9504:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788528313.153047:0:9504:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788528313.153048:0:9504:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788528313.153049:0:9504:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788528313.153063:0:9504:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788528313.153066:0:9504:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788528313.153067:0:9504:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788528313.153068:0:9504:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788528313.153069:0:9504:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788528313.153070:0:9504:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788528313.153071:0:9504:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788528313.153072:0:9504:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788528313.153073:0:9504:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788528313.153074:0:9504:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788528313.153075:0:9504:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788528313.153076:0:9504:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788528313.153091:0:9504:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788528313.153100:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735396736:0@lo:253: 00000100:00100000:0.0:1788528313.153135:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528313.153160:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735396736 00000100:00100000:0.0:1788528313.153164:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735396736 00000100:00100000:0.0:1788528313.153191:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788528313.153198:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+18:9504:x1875407735396736:12345-0@lo:253: 20000000:01000000:0.0:1788528313.153218:0:6502:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788528313.153231:0:6502:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788528313.153327:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc31640c0 going to sleep for 11 seconds 20000000:01000000:1.0:1788528313.167887:0:6502:0:(mgs_nids.c:820:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788528313.167910:0:6502:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788528313.168055:0:6524:0:(mgs_nids.c:717:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788528313.168060:0:6524:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788528313.168083:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a9101850800/0x892c60dda91c78b0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.168100:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9101851e00/0x892c60dda91c7798 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7791 expref: 18 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.168125:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90f6e17400/0x892c60dda91c77ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c77e5 expref: 18 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.168133:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a9101850800/0x892c60dda91c78b0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.168170:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90f6e17400/0x892c60dda91c77ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c77e5 expref: 18 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.168183:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a90f6e17400/0x892c60dda91c77ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c77e5 expref: 18 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528313.168198:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30adc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6524:1875407735396864:0@lo:104: 00000100:00100000:2.0:1788528313.168264:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788528313.168318:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9101851e00/0x892c60dda91c7798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c7791 expref: 18 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.168327:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9101851e00/0x892c60dda91c7798 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c7791 expref: 18 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528313.168327:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+18:9504:x1875407735396736:12345-0@lo:253: Request processed in 15128us (15191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528313.168335:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6524:1875407735396992:0@lo:104: 00000100:00100000:1.0:1788528313.168338:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788528313.168355:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528313.168369:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ee4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788528313.168396:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735396864 00000100:00100000:0.0:1788528313.168404:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735396864 00000100:00100000:3.0:1788528313.168459:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735396992 00000100:00100000:3.0:1788528313.168463:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735396992 00000100:00100000:0.0:1788528313.168472:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788528313.168484:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+4:6524:x1875407735396864:12345-0@lo:104: 00010000:00010000:0.0:1788528313.168499:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c1551800/0x892c60dda91c77e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c77ec expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528313.168530:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788528313.168546:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dd052447-840d-4bcc-891b-140c465c7625+4:6524:x1875407735396992:12345-0@lo:104: 00010000:00010000:3.0:1788528313.168572:0:8437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16400/0x892c60dda91c7791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7798 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528313.168819:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1788528313.168824:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788528313.168829:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+4:6524:x1875407735396864:12345-0@lo:104: Request processed in 345us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528313.168831:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30adc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6524:1875407735396864:0@lo:104: 00000100:00100000:3.0:1788528313.168833:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dd052447-840d-4bcc-891b-140c465c7625+4:6524:x1875407735396992:12345-0@lo:104: Request processed in 288us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528313.168843:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6524:1875407735396992:0@lo:104: 00000100:00100000:0.0:1788528313.168848:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788528313.168861:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1788528313.168863:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a9101850800/0x892c60dda91c78b0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.168885:0:6496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788528313.168890:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c1551800/0x892c60dda91c77e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c77ec expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.168898:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c1551800 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:3.0:1788528313.168903:0:6496:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c1551800/0x892c60dda91c77e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c77ec expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.168912:0:6496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c1551800/0x892c60dda91c77e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c77ec expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528313.168913:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd052447-840d-4bcc-891b-140c465c7625:9504:1875407735396736:0@lo:253: 10000000:00010000:3.0:1788528313.168926:0:6496:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c1551800/0x892c60dda91c77e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c77ec expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528313.168930:0:6496:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788528313.168930:0:9504:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788528313.168935:0:9504:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788528313.168937:0:9504:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788528313.168939:0:9504:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788528313.168940:0:9504:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788528313.168941:0:9504:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788528313.168943:0:9504:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788528313.168945:0:9504:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788528313.168946:0:9504:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788528313.168948:0:9504:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788528313.168950:0:9504:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788528313.168951:0:9504:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:3.0:1788528313.168962:0:6496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c1551800/0x892c60dda91c77e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c77ec expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:0.0:1788528313.168965:0:9504:0:(tgt_mount.c:2815:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788528313.168973:0:6496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788528313.168992:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c1551800/0x892c60dda91c77e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c77ec expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528313.169002:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735397120:0@lo:103: 00010000:00010000:3.0:1788528313.169020:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c1551800/0x892c60dda91c77e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c77ec expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528313.169039:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528313.169078:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735397120 00000100:00100000:2.0:1788528313.169081:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735397120 00010000:00010000:3.0:1788528313.169084:0:6496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528313.169088:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16400/0x892c60dda91c7791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7798 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.169093:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16400 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:3.0:1788528313.169096:0:6496:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16400/0x892c60dda91c7791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c7798 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.169104:0:6496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16400/0x892c60dda91c7791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c7798 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788528313.169110:0:6496:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16400/0x892c60dda91c7791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c7798 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528313.169114:0:6496:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788528313.169134:0:6496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16400/0x892c60dda91c7791 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7798 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.169140:0:6496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788528313.169150:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16400/0x892c60dda91c7791 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7798 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.169156:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16400/0x892c60dda91c7791 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7798 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.169167:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528313.169175:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528313.169177:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528313.169182:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90f6e17400/0x892c60dda91c77ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c77e5 expref: 18 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528313.169186:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735397248:0@lo:103: 00000100:00100000:2.0:1788528313.169210:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788528313.169212:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528313.169238:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735397248 00000100:00100000:3.0:1788528313.169242:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735397248 00010000:00010000:3.0:1788528313.169254:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9101851e00/0x892c60dda91c7798 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7791 expref: 19 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528313.169272:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788528313.169277:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd052447-840d-4bcc-891b-140c465c7625+19:3640:x1875407735397248:12345-0@lo:103: 00000100:00100000:2.0:1788528313.169277:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+19:3639:x1875407735397120:12345-0@lo:103: 00010000:00010000:3.0:1788528313.169286:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528313.169286:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528313.169291:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9101851e00/0x892c60dda91c7798 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7791 expref: 19 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.169292:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90f6e17400/0x892c60dda91c77ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c77e5 expref: 19 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.169302:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90f6e17400/0x892c60dda91c77ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c77e5 expref: 19 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.169312:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9101851e00/0x892c60dda91c7798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c7791 expref: 19 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.169325:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90f6e17400/0x892c60dda91c77ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c77e5 expref: 19 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528313.169328:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101851e00/0x892c60dda91c7798 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c7791 expref: 19 pid: 6500 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.169337:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a9101850800/0x892c60dda91c78b0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.169346:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101850800/0x892c60dda91c78b0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528313.169346:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528313.169356:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 20000000:01000000:2.0:1788528313.169361:0:6495:0:(mgs_nids.c:693:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008887761s 00010000:00010000:2.0:1788528313.169364:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9101850800/0x892c60dda91c78b0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.169381:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9101850800/0x892c60dda91c78b0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.169389:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a9101850800/0x892c60dda91c78b0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.169395:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a9101850800/0x892c60dda91c78b0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.169400:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850800 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528313.169405:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a9101850800/0x892c60dda91c78b0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.169413:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a9101850800/0x892c60dda91c78b0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.169425:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a9101850800/0x892c60dda91c78b0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.169434:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528313.169435:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd052447-840d-4bcc-891b-140c465c7625+17:3640:x1875407735397248:12345-0@lo:103: Request processed in 156us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528313.169442:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788528313.169455:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+16:3639:x1875407735397120:12345-0@lo:103: Request processed in 240us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528313.169461:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788528313.169469:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735397120:0@lo:103: 00010000:00010000:2.0:1788528313.169479:0:6524:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a9101850800/0x892c60dda91c78b0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.169486:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a9101850800/0x892c60dda91c78b0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528313.169493:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101850800/0x892c60dda91c78b0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528313.169510:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735397248:0@lo:103: 00080000:10000000:3.0:1788528313.174888:0:9504:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788528313.175069:0:9504:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788528313.175251:0:9504:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788528313.175373:0:9504:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788528313.175528:0:9504:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788528313.175819:0:9504:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1788528313.176433:0:9504:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788528313.182485:0:9504:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788528313.182495:0:9504:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788528313.182533:0:9504:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788528313.182693:0:9504:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788528313.183538:0:9504:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788528313.183748:0:9504:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788528313.470942:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528313.534765:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735397376:0@lo:13: 00000100:00100000:3.0:1788528313.534838:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528313.534900:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735397376 00000100:00100000:1.0:1788528313.534917:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735397376 00000100:00100000:1.0:1788528313.534967:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788528313.534975:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735397376:12345-0@lo:13: 00002000:00000024:1.0:1788528313.535028:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788528313.535903:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788528313.535916:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735397504:0@lo:13: 00000100:00100000:3.0:1788528313.535954:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528313.535991:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1788528313.535999:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1788528313.536171:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735397504 00010000:00080000:0.0:1788528313.536405:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6f08380 x1875407735397376/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528313.536425:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735397376:0@lo:13: 00000100:00100000:3.0:1788528313.536501:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735397504 00000100:00100000:3.0:1788528313.536620:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788528313.536629:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735397376:12345-0@lo:13: Request processed in 1652us (1789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528313.536631:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735397504:12345-0@lo:13: 00000100:00100000:1.0:1788528313.536645:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00002000:00000024:3.0:1788528313.536655:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788528313.536702:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735397504:12345-0@lo:13: Request processed in 74us (747us total) trans 0 rc 0/0 00010000:00080000:0.0:1788528313.536951:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6f0b100 x1875407735397504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528313.536964:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735397504:0@lo:13: 00000100:00100000:3.0:1788528313.537032:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000020:00000004:3.0:1788528313.874440:0:9577:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788528313.875133:0:9577:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788528314.495945:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528314.562440:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788528314.574390:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735397632:0@lo:41: 00000100:00100000:2.0:1788528314.574492:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528314.578400:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735397632 00000100:00100000:1.0:1788528314.578419:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735397632 00000100:00100000:1.0:1788528314.578499:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788528314.578512:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735397632:12345-0@lo:41: 00000004:00000024:1.0:1788528314.578588:0:9268:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446502400 avail 1300262912 00000100:00100000:1.0:1788528314.578702:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735397632:12345-0@lo:41: Request processed in 192us (4209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528314.578710:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788528314.579527:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735397632:0@lo:41: 00010000:00010000:3.0:1788528315.519915:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528316.542676:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528317.567219:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528317.631359:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735397760:0@lo:41: 00000100:00100000:2.0:1788528317.631431:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528317.631686:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735397760 00000100:00100000:1.0:1788528317.631694:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735397760 00000100:00100000:1.0:1788528317.631744:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788528317.631753:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735397760:12345-0@lo:41: 00000004:00000024:1.0:1788528317.631785:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1788528317.631844:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735397760:12345-0@lo:41: Request processed in 92us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528317.631851:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788528317.632006:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735397760:0@lo:41: 00010000:00010000:0.0:1788528318.598452:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528318.657919:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735398144:0@lo:400: 00000100:00100000:3.0:1788528318.658007:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528318.658054:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735398656:0@lo:400: 00000100:00100000:3.0:1788528318.658078:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528318.658095:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735399168:0@lo:400: 00000100:00100000:3.0:1788528318.658115:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528318.658136:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788528318.658142:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735398272:0@lo:400: 00000100:00100000:3.0:1788528318.658160:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528318.658174:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735398784:0@lo:400: 00000100:00100000:3.0:1788528318.658195:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528318.658226:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735398144 00000100:00100000:3.0:1788528318.658233:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735398144 00000100:00100000:3.0:1788528318.658275:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788528318.658284:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735398144:12345-0@lo:400: 00000100:00100000:3.0:1788528318.658330:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735398144:12345-0@lo:400: Request processed in 46us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528318.658336:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788528318.658357:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735398656 00000100:00100000:3.0:1788528318.658360:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735398656 00000100:00100000:3.0:1788528318.658388:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735399168 00000100:00100000:3.0:1788528318.658391:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735399168 00000100:00100000:3.0:1788528318.658402:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735398272 00000100:00100000:3.0:1788528318.658404:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735398272 00000100:00100000:3.0:1788528318.658416:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788528318.658421:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735398656:12345-0@lo:400: 00000100:00100000:3.0:1788528318.658446:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735398656:12345-0@lo:400: Request processed in 25us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528318.658462:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788528318.658474:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788528318.658480:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735399168:12345-0@lo:400: 00000100:00100000:3.0:1788528318.658518:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735399168:12345-0@lo:400: Request processed in 38us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528318.658523:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788528318.658533:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788528318.658538:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735398272:12345-0@lo:400: 00000100:00100000:3.0:1788528318.658584:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735398272:12345-0@lo:400: Request processed in 46us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528318.658590:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788528318.658609:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735398784 00000100:00100000:3.0:1788528318.658611:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735398784 00000100:00100000:3.0:1788528318.658634:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788528318.658640:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735398784:12345-0@lo:400: 00000100:00100000:3.0:1788528318.658665:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735398784:12345-0@lo:400: Request processed in 26us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528318.658671:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788528318.658702:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc327dc00 x1875407735398272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528318.658715:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735398272:0@lo:400: 00010000:00080000:3.0:1788528318.658725:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f5a0ad80 x1875407735398784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528318.658734:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735398784:0@lo:400: 00000100:00100000:3.0:1788528318.658742:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735398144:0@lo:400: 00010000:00080000:3.0:1788528318.658757:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f5a0e300 x1875407735398656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528318.658766:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735398656:0@lo:400: 00010000:00080000:3.0:1788528318.658774:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3c7ce00 x1875407735399168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528318.658782:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735399168:0@lo:400: 00000100:00100000:1.0:1788528318.658881:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735397888:0@lo:400: 00000100:00100000:1.0:1788528318.658913:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528318.658941:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735398400:0@lo:400: 00000100:00100000:1.0:1788528318.658983:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528318.658999:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735398912:0@lo:400: 00000100:00100000:1.0:1788528318.659016:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528318.659032:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788528318.659037:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735398016:0@lo:400: 00000100:00100000:1.0:1788528318.659055:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528318.659067:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735398528:0@lo:400: 00000100:00100000:1.0:1788528318.659084:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528318.659096:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1875407735399040:0@lo:400: 00000100:00100000:1.0:1788528318.659117:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528318.659213:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735398016 00000100:00100000:2.0:1788528318.659218:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735398016 00000100:00100000:2.0:1788528318.659237:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735398528 00000100:00100000:2.0:1788528318.659240:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735398528 00000100:00100000:2.0:1788528318.659250:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735399040 00000100:00100000:2.0:1788528318.659252:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735399040 00000100:00100000:2.0:1788528318.659264:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788528318.659270:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735398016:12345-0@lo:400: 00000100:00100000:2.0:1788528318.659307:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735398016:12345-0@lo:400: Request processed in 37us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528318.659313:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788528318.659324:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788528318.659329:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735398528:12345-0@lo:400: 00000100:00100000:2.0:1788528318.659351:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735398528:12345-0@lo:400: Request processed in 22us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528318.659357:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788528318.659365:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788528318.659371:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875407735399040:12345-0@lo:400: 00000100:00100000:2.0:1788528318.659401:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875407735399040:12345-0@lo:400: Request processed in 30us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528318.659406:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788528318.659420:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788528318.659424:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788528318.659427:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788528318.659434:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735398400 00000100:00100000:2.0:1788528318.659437:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735398400 00000100:00100000:2.0:1788528318.659457:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788528318.659463:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735398400:12345-0@lo:400: 00000100:00100000:2.0:1788528318.659489:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735398400:12345-0@lo:400: Request processed in 26us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528318.659495:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788528318.659519:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc327d880 x1875407735398016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528318.659529:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735398016:0@lo:400: 00010000:00080000:2.0:1788528318.659537:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc327e680 x1875407735398528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528318.659545:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735398528:0@lo:400: 00010000:00080000:2.0:1788528318.659573:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3c7d180 x1875407735399040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528318.659582:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1875407735399040:0@lo:400: 00000100:00100000:2.0:1788528318.659591:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735398400:0@lo:400: 00000100:00100000:1.0:1788528318.664085:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735398912 00000100:00100000:1.0:1788528318.664105:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735398912 00000100:00100000:1.0:1788528318.664181:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788528318.664191:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735398912:12345-0@lo:400: 00000100:00100000:0.0:1788528318.664248:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788528318.664261:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735399296:0@lo:13: 00000100:00100000:1.0:1788528318.664265:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735398912:12345-0@lo:400: Request processed in 76us (5248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528318.664271:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788528318.664293:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735397888 00000100:00100000:1.0:1788528318.664297:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735397888 00000100:00100000:0.0:1788528318.664298:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528318.664320:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788528318.664326:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+16:3637:x1875407735397888:12345-0@lo:400: 00000100:00100000:0.0:1788528318.664326:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788528318.664333:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735399424:0@lo:13: 00000100:00100000:0.0:1788528318.664355:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528318.664356:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+16:3637:x1875407735397888:12345-0@lo:400: Request processed in 31us (5443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528318.664363:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788528318.664376:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735399296 00000100:00100000:0.0:1788528318.664393:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735399296 00000100:00100000:0.0:1788528318.664424:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735399424 00000100:00100000:0.0:1788528318.664426:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735399424 00000100:00100000:1.0:1788528318.664434:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788528318.664516:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735399296:12345-0@lo:13: 00002000:00000024:1.0:1788528318.664544:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788528318.664603:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735399296:12345-0@lo:13: Request processed in 162us (304us total) trans 0 rc 0/0 00010000:00080000:3.0:1788528318.664660:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6f08380 x1875407735399296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528318.664678:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735399296:0@lo:13: 00000100:00100000:0.0:1788528318.664685:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788528318.664691:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735399424:12345-0@lo:13: 00002000:00000024:0.0:1788528318.664701:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788528318.664741:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735399424:12345-0@lo:13: Request processed in 51us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528318.664747:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788528318.664779:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735397888:0@lo:400: 00010000:00080000:0.0:1788528318.664790:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3c7ca80 x1875407735398912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528318.664799:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735398912:0@lo:400: 00010000:00080000:3.0:1788528318.666883:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6f0bb80 x1875407735399424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528318.666908:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735399424:0@lo:13: 00000100:00100000:1.0:1788528318.667095:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788528318.667760:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788528319.620619:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528319.681669:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735399552:0@lo:41: 00000100:00100000:2.0:1788528319.681733:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528319.681811:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735399552 00000100:00100000:2.0:1788528319.681818:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735399552 00000100:00100000:2.0:1788528319.681858:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788528319.681866:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735399552:12345-0@lo:41: 00000004:00000024:2.0:1788528319.681897:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446502400 avail 1300262912 00000100:00100000:2.0:1788528319.681938:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735399552:12345-0@lo:41: Request processed in 72us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528319.681945:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788528319.681997:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735399552:0@lo:41: 00000001:02000400:0.0:1788528320.272400:0:9867:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788528320.638691:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788528321.310236:0:9919:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788528321.311861:0:9919:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788528321.666957:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788528322.238672:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788528322.238680:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff8a90fa76f800 from 39 10000000:01000000:2.0:1788528322.238685:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788528322.238730:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c78b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528322.238742:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c78b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528322.238753:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c78b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528322.238775:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735399680:0@lo:101: 00000100:00100000:2.0:1788528322.238840:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528322.238898:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c7849e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788528322.240383:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735399680 00000100:00100000:1.0:1788528322.240396:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735399680 00000100:00100000:1.0:1788528322.240452:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788528322.240460:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+16:6506:x1875407735399680:12345-0@lo:101: 00010000:00010000:1.0:1788528322.240476:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528322.240492:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90f6e17200/0x892c60dda91c78be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c78b7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528322.240518:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90f6e17200/0x892c60dda91c78be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c78b7 expref: 17 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528322.240529:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90f6e17200/0x892c60dda91c78be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c78b7 expref: 17 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528322.240538:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e17200, rc 0) 00000100:00100000:1.0:1788528322.240636:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+17:6506:x1875407735399680:12345-0@lo:101: Request processed in 176us (1794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528322.240643:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788528322.240986:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735399680:0@lo:101: 00010000:00010000:2.0:1788528322.241007:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c78b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c78be expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528322.241035:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c78b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c78be expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788528322.242474:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788528322.242815:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788528322.242981:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788528322.243007:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 120 off8536 00000040:00080000:2.0:1788528322.243020:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 168 off8704 00000040:00080000:2.0:1788528322.243034:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8928 00000040:00080000:2.0:1788528322.243047:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9152 00000040:00080000:2.0:1788528322.243059:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 120 off9272 00000040:00080000:2.0:1788528322.243094:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 168 off9440 00000040:00080000:2.0:1788528322.243108:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].8, 224 off9664 00000040:00080000:2.0:1788528322.243133:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].9, 224 off9888 00000040:00080000:2.0:1788528322.243150:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].10, 120 off10008 00000040:00080000:2.0:1788528322.243163:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].11, 224 off10232 00000040:00080000:2.0:1788528322.243176:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].12, 224 off10456 00000040:00080000:2.0:1788528322.243188:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].13, 88 off10544 00000040:00080000:2.0:1788528322.243201:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].14, 128 off10672 00000040:00080000:2.0:1788528322.243213:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].15, 144 off10816 00000040:00080000:2.0:1788528322.243226:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].16, 160 off10976 00000040:00080000:2.0:1788528322.243239:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].17, 224 off11200 00000040:00080000:2.0:1788528322.243250:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].18, 224 off11424 00000040:00080000:2.0:1788528322.243261:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].19, 80 off11504 00000040:00080000:2.0:1788528322.243274:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].20, 224 off11728 00000040:00080000:2.0:1788528322.243288:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].21, 224 off11952 00000040:00080000:2.0:1788528322.243299:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].22, 88 off12040 00000040:00080000:2.0:1788528322.243314:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].23, 128 off12168 00000040:00080000:2.0:1788528322.243328:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].24, 144 off12312 00000040:00080000:2.0:1788528322.243342:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].25, 160 off12472 00000040:00080000:2.0:1788528322.243354:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].26, 224 off12696 00000040:00080000:2.0:1788528322.243381:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].27, 224 off12920 00000040:00080000:2.0:1788528322.243396:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].28, 80 off13000 00000040:00080000:2.0:1788528322.243409:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].29, 224 off13224 00000040:00080000:2.0:1788528322.243422:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].30, 224 off13448 00000040:00080000:2.0:1788528322.243436:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].31, 88 off13536 00000040:00080000:2.0:1788528322.243449:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].32, 128 off13664 00000040:00080000:2.0:1788528322.243460:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].33, 144 off13808 00000040:00080000:2.0:1788528322.243473:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].34, 128 off13936 00000040:00080000:2.0:1788528322.243486:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].35, 224 off14160 00000040:00080000:2.0:1788528322.243498:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].36, 224 off14384 00000040:00080000:2.0:1788528322.243511:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].37, 80 off14464 00000040:00080000:2.0:1788528322.243534:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].38, 224 off14688 00000040:00080000:2.0:1788528322.243539:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788528322.243645:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735399808:0@lo:501: 00000100:00100000:2.0:1788528322.243709:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528322.243747:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c7849e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788528322.246493:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735399808 00000100:00100000:0.0:1788528322.246507:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735399808 00000100:00100000:0.0:1788528322.246642:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788528322.246653:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+17:6506:x1875407735399808:12345-0@lo:501: 00000100:00100000:0.0:1788528322.246810:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+17:6506:x1875407735399808:12345-0@lo:501: Request processed in 159us (3100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528322.246817:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788528322.246901:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735399808:0@lo:501: 00000100:00100000:2.0:1788528322.246965:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735399936:0@lo:503: 00000100:00100000:2.0:1788528322.247021:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528322.248361:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c7849e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788528322.251004:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735399936 00000100:00100000:1.0:1788528322.251020:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735399936 00000100:00100000:1.0:1788528322.251082:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788528322.251152:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+17:6506:x1875407735399936:12345-0@lo:503: 00000100:00100000:1.0:1788528322.251618:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+17:6506:x1875407735399936:12345-0@lo:503: Request processed in 526us (4595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528322.251635:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788528322.251922:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735399936:0@lo:503: 00000040:00080000:3.0:1788528322.252844:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788528322.252922:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735400064:0@lo:502: 00000100:00100000:3.0:1788528322.253070:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528322.253180:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1c8f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788528322.253425:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735400064 00000100:00100000:0.0:1788528322.253432:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735400064 00000100:00100000:0.0:1788528322.253479:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788528322.253488:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+17:6506:x1875407735400064:12345-0@lo:502: 00000100:00100000:0.0:1788528322.253634:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+17:6506:x1875407735400064:12345-0@lo:502: Request processed in 147us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528322.253641:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788528322.253877:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735400064:0@lo:502: 00000040:00080000:3.0:1788528322.254222:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788528322.254580:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 120 off8536 00000040:00080000:3.0:1788528322.254594:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 168 off8704 00000040:00080000:3.0:1788528322.254607:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8928 00000040:00080000:3.0:1788528322.254630:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9152 00000040:00080000:3.0:1788528322.254641:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 120 off9272 00000040:00080000:3.0:1788528322.254652:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 168 off9440 00000040:00080000:3.0:1788528322.254662:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9664 00000040:00080000:3.0:1788528322.254672:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 224 off9888 00000040:00080000:3.0:1788528322.254682:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 120 off10008 00000040:00080000:3.0:1788528322.254692:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10232 00000040:00080000:3.0:1788528322.254702:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 224 off10456 00000040:00080000:3.0:1788528322.254712:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 88 off10544 00000040:00080000:3.0:1788528322.254722:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].14, 128 off10672 00000040:00080000:3.0:1788528322.254732:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].15, 144 off10816 00000040:00080000:3.0:1788528322.254741:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].16, 160 off10976 00000040:00080000:3.0:1788528322.254751:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].17, 224 off11200 00000040:00080000:3.0:1788528322.254763:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].18, 224 off11424 00000040:00080000:3.0:1788528322.254774:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].19, 80 off11504 00000040:00080000:3.0:1788528322.254786:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].20, 224 off11728 00000040:00080000:3.0:1788528322.254799:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].21, 224 off11952 00000040:00080000:3.0:1788528322.254811:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].22, 88 off12040 00000040:00080000:3.0:1788528322.254824:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].23, 128 off12168 00000040:00080000:3.0:1788528322.254836:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].24, 144 off12312 00000040:00080000:3.0:1788528322.254850:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].25, 160 off12472 00000040:00080000:3.0:1788528322.254864:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].26, 224 off12696 00000040:00080000:3.0:1788528322.254877:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].27, 224 off12920 00000040:00080000:3.0:1788528322.254891:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].28, 80 off13000 00000040:00080000:3.0:1788528322.254903:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].29, 224 off13224 00000040:00080000:3.0:1788528322.254916:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].30, 224 off13448 00000040:00080000:3.0:1788528322.255038:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].31, 88 off13536 00000040:00080000:3.0:1788528322.255057:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].32, 128 off13664 00000040:00080000:3.0:1788528322.255072:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].33, 144 off13808 00000040:00080000:3.0:1788528322.255085:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].34, 128 off13936 00000040:00080000:3.0:1788528322.255325:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].35, 224 off14160 00000040:00080000:3.0:1788528322.255346:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].36, 224 off14384 00000040:00080000:3.0:1788528322.255359:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].37, 80 off14464 00000040:00080000:3.0:1788528322.255381:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].38, 224 off14688 00000040:00080000:3.0:1788528322.255394:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].39, 224 off14912 00000040:00080000:3.0:1788528322.255406:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].40, 88 off15000 00000040:00080000:3.0:1788528322.255417:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].41, 128 off15128 00000040:00080000:3.0:1788528322.255431:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].42, 144 off15272 00000040:00080000:3.0:1788528322.255443:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].43, 128 off15400 00000040:00080000:3.0:1788528322.255455:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].44, 224 off15624 00000040:00080000:3.0:1788528322.255467:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].45, 224 off15848 00000040:00080000:3.0:1788528322.255480:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].46, 80 off15928 00000100:00100000:3.0:1788528322.255515:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735400192:0@lo:502: 00000100:00100000:3.0:1788528322.255595:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528322.255690:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1c8f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788528322.255788:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735400192 00000100:00100000:2.0:1788528322.255797:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735400192 00000100:00100000:2.0:1788528322.255878:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788528322.255888:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+17:6506:x1875407735400192:12345-0@lo:502: 00000100:00100000:2.0:1788528322.256024:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+17:6506:x1875407735400192:12345-0@lo:502: Request processed in 137us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528322.256032:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788528322.256109:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735400192:0@lo:502: 00000040:00080000:3.0:1788528322.256154:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].47, 224 off16152 00000040:00080000:3.0:1788528322.256163:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000040:00080000:3.0:1788528322.257038:0:9971:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 48 count 48 00000020:01000000:1.0:1788528322.257200:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1788528322.257221:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788528322.257244:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c78b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c78be expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528322.257254:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c78b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c78be expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528322.257266:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788528322.257269:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788528322.257271:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788528322.257302:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c78c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528322.257310:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c78c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528322.257318:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c78c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528322.257335:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6feea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735400320:0@lo:101: 00000100:00100000:1.0:1788528322.257377:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528322.260536:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90fbeae300 going to sleep for 11 seconds 00000100:00100000:0.0:1788528322.260771:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735400320 00000100:00100000:0.0:1788528322.260781:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735400320 00000100:00100000:0.0:1788528322.260834:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788528322.260843:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+17:6506:x1875407735400320:12345-0@lo:101: 00010000:00010000:0.0:1788528322.260858:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528322.260878:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc26e2200/0x892c60dda91c78cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c78c5 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528322.260905:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc26e2200/0x892c60dda91c78cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c78c5 expref: 18 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528322.260916:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc26e2200/0x892c60dda91c78cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c78c5 expref: 18 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528322.260924:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e2200, rc 0) 00000100:00100000:0.0:1788528322.261005:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735400320:12345-0@lo:101: Request processed in 163us (3626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528322.261011:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788528322.261183:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6feea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735400320:0@lo:101: 00010000:00010000:1.0:1788528322.261200:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c78c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c78cc expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528322.261218:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c78c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c78cc expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788528322.261415:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788528322.261675:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788528322.261876:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788528322.261902:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 128 off8544 00000040:00080000:1.0:1788528322.261917:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 112 off8656 00000040:00080000:1.0:1788528322.261951:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].4, 224 off8880 00000040:00080000:1.0:1788528322.261969:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].5, 224 off9104 00000040:00080000:1.0:1788528322.261984:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].6, 80 off9184 00000040:00080000:1.0:1788528322.262002:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].7, 224 off9408 00000040:00080000:1.0:1788528322.262007:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788528322.262064:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6feea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735400448:0@lo:501: 00000100:00100000:1.0:1788528322.262104:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528322.262141:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90fbeae300 going to sleep for 11 seconds 00000100:00100000:0.0:1788528322.262766:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735400448 00000100:00100000:0.0:1788528322.262773:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735400448 00000100:00100000:0.0:1788528322.262801:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788528322.262808:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735400448:12345-0@lo:501: 00000100:00100000:0.0:1788528322.262979:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735400448:12345-0@lo:501: Request processed in 118us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528322.262987:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788528322.263073:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6feea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735400448:0@lo:501: 00000100:00100000:1.0:1788528322.263115:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6feea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735400576:0@lo:503: 00000100:00100000:1.0:1788528322.263153:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528322.263181:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90fbeae300 going to sleep for 11 seconds 00000100:00100000:0.0:1788528322.263512:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735400576 00000100:00100000:0.0:1788528322.263517:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735400576 00000100:00100000:0.0:1788528322.263539:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788528322.263545:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735400576:12345-0@lo:503: 00000100:00100000:0.0:1788528322.263656:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735400576:12345-0@lo:503: Request processed in 109us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528322.263662:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788528322.263822:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6feea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735400576:0@lo:503: 00000040:00080000:1.0:1788528322.264484:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788528322.264768:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6feea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735400704:0@lo:502: 00000100:00100000:1.0:1788528322.264819:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528322.264855:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90fbeae300 going to sleep for 11 seconds 00000100:00100000:0.0:1788528322.264908:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735400704 00000100:00100000:0.0:1788528322.264913:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735400704 00000100:00100000:0.0:1788528322.265060:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788528322.265070:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735400704:12345-0@lo:502: 00000100:00100000:0.0:1788528322.265175:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735400704:12345-0@lo:502: Request processed in 107us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528322.265182:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788528322.265450:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6feea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735400704:0@lo:502: 00000040:00080000:1.0:1788528322.265755:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788528322.265785:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 00000040:00080000:1.0:1788528322.265799:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1788528322.265820:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788528322.265846:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1788528322.265861:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1788528322.265873:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 00000040:00080000:1.0:1788528322.265885:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1788528322.265898:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000100:00100000:1.0:1788528322.265921:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6feea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735400832:0@lo:502: 00000100:00100000:1.0:1788528322.266370:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528322.266440:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90fbeae300 going to sleep for 11 seconds 00000100:00100000:2.0:1788528322.266471:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735400832 00000100:00100000:2.0:1788528322.266478:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735400832 00000100:00100000:2.0:1788528322.266584:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788528322.266593:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735400832:12345-0@lo:502: 00000100:00100000:2.0:1788528322.266697:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735400832:12345-0@lo:502: Request processed in 104us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528322.266704:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788528322.266782:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6feea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735400832:0@lo:502: 00000040:00080000:1.0:1788528322.266830:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 00000040:00080000:1.0:1788528322.266839:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788528322.267793:0:9972:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528322.267803:0:9972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528322.267805:0:9972:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788528322.267810:0:9972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788528322.267812:0:9972:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788528322.267817:0:9972:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528322.267820:0:9972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528322.267821:0:9972:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788528322.267824:0:9972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1788528322.267934:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788528322.267953:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788528322.267964:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c78c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c78cc expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528322.267975:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c78c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c78cc expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528322.267985:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788528322.267987:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff8a90fa76f800 from 1 10000000:01000000:3.0:1788528322.267990:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788528322.268020:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c78d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528322.268028:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c78d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528322.268046:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c78d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528322.268064:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735400960:0@lo:101: 00000100:00100000:3.0:1788528322.268117:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528322.272119:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1c8fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528322.276584:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735400960 00000100:00100000:0.0:1788528322.276599:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735400960 00000100:00100000:0.0:1788528322.276664:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788528322.276674:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735400960:12345-0@lo:101: 00010000:00010000:0.0:1788528322.276690:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528322.276710:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc26e2600/0x892c60dda91c78da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c78d3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528322.276738:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc26e2600/0x892c60dda91c78da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c78d3 expref: 19 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528322.276751:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc26e2600/0x892c60dda91c78da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c78d3 expref: 19 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528322.276760:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e2600, rc 0) 00000100:00100000:0.0:1788528322.276842:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735400960:12345-0@lo:101: Request processed in 169us (8724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528322.276850:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788528322.277126:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735400960:0@lo:101: 00010000:00010000:3.0:1788528322.277147:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c78d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c78da expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528322.277158:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c78d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c78da expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528322.277487:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735401088:0@lo:501: 00000100:00100000:3.0:1788528322.277522:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528322.277575:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735401088 00000100:00100000:3.0:1788528322.277580:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735401088 00000100:00100000:3.0:1788528322.277605:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788528322.277612:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735401088:12345-0@lo:501: 00000100:00100000:3.0:1788528322.277669:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735401088:12345-0@lo:501: Request processed in 57us (146us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788528322.277676:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788528322.277712:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1c8fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528322.277724:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735401088:0@lo:501: 10000000:01000000:3.0:1788528322.277735:0:6506:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.203.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:3.0:1788528322.277774:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735401216:0@lo:501: 00000100:00100000:3.0:1788528322.277798:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528322.277816:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735401216 00000100:00100000:3.0:1788528322.277820:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735401216 00000100:00100000:3.0:1788528322.277835:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788528322.277841:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735401216:12345-0@lo:501: 00000100:00100000:3.0:1788528322.277879:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735401216:12345-0@lo:501: Request processed in 38us (81us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788528322.277886:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788528322.277905:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1c8fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528322.277915:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735401216:0@lo:501: 10000000:01000000:3.0:1788528322.277931:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788528322.277938:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c78d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c78da expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528322.277958:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c78d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c78da expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528322.277967:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788528322.277969:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff8a90f5add000 from 39 10000000:01000000:3.0:1788528322.277972:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788528322.277990:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa400/0x892c60dda91c78e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528322.277998:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa400/0x892c60dda91c78e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528322.278005:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa400/0x892c60dda91c78e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528322.278023:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735401344:0@lo:101: 00000100:00100000:3.0:1788528322.278047:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528322.278066:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735401344 00000100:00100000:3.0:1788528322.278070:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735401344 00000100:00100000:3.0:1788528322.278087:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788528322.278159:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735401344:12345-0@lo:101: 00010000:00010000:3.0:1788528322.278167:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528322.278176:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c14abc00/0x892c60dda91c78e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c78e1 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528322.278193:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c14abc00/0x892c60dda91c78e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c78e1 expref: 20 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528322.278200:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c14abc00/0x892c60dda91c78e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c78e1 expref: 20 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528322.278383:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c14abc00, rc 0) 00000100:00100000:3.0:1788528322.278408:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+20:6506:x1875407735401344:12345-0@lo:101: Request processed in 254us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528322.278414:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788528322.278438:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1c8fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528322.278449:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735401344:0@lo:101: 00010000:00010000:3.0:1788528322.278460:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa400/0x892c60dda91c78e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c78e8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528322.278468:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa400/0x892c60dda91c78e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c78e8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788528322.278642:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 39 count 39 00000040:00080000:3.0:1788528322.278899:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788528322.279494:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788528322.279523:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 120 off8536 00000040:00080000:3.0:1788528322.279547:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 168 off8704 00000040:00080000:3.0:1788528322.279586:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8928 00000040:00080000:3.0:1788528322.279599:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9152 00000040:00080000:3.0:1788528322.279610:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9272 00000040:00080000:3.0:1788528322.279621:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 168 off9440 00000040:00080000:3.0:1788528322.279632:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 224 off9664 00000040:00080000:3.0:1788528322.279644:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1788528322.279655:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 120 off10008 00000040:00080000:3.0:1788528322.279666:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 224 off10232 00000040:00080000:3.0:1788528322.279677:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10456 00000040:00080000:3.0:1788528322.279689:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 88 off10544 00000040:00080000:3.0:1788528322.279701:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 128 off10672 00000040:00080000:3.0:1788528322.279713:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 144 off10816 00000040:00080000:3.0:1788528322.279725:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 160 off10976 00000040:00080000:3.0:1788528322.279738:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 224 off11200 00000040:00080000:3.0:1788528322.279750:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11424 00000040:00080000:3.0:1788528322.279773:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 80 off11504 00000040:00080000:3.0:1788528322.279786:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 224 off11728 00000040:00080000:3.0:1788528322.279796:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11952 00000040:00080000:3.0:1788528322.279808:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 88 off12040 00000040:00080000:3.0:1788528322.279819:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 128 off12168 00000040:00080000:3.0:1788528322.279830:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 144 off12312 00000040:00080000:3.0:1788528322.279840:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 160 off12472 00000040:00080000:3.0:1788528322.279850:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 224 off12696 00000040:00080000:3.0:1788528322.279861:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 224 off12920 00000040:00080000:3.0:1788528322.279871:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 80 off13000 00000040:00080000:3.0:1788528322.279880:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 224 off13224 00000040:00080000:3.0:1788528322.279901:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13448 00000040:00080000:3.0:1788528322.279911:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 88 off13536 00000040:00080000:3.0:1788528322.279921:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 128 off13664 00000040:00080000:3.0:1788528322.279931:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 144 off13808 00000040:00080000:3.0:1788528322.279955:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 128 off13936 00000040:00080000:3.0:1788528322.279984:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 224 off14160 00000040:00080000:3.0:1788528322.279999:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 224 off14384 00000040:00080000:3.0:1788528322.280014:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 80 off14464 00000040:00080000:3.0:1788528322.280036:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 224 off14688 00000040:00080000:3.0:1788528322.280042:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 38 count 39 00000100:00100000:3.0:1788528322.281695:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735401472:0@lo:501: 00000100:00100000:3.0:1788528322.281760:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528322.281846:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1c8fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528322.284477:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735401472 00000100:00100000:1.0:1788528322.284494:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735401472 00000100:00100000:2.0:1788528322.284769:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788528322.284782:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+20:6506:x1875407735401472:12345-0@lo:501: 00000100:00100000:2.0:1788528322.284971:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+20:6506:x1875407735401472:12345-0@lo:501: Request processed in 193us (3210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528322.284979:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788528322.285543:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735401472:0@lo:501: 00000100:00100000:3.0:1788528322.285626:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735401600:0@lo:503: 00000100:00100000:3.0:1788528322.285682:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528322.285709:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1c8fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528322.286519:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735401600 00000100:00100000:2.0:1788528322.286527:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735401600 00000100:00100000:2.0:1788528322.286596:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788528322.286605:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+20:6506:x1875407735401600:12345-0@lo:503: 00000100:00100000:2.0:1788528322.286717:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+20:6506:x1875407735401600:12345-0@lo:503: Request processed in 112us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528322.286725:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788528322.286902:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735401600:0@lo:503: 00000040:00080000:3.0:1788528322.287366:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788528322.287437:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735401728:0@lo:502: 00000100:00100000:3.0:1788528322.287481:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528322.287506:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1c8fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528322.287781:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735401728 00000100:00100000:2.0:1788528322.287787:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735401728 00000100:00100000:2.0:1788528322.287822:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788528322.287830:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+20:6506:x1875407735401728:12345-0@lo:502: 00000100:00100000:2.0:1788528322.287912:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+20:6506:x1875407735401728:12345-0@lo:502: Request processed in 83us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528322.287919:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788528322.288078:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735401728:0@lo:502: 00000040:00080000:3.0:1788528322.288740:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788528322.288770:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 120 off8536 00000040:00080000:3.0:1788528322.288785:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 168 off8704 00000040:00080000:3.0:1788528322.288798:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8928 00000040:00080000:3.0:1788528322.288811:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9152 00000040:00080000:3.0:1788528322.288839:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9272 00000040:00080000:3.0:1788528322.288851:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 168 off9440 00000040:00080000:3.0:1788528322.288862:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 224 off9664 00000040:00080000:3.0:1788528322.288874:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788528322.288887:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 120 off10008 00000040:00080000:3.0:1788528322.288915:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 224 off10232 00000040:00080000:3.0:1788528322.288931:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10456 00000040:00080000:3.0:1788528322.288953:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 88 off10544 00000040:00080000:3.0:1788528322.288968:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 128 off10672 00000040:00080000:3.0:1788528322.288980:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 144 off10816 00000040:00080000:3.0:1788528322.288993:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 160 off10976 00000040:00080000:3.0:1788528322.289005:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 224 off11200 00000040:00080000:3.0:1788528322.289017:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11424 00000040:00080000:3.0:1788528322.289027:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 80 off11504 00000040:00080000:3.0:1788528322.289037:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 224 off11728 00000040:00080000:3.0:1788528322.289047:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11952 00000040:00080000:3.0:1788528322.289057:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 88 off12040 00000040:00080000:3.0:1788528322.289068:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 128 off12168 00000040:00080000:3.0:1788528322.289083:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 144 off12312 00000040:00080000:3.0:1788528322.289347:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 160 off12472 00000040:00080000:3.0:1788528322.289364:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 224 off12696 00000040:00080000:3.0:1788528322.289390:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 224 off12920 00000040:00080000:3.0:1788528322.289406:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 80 off13000 00000040:00080000:3.0:1788528322.289420:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 224 off13224 00000040:00080000:3.0:1788528322.289432:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13448 00000040:00080000:3.0:1788528322.289446:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 88 off13536 00000040:00080000:3.0:1788528322.289459:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 128 off13664 00000040:00080000:3.0:1788528322.289470:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 144 off13808 00000040:00080000:3.0:1788528322.289482:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 128 off13936 00000040:00080000:3.0:1788528322.289494:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 224 off14160 00000040:00080000:3.0:1788528322.289506:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 224 off14384 00000040:00080000:3.0:1788528322.289518:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 80 off14464 00000040:00080000:3.0:1788528322.289530:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 224 off14688 00000040:00080000:3.0:1788528322.289733:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14912 00000040:00080000:3.0:1788528322.289753:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 88 off15000 00000040:00080000:3.0:1788528322.289768:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 128 off15128 00000040:00080000:3.0:1788528322.289781:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 144 off15272 00000040:00080000:3.0:1788528322.289807:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 128 off15400 00000040:00080000:3.0:1788528322.289823:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 224 off15624 00000040:00080000:3.0:1788528322.289837:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off15848 00000040:00080000:3.0:1788528322.289851:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].46, 80 off15928 00000100:00100000:3.0:1788528322.289887:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735401856:0@lo:502: 00000100:00100000:3.0:1788528322.289958:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528322.290465:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1c8fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528322.290527:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735401856 00000100:00100000:1.0:1788528322.290534:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735401856 00000100:00100000:1.0:1788528322.290595:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788528322.290605:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+20:6506:x1875407735401856:12345-0@lo:502: 00000100:00100000:1.0:1788528322.290725:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+20:6506:x1875407735401856:12345-0@lo:502: Request processed in 123us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528322.290732:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788528322.290835:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735401856:0@lo:502: 00000040:00080000:3.0:1788528322.290884:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].47, 224 off16152 00000040:00080000:3.0:1788528322.290893:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000040:00080000:3.0:1788528322.291677:0:9973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 48 count 48 00000020:01000000:1.0:1788528322.291866:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1788528322.291877:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788528322.291886:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa400/0x892c60dda91c78e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c78e8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528322.291895:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa400/0x892c60dda91c78e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c78e8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528322.291904:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788528322.291906:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff8a90f5add000 from 6 10000000:01000000:1.0:1788528322.291909:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788528322.291940:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16000/0x892c60dda91c78ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528322.291955:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16000/0x892c60dda91c78ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528322.291965:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16000/0x892c60dda91c78ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528322.291982:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6feea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735401984:0@lo:101: 00000100:00100000:1.0:1788528322.292022:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528322.292055:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90fbeae180 going to sleep for 11 seconds 00000100:00100000:3.0:1788528322.292158:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735401984 00000100:00100000:3.0:1788528322.292164:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735401984 00000100:00100000:3.0:1788528322.292199:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788528322.292450:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+20:6506:x1875407735401984:12345-0@lo:101: 00010000:00010000:3.0:1788528322.292463:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528322.292477:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c14aa000/0x892c60dda91c78f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c78ef expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528322.292498:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c14aa000/0x892c60dda91c78f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c78ef expref: 21 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528322.292507:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c14aa000/0x892c60dda91c78f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c78ef expref: 21 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528322.292516:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c14aa000, rc 0) 00000100:00100000:3.0:1788528322.292598:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+21:6506:x1875407735401984:12345-0@lo:101: Request processed in 391us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528322.292605:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788528322.292705:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6feea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735401984:0@lo:101: 00010000:00010000:1.0:1788528322.292719:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16000/0x892c60dda91c78ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c78f6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528322.292729:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16000/0x892c60dda91c78ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c78f6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528322.292786:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6feea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735402112:0@lo:256: 00000100:00100000:1.0:1788528322.292817:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528322.292919:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90fbeae180 going to sleep for 11 seconds 00000100:00100000:0.0:1788528322.292972:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735402112 00000100:00100000:0.0:1788528322.292978:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735402112 00000100:00100000:0.0:1788528322.293017:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788528322.293025:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+21:6506:x1875407735402112:12345-0@lo:256: 20000000:01000000:0.0:1788528322.293040:0:6502:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788528322.293056:0:6502:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788528322.293059:0:6502:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788528322.293488:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+21:6506:x1875407735402112:12345-0@lo:256: Request processed in 463us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528322.293495:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788528322.293550:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6feea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735402112:0@lo:256: 10000000:01000000:1.0:1788528322.293716:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788528322.293723:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16000/0x892c60dda91c78ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c78f6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528322.293732:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16000/0x892c60dda91c78ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c78f6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528322.293742:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788528322.293745:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1788528322.293748:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788528322.293767:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17400/0x892c60dda91c78fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528322.293775:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17400/0x892c60dda91c78fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528322.293782:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17400/0x892c60dda91c78fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528322.293794:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6feea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735402240:0@lo:101: 00000100:00100000:1.0:1788528322.293820:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528322.293875:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90fbeae180 going to sleep for 11 seconds 00000100:00100000:2.0:1788528322.293931:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735402240 00000100:00100000:2.0:1788528322.293936:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735402240 00000100:00100000:3.0:1788528322.294085:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788528322.294165:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+21:6506:x1875407735402240:12345-0@lo:101: 00010000:00010000:3.0:1788528322.294175:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528322.294187:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c14aba00/0x892c60dda91c7904 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c78fd expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528322.294204:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c14aba00/0x892c60dda91c7904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c78fd expref: 22 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528322.294224:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c14aba00/0x892c60dda91c7904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c78fd expref: 22 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528322.294232:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c14aba00, rc 0) 00000100:00100000:3.0:1788528322.294303:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+22:6506:x1875407735402240:12345-0@lo:101: Request processed in 210us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528322.294309:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788528322.294440:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6feea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735402240:0@lo:101: 00010000:00010000:1.0:1788528322.294462:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17400/0x892c60dda91c78fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7904 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528322.294470:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17400/0x892c60dda91c78fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7904 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788528322.294645:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 34 count 34 00000040:00080000:1.0:1788528322.294871:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788528322.295047:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788528322.295072:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 136 off8552 00000040:00080000:1.0:1788528322.295089:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 176 off8728 00000040:00080000:1.0:1788528322.295340:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8952 00000040:00080000:1.0:1788528322.295355:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9176 00000040:00080000:1.0:1788528322.295368:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9296 00000040:00080000:1.0:1788528322.295380:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 112 off9408 00000040:00080000:1.0:1788528322.295393:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 160 off9568 00000040:00080000:1.0:1788528322.295406:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9792 00000040:00080000:1.0:1788528322.295438:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10016 00000040:00080000:1.0:1788528322.295452:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 88 off10104 00000040:00080000:1.0:1788528322.295463:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 144 off10248 00000040:00080000:1.0:1788528322.295475:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 152 off10400 00000040:00080000:1.0:1788528322.295485:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 168 off10568 00000040:00080000:1.0:1788528322.295496:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 224 off10792 00000040:00080000:1.0:1788528322.295509:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 224 off11016 00000040:00080000:1.0:1788528322.295520:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 80 off11096 00000040:00080000:1.0:1788528322.295532:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11320 00000040:00080000:1.0:1788528322.295544:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 224 off11544 00000040:00080000:1.0:1788528322.295621:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 160 off11704 00000040:00080000:1.0:1788528322.295639:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11928 00000040:00080000:1.0:1788528322.295654:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 224 off12152 00000040:00080000:1.0:1788528322.295668:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 80 off12232 00000040:00080000:1.0:1788528322.295682:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 224 off12456 00000040:00080000:1.0:1788528322.295708:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 224 off12680 00000040:00080000:1.0:1788528322.295738:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 88 off12768 00000040:00080000:1.0:1788528322.295755:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 144 off12912 00000040:00080000:1.0:1788528322.295769:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 152 off13064 00000040:00080000:1.0:1788528322.295782:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 136 off13200 00000040:00080000:1.0:1788528322.295794:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13424 00000040:00080000:1.0:1788528322.295805:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 224 off13648 00000040:00080000:1.0:1788528322.295818:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 80 off13728 00000040:00080000:1.0:1788528322.295839:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 224 off13952 00000040:00080000:1.0:1788528322.295846:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 33 count 34 00000100:00100000:1.0:1788528322.295926:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6feea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735402368:0@lo:501: 00000100:00100000:1.0:1788528322.295990:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528322.296104:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90fbeae180 going to sleep for 11 seconds 00000100:00100000:3.0:1788528322.296267:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735402368 00000100:00100000:3.0:1788528322.296276:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735402368 00000100:00100000:3.0:1788528322.296324:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788528322.296335:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+22:6506:x1875407735402368:12345-0@lo:501: 00000100:00100000:3.0:1788528322.296457:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+22:6506:x1875407735402368:12345-0@lo:501: Request processed in 125us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528322.296465:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788528322.296657:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6feea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735402368:0@lo:501: 00000100:00100000:2.0:1788528322.296698:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735402496:0@lo:503: 00000100:00100000:2.0:1788528322.296736:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528322.296754:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78f0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788528322.296825:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735402496 00000100:00100000:3.0:1788528322.296830:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735402496 00000100:00100000:3.0:1788528322.296855:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788528322.296860:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+22:6506:x1875407735402496:12345-0@lo:503: 00000100:00100000:3.0:1788528322.296928:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+22:6506:x1875407735402496:12345-0@lo:503: Request processed in 67us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528322.296934:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788528322.297023:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735402496:0@lo:503: 00000040:00080000:2.0:1788528322.297439:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788528322.297496:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735402624:0@lo:502: 00000100:00100000:2.0:1788528322.297531:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528322.297586:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78f0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788528322.299277:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735402624 00000100:00100000:3.0:1788528322.299288:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735402624 00000100:00100000:3.0:1788528322.299333:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788528322.299341:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+22:6506:x1875407735402624:12345-0@lo:502: 00000100:00100000:3.0:1788528322.299480:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+22:6506:x1875407735402624:12345-0@lo:502: Request processed in 140us (1948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528322.299487:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788528322.300493:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735402624:0@lo:502: 00000040:00080000:2.0:1788528322.300740:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788528322.300771:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 136 off8552 00000040:00080000:2.0:1788528322.300785:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 176 off8728 00000040:00080000:2.0:1788528322.300797:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8952 00000040:00080000:2.0:1788528322.300824:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9176 00000040:00080000:2.0:1788528322.300838:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9296 00000040:00080000:2.0:1788528322.300851:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 112 off9408 00000040:00080000:2.0:1788528322.300863:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 160 off9568 00000040:00080000:2.0:1788528322.300875:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9792 00000040:00080000:2.0:1788528322.300886:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10016 00000040:00080000:2.0:1788528322.300898:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 88 off10104 00000040:00080000:2.0:1788528322.300910:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 144 off10248 00000040:00080000:2.0:1788528322.300923:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 152 off10400 00000040:00080000:2.0:1788528322.300936:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 168 off10568 00000040:00080000:2.0:1788528322.300959:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 224 off10792 00000040:00080000:2.0:1788528322.300973:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 224 off11016 00000040:00080000:2.0:1788528322.300985:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 80 off11096 00000040:00080000:2.0:1788528322.300997:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11320 00000040:00080000:2.0:1788528322.301010:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 224 off11544 00000040:00080000:2.0:1788528322.301022:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 160 off11704 00000040:00080000:2.0:1788528322.301056:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11928 00000040:00080000:2.0:1788528322.301072:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 224 off12152 00000040:00080000:2.0:1788528322.301085:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 80 off12232 00000040:00080000:2.0:1788528322.301406:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 224 off12456 00000040:00080000:2.0:1788528322.301425:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 224 off12680 00000040:00080000:2.0:1788528322.301437:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 88 off12768 00000040:00080000:2.0:1788528322.301449:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 144 off12912 00000040:00080000:2.0:1788528322.301460:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 152 off13064 00000040:00080000:2.0:1788528322.301472:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 136 off13200 00000040:00080000:2.0:1788528322.301485:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13424 00000040:00080000:2.0:1788528322.301498:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 224 off13648 00000040:00080000:2.0:1788528322.301511:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 80 off13728 00000040:00080000:2.0:1788528322.301524:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 224 off13952 00000040:00080000:2.0:1788528322.301536:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 224 off14176 00000040:00080000:2.0:1788528322.301550:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 88 off14264 00000040:00080000:2.0:1788528322.302073:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 144 off14408 00000040:00080000:2.0:1788528322.302282:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 152 off14560 00000040:00080000:2.0:1788528322.302299:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 136 off14696 00000040:00080000:2.0:1788528322.302314:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14920 00000040:00080000:2.0:1788528322.302328:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 224 off15144 00000040:00080000:2.0:1788528322.302342:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 80 off15224 00000100:00100000:2.0:1788528322.302382:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735402752:0@lo:502: 00000100:00100000:2.0:1788528322.302452:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528322.302528:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78f0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788528322.304611:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735402752 00000100:00100000:3.0:1788528322.304624:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735402752 00000100:00100000:3.0:1788528322.304681:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788528322.304691:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+22:6506:x1875407735402752:12345-0@lo:502: 00000100:00100000:3.0:1788528322.304844:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+22:6506:x1875407735402752:12345-0@lo:502: Request processed in 153us (2390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528322.304851:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788528322.305015:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735402752:0@lo:502: 00000040:00080000:2.0:1788528322.305103:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 224 off15448 00000040:00080000:2.0:1788528322.305116:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 42 count 43 00000020:01000000:3.0:1788528322.308654:0:9974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788528322.308666:0:9974:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788528322.308672:0:9974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528322.308674:0:9974:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788528322.308683:0:9974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788528322.308688:0:9974:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:3.0:1788528322.308715:0:9974:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788528322.308718:0:9974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788528322.308733:0:9974:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8a8fc35e0000) 00000020:00000080:3.0:1788528322.308780:0:9974:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1788528322.308787:0:9974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788528322.308875:0:9974:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788528322.308882:0:9974:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788528322.308888:0:9974:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x892c60dda91c7912 00010000:00080000:3.0:1788528322.308920:0:9974:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a8fc3c52800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.138@tcp at head 00010000:00010000:3.0:1788528322.309164:0:9974:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1788528322.309463:0:9974:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788528322.309476:0:9974:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788528322.309643:0:9974:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788528322.309731:0:9974:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788528322.309857:0:9974:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788528322.309933:0:9974:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788528322.310495:0:9975:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788528322.310500:0:9975:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788528322.311050:0:9974:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788528322.311059:0:9974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788528322.311111:0:9974:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788528322.311136:0:9974:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x892c60dda91c7919 00000100:00080000:2.0:1788528322.311145:0:9974:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788528322.311151:0:9974:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a8fc3c52800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1788528322.311186:0:9974:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90fab2ed80 x1875407735402880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788528322.311221:0:9974:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788528322.311484:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735402880:0@lo:8: 00000100:00100000:1.0:1788528322.311548:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788528322.311683:0:9974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788528322.311687:0:9974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528322.311689:0:9974:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788528322.311693:0:9974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788528322.311696:0:9974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528322.311698:0:9974:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788528322.311701:0:9974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788528322.311703:0:9974:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788528322.311723:0:9974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788528322.311726:0:9974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528322.311727:0:9974:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788528322.311731:0:9974:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 43 count 43 00000020:01000000:2.0:1788528322.311771:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1788528322.311786:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788528322.311795:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17400/0x892c60dda91c78fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7904 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528322.311804:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17400/0x892c60dda91c78fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7904 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528322.311814:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788528322.311816:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff8a90f5add000 from 1 10000000:01000000:2.0:1788528322.311819:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788528322.311843:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7920 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528322.311857:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7920 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528322.311868:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7920 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528322.311883:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735403008:0@lo:101: 00000100:00100000:2.0:1788528322.311915:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528322.311956:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c2d3ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788528322.312103:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735403008 00000100:00100000:0.0:1788528322.312110:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735403008 00000100:00100000:0.0:1788528322.312154:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788528322.312163:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+22:6506:x1875407735403008:12345-0@lo:101: 00010000:00010000:0.0:1788528322.312175:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528322.312190:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc26e2800/0x892c60dda91c7927 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7920 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528322.312229:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc26e2800/0x892c60dda91c7927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7920 expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528322.312241:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc26e2800/0x892c60dda91c7927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7920 expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528322.312249:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e2800, rc 0) 00000100:00100000:0.0:1788528322.312289:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+23:6506:x1875407735403008:12345-0@lo:101: Request processed in 127us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528322.312301:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788528322.312347:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735403008:0@lo:101: 00010000:00010000:0.0:1788528322.312360:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7920 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7927 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528322.312369:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7920 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7927 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528322.312431:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735403136:0@lo:501: 00000100:00100000:0.0:1788528322.312455:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528322.312467:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3a94e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788528322.312479:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735403136 00000100:00100000:0.0:1788528322.312482:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735403136 00000100:00100000:0.0:1788528322.312499:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788528322.312504:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+23:6506:x1875407735403136:12345-0@lo:501: 00000100:00100000:0.0:1788528322.312573:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+23:6506:x1875407735403136:12345-0@lo:501: Request processed in 48us (97us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788528322.312580:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788528322.312608:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735403136:0@lo:501: 10000000:01000000:0.0:1788528322.312619:0:6506:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.203.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:0.0:1788528322.312644:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735403264:0@lo:501: 00000100:00100000:0.0:1788528322.312667:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528322.312680:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3a94e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788528322.312690:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735403264 00000100:00100000:0.0:1788528322.312694:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735403264 00000100:00100000:0.0:1788528322.312711:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788528322.312725:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+23:6506:x1875407735403264:12345-0@lo:501: 00000100:00100000:0.0:1788528322.312768:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+23:6506:x1875407735403264:12345-0@lo:501: Request processed in 45us (100us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788528322.312775:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788528322.312802:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735403264:0@lo:501: 10000000:01000000:0.0:1788528322.312818:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788528322.312823:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7920 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7927 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528322.312831:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7920 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7927 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528322.312839:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788528322.312841:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff8a90c7f88000 from 39 10000000:01000000:0.0:1788528322.312843:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788528322.312857:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2a00/0x892c60dda91c792e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528322.312863:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2a00/0x892c60dda91c792e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528322.312871:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2a00/0x892c60dda91c792e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528322.312882:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735403392:0@lo:101: 00000100:00100000:0.0:1788528322.312904:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528322.312916:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3a94e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788528322.312926:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735403392 00000100:00100000:0.0:1788528322.312929:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735403392 00000100:00100000:0.0:1788528322.312965:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788528322.312972:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c8116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+23:6506:x1875407735403392:12345-0@lo:101: 00010000:00010000:0.0:1788528322.312979:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528322.312987:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc26e3600/0x892c60dda91c7935 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c792e expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528322.313000:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc26e3600/0x892c60dda91c7935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c792e expref: 24 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528322.313007:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc26e3600/0x892c60dda91c7935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c792e expref: 24 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528322.313013:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e3600, rc 0) 00000100:00100000:0.0:1788528322.313039:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c8116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735403392:12345-0@lo:101: Request processed in 69us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528322.313045:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788528322.313071:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735403392:0@lo:101: 00010000:00010000:0.0:1788528322.313081:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2a00/0x892c60dda91c792e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7935 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528322.313088:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2a00/0x892c60dda91c792e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7935 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528322.313110:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735403520:0@lo:501: 00000100:00100000:0.0:1788528322.313131:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528322.313143:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3a94e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788528322.313153:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735403520 00000100:00100000:0.0:1788528322.313156:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735403520 00000100:00100000:0.0:1788528322.313172:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788528322.313184:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c8116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735403520:12345-0@lo:501: 00000100:00100000:0.0:1788528322.313261:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c8116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735403520:12345-0@lo:501: Request processed in 77us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528322.313267:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788528322.313305:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735403520:0@lo:501: 00000100:00100000:0.0:1788528322.313328:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735403648:0@lo:503: 00000100:00100000:0.0:1788528322.313363:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528322.313375:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695000 going to sleep for 11 seconds 00000100:00100000:0.0:1788528322.313385:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735403648 00000100:00100000:0.0:1788528322.313389:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735403648 00000100:00100000:0.0:1788528322.313404:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788528322.313408:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c8116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735403648:12345-0@lo:503: 00000100:00100000:0.0:1788528322.313477:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c8116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735403648:12345-0@lo:503: Request processed in 67us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528322.313484:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788528322.313518:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735403648:0@lo:503: 00000100:00100000:3.0:1788528322.320008:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735402880 00000100:00100000:3.0:1788528322.320024:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735402880 00000100:00100000:3.0:1788528322.320119:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788528322.320127:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1875407735402880:12345-0@lo:8: 00010000:00080000:3.0:1788528322.320162:0:8725:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:3.0:1788528322.320194:0:8725:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x892c60dda91c793c 00002000:00100000:3.0:1788528322.320207:0:8725:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8a8fc3c50000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788528322.320211:0:8725:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1788528322.320573:0:8725:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788528322.320662:0:8725:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788528322.320900:0:8725:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788528322.320927:0:8725:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3c53000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788528322.321018:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3636:x1875407735402880:12345-0@lo:8: Request processed in 890us (9468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528322.321026:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788528322.321127:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90fab2ed80 x1875407735402880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788528332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528322.321138:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788528322.321147:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788528322.321154:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788528322.321159:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788528322.321162:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3c52800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788528322.321178:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788528322.321184:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735402880:0@lo:8: 00000100:00100000:1.0:1788528322.321460:0:9976:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fedf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9976:1875407735403776:0@lo:700: 00000100:00100000:1.0:1788528322.321497:0:9976:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528322.321526:0:9976:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90fbeae180 going to sleep for 11 seconds 00000100:00100000:0.0:1788528322.321623:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735403776 00000100:00100000:0.0:1788528322.321630:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735403776 00000100:00100000:0.0:1788528322.321680:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788528322.321690:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6feed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9976:x1875407735403776:12345-0@lo:700: 00000100:00100000:0.0:1788528322.321722:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8430:1875407735403904:0@lo:700: 00000100:00100000:0.0:1788528322.321753:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528322.321772:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695000 going to sleep for 11 seconds 00000100:00100000:0.0:1788528322.321789:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735403904 00000100:00100000:0.0:1788528322.321793:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735403904 00000100:00100000:0.0:1788528322.321820:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788528322.321837:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8430:x1875407735403904:12345-0@lo:700: 00000100:00080000:1.0:1788528322.322030:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788528322.322040:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788528322.324519:0:9975:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788528322.324622:0:9975:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 191542067371ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788528322.324631:0:9975:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788528322.325747:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735404288:0@lo:400: 00000100:00100000:2.0:1788528322.325816:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528322.325871:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735404032:0@lo:400: 00000100:00100000:0.0:1788528322.325912:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735404160:0@lo:400: 00000100:00100000:0.0:1788528322.325940:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528322.325981:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1875407735404672:0@lo:400: 00000100:00100000:0.0:1788528322.326014:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735404160 00000100:00100000:0.0:1788528322.326021:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735404160 00000100:00100000:0.0:1788528322.326065:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788528322.326073:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735404160:12345-0@lo:400: 00000100:00100000:0.0:1788528322.326138:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735404160:12345-0@lo:400: Request processed in 66us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528322.326146:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788528322.326976:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735404800:0@lo:400: 00000100:00100000:2.0:1788528322.327014:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528322.327043:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788528322.327050:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735404416:0@lo:400: 00000100:00100000:2.0:1788528322.327076:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528322.327104:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735404928:0@lo:400: 00000100:00100000:2.0:1788528322.327140:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528322.327180:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735404800 00000100:00100000:2.0:1788528322.327184:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735404800 00000100:00100000:3.0:1788528322.327316:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735404928 00000100:00100000:3.0:1788528322.327327:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735404928 00000100:00100000:2.0:1788528322.327380:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788528322.327387:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735404800:12345-0@lo:400: 00000100:00100000:2.0:1788528322.327431:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735404800:12345-0@lo:400: Request processed in 45us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528322.327444:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788528322.327501:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528322.327511:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735404288 00000100:00100000:1.0:1788528322.327518:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735404288 00000100:00100000:0.0:1788528322.327547:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735404160:0@lo:400: 00000100:00100000:1.0:1788528322.327567:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735404672 00000100:00100000:1.0:1788528322.327572:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735404672 00000100:00100000:1.0:1788528322.327598:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788528322.327607:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735404288:12345-0@lo:400: 00000100:00100000:0.0:1788528322.327614:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528322.327631:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1875407735404544:0@lo:400: 00000100:00100000:1.0:1788528322.327654:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735404288:12345-0@lo:400: Request processed in 48us (1837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528322.327663:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788528322.327665:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528322.327680:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735404032 00000100:00100000:0.0:1788528322.327684:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735405056:0@lo:400: 00000100:00100000:1.0:1788528322.327685:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735404032 00000100:00100000:1.0:1788528322.327703:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735404544 00000100:00100000:1.0:1788528322.327707:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735404544 00000100:00100000:0.0:1788528322.327719:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528322.327726:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735405056 00000100:00100000:1.0:1788528322.327729:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735405056 00000100:00100000:1.0:1788528322.327749:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788528322.327756:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788528322.327758:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875407735404672:12345-0@lo:400: 00000100:00100000:0.0:1788528322.327771:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735404032:12345-0@lo:400: 00000100:00100000:1.0:1788528322.327801:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875407735404672:12345-0@lo:400: Request processed in 45us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528322.327809:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788528322.327823:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735404032:12345-0@lo:400: Request processed in 56us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528322.327824:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788528322.327837:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788528322.327838:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875407735404544:12345-0@lo:400: 00000100:00100000:0.0:1788528322.327859:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788528322.327873:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875407735404544:12345-0@lo:400: Request processed in 39us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528322.327878:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735405056:12345-0@lo:400: 00000100:00100000:1.0:1788528322.327884:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1788528322.327924:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc30adc00 x1875407735404672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528322.327936:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1875407735404672:0@lo:400: 00000100:00100000:3.0:1788528322.329083:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788528322.329406:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735404416 00000100:00100000:2.0:1788528322.329414:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735404416 00000100:00100000:2.0:1788528322.329465:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788528322.329474:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735404416:12345-0@lo:400: 00000100:00100000:3.0:1788528322.329637:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735404928:12345-0@lo:400: 00000100:00100000:0.0:1788528322.329734:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735405056:12345-0@lo:400: Request processed in 1860us (2014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528322.329742:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788528322.330025:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735404416:12345-0@lo:400: Request processed in 552us (2947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528322.330032:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1788528322.330050:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788528322.330055:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788528322.330059:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788528322.330084:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735404416:0@lo:400: 00010000:00080000:1.0:1788528322.330194:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90fab2c700 x1875407735404032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528322.330217:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735404032:0@lo:400: 00010000:00080000:1.0:1788528322.330242:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90fab2d500 x1875407735404544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528322.330251:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1875407735404544:0@lo:400: 00010000:00080000:1.0:1788528322.330267:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f58c2a00 x1875407735405056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528322.330275:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735405056:0@lo:400: 00010000:00080000:2.0:1788528322.330449:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90fab2ed80 x1875407735404288/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528322.330458:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735404288:0@lo:400: 00010000:00080000:2.0:1788528322.330474:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f58c3800 x1875407735404800/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528322.330483:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735404800:0@lo:400: 00000100:00100000:2.0:1788528322.330854:0:9977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc374c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:9977:1875407735405184:0@lo:502: 00000100:00100000:2.0:1788528322.330908:0:9977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528322.330957:0:9977:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c2d3ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788528322.331003:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735405184 00000100:00100000:0.0:1788528322.331009:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735405184 00000100:00100000:0.0:1788528322.331047:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788528322.331054:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+24:9977:x1875407735405184:12345-0@lo:502: 00000100:00100000:0.0:1788528322.331470:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+24:9977:x1875407735405184:12345-0@lo:502: Request processed in 415us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528322.331477:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788528322.331598:0:9977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc374c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:9977:1875407735405184:0@lo:502: 00000100:00100000:2.0:1788528322.331646:0:9977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc374c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:9977:1875407735405312:0@lo:502: 00000100:00100000:2.0:1788528322.331678:0:9977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528322.331700:0:9977:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ecd180 going to sleep for 11 seconds 00000100:00100000:0.0:1788528322.331801:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735405312 00000100:00100000:0.0:1788528322.331807:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735405312 00000100:00100000:0.0:1788528322.331866:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788528322.331874:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+24:9977:x1875407735405312:12345-0@lo:502: 00000100:00100000:0.0:1788528322.331955:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+24:9977:x1875407735405312:12345-0@lo:502: Request processed in 82us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528322.331962:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788528322.332019:0:9977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc374c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:9977:1875407735405312:0@lo:502: 00000040:00080000:2.0:1788528322.332038:0:9977:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000100:00100000:3.0:1788528322.332251:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735404928:12345-0@lo:400: Request processed in 3158us (5108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528322.332260:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788528322.332410:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f58c0380 x1875407735404928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528322.332421:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735404928:0@lo:400: 00000020:01000000:2.0:1788528322.332612:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788528322.332624:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788528322.332634:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2a00/0x892c60dda91c792e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7935 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528322.332645:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2a00/0x892c60dda91c792e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7935 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528322.332654:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788528322.332656:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff8a90c7f88000 from 6 10000000:01000000:2.0:1788528322.332659:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788528322.332684:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851c00/0x892c60dda91c7943 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528322.332691:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a9101851c00/0x892c60dda91c7943 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528322.332699:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a9101851c00/0x892c60dda91c7943 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528322.332713:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc374c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735405440:0@lo:101: 00000100:00100000:2.0:1788528322.332741:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528322.333009:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ecd180 going to sleep for 11 seconds 00000100:00100000:1.0:1788528322.333105:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735405440 00000100:00100000:1.0:1788528322.333111:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735405440 00000100:00100000:1.0:1788528322.333738:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788528322.333749:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735405440:12345-0@lo:101: 00010000:00010000:1.0:1788528322.333762:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528322.333780:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90f6e16400/0x892c60dda91c794a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7943 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528322.333805:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90f6e16400/0x892c60dda91c794a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7943 expref: 25 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528322.333816:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90f6e16400/0x892c60dda91c794a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7943 expref: 25 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528322.333824:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e16400, rc 0) 00000100:00100000:1.0:1788528322.333911:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735405440:12345-0@lo:101: Request processed in 165us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528322.333929:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788528322.334187:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc374c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735405440:0@lo:101: 00010000:00010000:2.0:1788528322.334205:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a9101851c00/0x892c60dda91c7943 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c794a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528322.334357:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a9101851c00/0x892c60dda91c7943 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c794a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528322.334407:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc374c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735405568:0@lo:256: 00000100:00100000:2.0:1788528322.334440:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528322.334508:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ecd180 going to sleep for 11 seconds 00000100:00100000:1.0:1788528322.334541:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735405568 00000100:00100000:1.0:1788528322.334546:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735405568 00000100:00100000:1.0:1788528322.334718:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788528322.334725:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735405568:12345-0@lo:256: 20000000:01000000:1.0:1788528322.334741:0:6500:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788528322.334758:0:6500:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788528322.334761:0:6500:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788528322.334838:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735405568:12345-0@lo:256: Request processed in 113us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528322.334844:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788528322.334897:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc374c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735405568:0@lo:256: 10000000:01000000:2.0:1788528322.334940:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788528322.334958:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851c00/0x892c60dda91c7943 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c794a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528322.334966:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a9101851c00/0x892c60dda91c7943 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c794a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528322.334975:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788528322.334977:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788528322.334979:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788528322.334998:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7951 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528322.335005:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7951 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528322.335013:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7951 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528322.335034:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc374c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735405696:0@lo:101: 00000100:00100000:2.0:1788528322.335057:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528322.335147:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ecd180 going to sleep for 11 seconds 00000100:00100000:0.0:1788528322.335215:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735405696 00000100:00100000:0.0:1788528322.335219:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735405696 00000100:00100000:0.0:1788528322.335248:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788528322.335255:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735405696:12345-0@lo:101: 00010000:00010000:0.0:1788528322.335262:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528322.335273:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7958 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7951 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528322.335289:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7951 expref: 26 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528322.335304:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7951 expref: 26 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528322.335312:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e3200, rc 0) 00000100:00100000:0.0:1788528322.335349:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735405696:12345-0@lo:101: Request processed in 94us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528322.335354:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788528322.335472:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc374c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735405696:0@lo:101: 00010000:00010000:2.0:1788528322.335483:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7951 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7958 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528322.335491:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7951 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7958 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528322.335518:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc374c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735405824:0@lo:501: 00000100:00100000:2.0:1788528322.335541:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528322.335576:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ecd180 going to sleep for 11 seconds 00000100:00100000:0.0:1788528322.335688:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735405824 00000100:00100000:0.0:1788528322.335692:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735405824 00000100:00100000:0.0:1788528322.335710:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788528322.335715:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735405824:12345-0@lo:501: 00000100:00100000:0.0:1788528322.335820:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735405824:12345-0@lo:501: Request processed in 104us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528322.335827:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788528322.335889:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc374c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735405824:0@lo:501: 00000100:00100000:2.0:1788528322.335911:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc374c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735405952:0@lo:503: 00000100:00100000:2.0:1788528322.335960:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528322.335984:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ecd180 going to sleep for 11 seconds 00000100:00100000:0.0:1788528322.336027:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735405952 00000100:00100000:0.0:1788528322.336031:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735405952 00000100:00100000:0.0:1788528322.336047:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788528322.336052:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735405952:12345-0@lo:503: 00000100:00100000:0.0:1788528322.336208:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735405952:12345-0@lo:503: Request processed in 150us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528322.336216:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000004:00080000:1.0:1788528322.338786:0:7440:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788528322.339877:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc374c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735405952:0@lo:503: 40000000:02000000:1.0:1788528322.342490:0:6515:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:0.0:1788528322.344636:0:9978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f08380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:9978:1875407735406080:0@lo:502: 00000100:00100000:0.0:1788528322.344722:0:9978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528322.344764:0:9978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788528322.344836:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735406080 00000100:00100000:2.0:1788528322.344844:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735406080 00000100:00100000:2.0:1788528322.344892:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788528322.344901:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+26:9978:x1875407735406080:12345-0@lo:502: 00000100:00100000:2.0:1788528322.345047:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+26:9978:x1875407735406080:12345-0@lo:502: Request processed in 146us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528322.345064:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788528322.345422:0:9978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f08380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:9978:1875407735406080:0@lo:502: 00000020:01000000:3.0:1788528322.345451:0:9978:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788528322.345459:0:9978:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788528322.345466:0:9978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528322.345468:0:9978:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788528322.345476:0:9978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788528322.345479:0:9978:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:3.0:1788528322.345499:0:9978:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788528322.345501:0:9978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788528322.345515:0:9978:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8a8fc35e3300) 00000020:00000080:3.0:1788528322.345538:0:9978:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1788528322.345543:0:9978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788528322.345647:0:9978:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788528322.345653:0:9978:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788528322.345660:0:9978:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x892c60dda91c7966 00010000:00080000:3.0:1788528322.345704:0:9978:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a8fc3c51800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:3.0:1788528322.345923:0:9978:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1788528322.346068:0:9978:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788528322.346079:0:9978:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1788528322.360885:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8430:x1875407735403904:12345-0@lo:700: Request processed in 39040us (39121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528322.360901:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:2.0:1788528322.362730:0:9978:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788528322.362959:0:9978:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788528322.363120:0:9978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788528322.363251:0:9978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00010000:00080000:0.0:1788528322.365734:0:8430:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6f0a300 x1875407735403904/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788528338 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528322.365774:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8430:1875407735403904:0@lo:700: 40000000:02000000:0.0:1788528322.365790:0:8430:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000040:00080000:2.0:1788528322.368856:0:9979:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788528322.368865:0:9979:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788528322.371876:0:9978:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788528322.371983:0:9978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788528322.372045:0:9978:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788528322.372082:0:9978:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x892c60dda91c796d 00000100:00080000:1.0:1788528322.372093:0:9978:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788528322.372099:0:9978:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a8fc3c51800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1788528322.372135:0:9978:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90f6fece00 x1875407735406208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788528322.372161:0:9978:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788528322.372319:0:9978:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528322.372325:0:9978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528322.372328:0:9978:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788528322.372339:0:9978:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528322.372344:0:9978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528322.372345:0:9978:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788528322.372349:0:9978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788528322.372350:0:9978:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788528322.372451:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735406208:0@lo:8: 00000100:00100000:3.0:1788528322.372513:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528322.372808:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735406208 00000100:00100000:2.0:1788528322.372815:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735406208 00000100:00100000:2.0:1788528322.372845:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788528322.372852:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1875407735406208:12345-0@lo:8: 00010000:00080000:2.0:1788528322.372877:0:8421:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:2.0:1788528322.372903:0:8421:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x892c60dda91c7974 00002000:00100000:2.0:1788528322.372916:0:8421:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8a8fc3020800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788528322.372919:0:8421:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788528322.372921:0:8421:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788528322.373005:0:8421:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788528322.373031:0:8421:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3021000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788528322.373087:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1875407735406208:12345-0@lo:8: Request processed in 234us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528322.373094:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788528322.373134:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6fece00 x1875407735406208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788528332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528322.373144:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788528322.373151:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788528322.373157:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788528322.373171:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788528322.373174:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3c51800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788528322.373185:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788528322.373190:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735406208:0@lo:8: 00000100:00100000:1.0:1788528322.374514:0:9978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fefb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:9978:1875407735406336:0@lo:502: 00000100:00100000:1.0:1788528322.374598:0:9978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528322.374634:0:9978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cd000 going to sleep for 11 seconds 00000004:00080000:2.0:1788528322.375174:0:9979:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788528322.375523:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735406336 00000100:00100000:3.0:1788528322.375531:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735406336 00000100:00100000:3.0:1788528322.375605:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788528322.375614:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+26:9978:x1875407735406336:12345-0@lo:502: 00000100:00100000:3.0:1788528322.375746:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+26:9978:x1875407735406336:12345-0@lo:502: Request processed in 132us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528322.375753:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000004:00080000:2.0:1788528322.378402:0:9979:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 191595844973ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788528322.378419:0:9979:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788528322.379284:0:9978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fefb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:9978:1875407735406336:0@lo:502: 00000020:01000000:1.0:1788528322.379330:0:9978:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528322.379339:0:9978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528322.379341:0:9978:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788528322.379345:0:9978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1788528322.379623:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1788528322.379634:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788528322.379645:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7951 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7958 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528322.379655:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7951 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7958 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528322.379664:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788528322.379666:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff8a90c7f88000 from 1 10000000:01000000:2.0:1788528322.379669:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788528322.379705:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c797b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528322.379712:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c797b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528322.379720:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c797b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528322.379739:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc374c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735406464:0@lo:101: 00000100:00100000:2.0:1788528322.379800:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528322.379843:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ecdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788528322.379880:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735406464 00000100:00100000:1.0:1788528322.379887:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735406464 00000100:00100000:1.0:1788528322.379936:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788528322.379954:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735406464:12345-0@lo:101: 00010000:00010000:1.0:1788528322.379967:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528322.379982:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90f6e17800/0x892c60dda91c7982 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c797b expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528322.380004:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90f6e17800/0x892c60dda91c7982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c797b expref: 27 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528322.380015:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90f6e17800/0x892c60dda91c7982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c797b expref: 27 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528322.380024:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e17800, rc 0) 00000100:00100000:1.0:1788528322.380068:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:6506:x1875407735406464:12345-0@lo:101: Request processed in 125us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528322.380085:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788528322.380157:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc374c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735406464:0@lo:101: 00010000:00010000:2.0:1788528322.380170:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c797b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7982 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528322.380178:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c797b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7982 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528322.380207:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc374c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735406592:0@lo:501: 00000100:00100000:2.0:1788528322.380247:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528322.380269:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ecdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788528322.380378:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735406592 00000100:00100000:1.0:1788528322.380383:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735406592 00000100:00100000:1.0:1788528322.380416:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788528322.380423:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+27:6506:x1875407735406592:12345-0@lo:501: 00000100:00100000:1.0:1788528322.380493:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+27:6506:x1875407735406592:12345-0@lo:501: Request processed in 70us (244us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788528322.380499:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788528322.380635:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc374c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735406592:0@lo:501: 10000000:01000000:2.0:1788528322.380647:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788528322.380653:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c797b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7982 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528322.380661:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c797b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7982 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788528322.388050:0:6487:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00100000:3.0:1788528322.388676:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788528322.388683:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788528322.389175:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6feed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9976:x1875407735403776:12345-0@lo:700: Request processed in 67483us (67672us total) trans 0 rc 0/0 00010000:00080000:1.0:1788528322.389499:0:9976:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6fedf80 x1875407735403776/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788528338 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528322.389514:0:9976:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fedf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9976:1875407735403776:0@lo:700: 00000100:00100000:0.0:1788528322.389677:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788528322.390576:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735406720:0@lo:13: 00000100:00100000:1.0:1788528322.390633:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528322.390710:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735406720 00000100:00100000:0.0:1788528322.390717:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735406720 00000100:00100000:0.0:1788528322.390787:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788528322.390796:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735406720:12345-0@lo:13: 00002000:00000024:0.0:1788528322.390823:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00080000:2.0:1788528322.390890:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788528322.391032:0:9980:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788528322.391056:0:9980:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9980:1875407735406848:0@lo:7: 00000100:00100000:3.0:1788528322.391087:0:9980:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528322.391116:0:9980:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90fa9ae900 going to sleep for 11 seconds 00000100:00100000:2.0:1788528322.391586:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735406848 00000100:00100000:2.0:1788528322.391591:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735406848 00000100:00100000:2.0:1788528322.391633:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788528322.391641:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9980:x1875407735406848:12345-0@lo:7: 00000100:00100000:0.0:1788528322.392877:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1875407735406720:12345-0@lo:13: Request processed in 2079us (2240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528322.392889:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788528322.392992:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3c7f800 x1875407735406720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528322.393017:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735406720:0@lo:13: 00002000:00080000:2.0:1788528322.400510:0:8422:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788528322.400519:0:8422:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788528322.400636:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9980:x1875407735406848:12345-0@lo:7: Request processed in 8992us (9544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528322.400655:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788528322.400990:0:9980:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3c7c700 x1875407735406848/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788528338 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528322.401006:0:9980:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9980:1875407735406848:0@lo:7: 00000004:00080000:0.0:1788528322.401022:0:9980:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788528322.401062:0:9980:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f0a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9980:1875407735406976:0@lo:5: 00000100:00100000:0.0:1788528322.401100:0:9980:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528322.401133:0:9980:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695000 going to sleep for 11 seconds 00000100:00100000:2.0:1788528322.401360:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735406976 00000100:00100000:2.0:1788528322.401375:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735406976 00000100:00100000:2.0:1788528322.401425:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788528322.401436:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9980:x1875407735406976:12345-0@lo:5: 00002000:00080000:2.0:1788528322.401459:0:8421:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788528322.401462:0:8421:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788528322.401751:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9980:x1875407735406976:12345-0@lo:5: Request processed in 316us (649us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788528322.401759:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788528322.401802:0:9980:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6f0a300 x1875407735406976/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788528338 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528322.401814:0:9980:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f0a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9980:1875407735406976:0@lo:5: 00000004:00080000:2.0:1788528322.401822:0:9980:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788528322.401846:0:9980:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc374c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9980:1875407735407104:0@lo:700: 00000100:00100000:2.0:1788528322.401871:0:9980:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528322.401899:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735407104 00000100:00100000:2.0:1788528322.401902:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735407104 00000100:00100000:2.0:1788528322.401929:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788528322.401935:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9980:x1875407735407104:12345-0@lo:700: 00000100:00100000:2.0:1788528322.402033:0:9980:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c2b57540 going to sleep for 11 seconds 00000001:00080000:3.0:1788528322.404860:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1788528322.405153:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9980:x1875407735407104:12345-0@lo:700: Request processed in 3214us (3277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528322.405166:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788528322.405500:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:1.0:1788528322.405520:0:9976:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788528322.405547:0:9976:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fec380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9976:1875407735407360:0@lo:7: 00000100:00100000:1.0:1788528322.405609:0:9976:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528322.405639:0:9976:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cdd80 going to sleep for 11 seconds 00010000:00080000:0.0:1788528322.405796:0:9980:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc374c380 x1875407735407104/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788528338 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528322.405806:0:9980:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788528322.405822:0:9980:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc374c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9980:1875407735407104:0@lo:700: 00000004:02000040:0.0:1788528322.406950:0:9980:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:2.0:1788528322.410122:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735407360 00000100:00100000:2.0:1788528322.410138:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735407360 00000100:00100000:2.0:1788528322.410220:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788528322.410231:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9976:x1875407735407360:12345-0@lo:7: 00000100:00100000:3.0:1788528322.413258:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735407232:0@lo:13: 00000100:00100000:3.0:1788528322.413339:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528322.413379:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735407232 00000100:00100000:3.0:1788528322.413387:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735407232 00000100:00100000:3.0:1788528322.413430:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788528322.413440:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1875407735407232:12345-0@lo:13: 00002000:00000024:3.0:1788528322.413460:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1788528322.413500:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1875407735407232:12345-0@lo:13: Request processed in 61us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528322.413506:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788528322.413574:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6fefb80 x1875407735407232/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528322.413592:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735407232:0@lo:13: 00002000:00080000:2.0:1788528322.414510:0:8725:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1788528322.414517:0:8725:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788528322.415144:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9976:x1875407735407360:12345-0@lo:7: Request processed in 4913us (9530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528322.415155:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788528322.415253:0:9980:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f0a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9980:1875407735407488:0@lo:5: 00000100:00100000:0.0:1788528322.415290:0:9980:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528322.415319:0:9980:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788528322.415367:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735407488 00000100:00100000:2.0:1788528322.415375:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735407488 00000100:00100000:2.0:1788528322.415415:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788528322.415422:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9980:x1875407735407488:12345-0@lo:5: 00010000:00080000:1.0:1788528322.416456:0:9976:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6fec380 x1875407735407360/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788528338 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528322.416472:0:9976:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fec380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9976:1875407735407360:0@lo:7: 00000004:00080000:1.0:1788528322.416484:0:9976:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788528322.416519:0:9976:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fec380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9976:1875407735407616:0@lo:5: 00000100:00100000:1.0:1788528322.416577:0:9976:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528322.418211:0:9976:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788528322.419997:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735407616 00000100:00100000:3.0:1788528322.420010:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735407616 00000100:00100000:3.0:1788528322.420077:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788528322.420088:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9976:x1875407735407616:12345-0@lo:5: 00002000:00080000:3.0:1788528322.420190:0:8422:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1788528322.420451:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9976:x1875407735407616:12345-0@lo:5: Request processed in 364us (3872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528322.420524:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788528322.421594:0:9976:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6fec380 x1875407735407616/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788528338 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528322.421611:0:9976:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fec380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9976:1875407735407616:0@lo:5: 00000004:00080000:1.0:1788528322.421624:0:9976:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788528322.421663:0:9976:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fec380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9976:1875407735407744:0@lo:5: 00000100:00100000:1.0:1788528322.421707:0:9976:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528322.421740:0:9976:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788528322.421805:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735407744 00000100:00100000:0.0:1788528322.421811:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735407744 00000100:00100000:0.0:1788528322.421858:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788528322.421867:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9976:x1875407735407744:12345-0@lo:5: 00002000:00080000:0.0:1788528322.421899:0:8423:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1788528322.426773:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9976:x1875407735407744:12345-0@lo:5: Request processed in 4901us (5059us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788528322.426786:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788528322.426907:0:9976:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6fec380 x1875407735407744/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788528338 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528322.426925:0:9976:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fec380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9976:1875407735407744:0@lo:5: 00000004:00080000:1.0:1788528322.426939:0:9976:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788528322.426990:0:9976:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6feea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9976:1875407735407872:0@lo:900: 00000100:00100000:1.0:1788528322.427029:0:9976:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528322.427107:0:9976:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788528322.427343:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735407872 00000100:00100000:0.0:1788528322.427350:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735407872 00002000:00080000:2.0:1788528322.427386:0:8421:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788528322.427402:0:8421:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1788528322.427441:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788528322.427450:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9976:x1875407735407872:12345-0@lo:900: 00000100:00100000:0.0:1788528322.427506:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9976:x1875407735407872:12345-0@lo:900: Request processed in 56us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528322.427512:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788528322.427578:0:9976:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6feea00 x1875407735407872/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788528338 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528322.427588:0:9976:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6feea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9976:1875407735407872:0@lo:900: 00000100:00100000:2.0:1788528322.429131:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9980:x1875407735407488:12345-0@lo:5: Request processed in 13705us (13836us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788528322.429143:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788528322.429299:0:9980:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6f0a300 x1875407735407488/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788528338 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528322.429316:0:9980:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f0a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9980:1875407735407488:0@lo:5: 00000004:00080000:0.0:1788528322.429328:0:9980:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:1.0:1788528322.686999:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528322.750952:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788528322.750978:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735408000:0@lo:41: 00000100:00100000:2.0:1788528322.751062:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528322.751122:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735408000 00000100:00100000:0.0:1788528322.751131:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735408000 00000100:00100000:0.0:1788528322.751311:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788528322.751333:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735408000:12345-0@lo:41: 00000004:00000024:0.0:1788528322.751365:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788528322.751420:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735408000:12345-0@lo:41: Request processed in 88us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528322.751426:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788528322.751570:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735408000:0@lo:41: 00000001:00080000:3.0:1788528323.209748:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:3.0:1788528323.209769:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1788528323.712909:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528323.775008:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788528323.776252:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735408256:0@lo:13: 00000100:00100000:1.0:1788528323.776322:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528323.776390:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735408128:0@lo:13: 00000100:00100000:1.0:1788528323.776413:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528323.776479:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735408256 00000100:00100000:2.0:1788528323.776488:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735408256 00000100:00100000:2.0:1788528323.776539:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735408128 00000100:00100000:2.0:1788528323.776542:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735408128 00000100:00100000:2.0:1788528323.776595:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788528323.776607:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735408256:12345-0@lo:13: 00000100:00100000:3.0:1788528323.776633:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00002000:00000024:2.0:1788528323.776637:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788528323.776648:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735408128:12345-0@lo:13: 00002000:00000024:3.0:1788528323.776663:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788528323.776686:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735408256:12345-0@lo:13: Request processed in 81us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528323.776702:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788528323.776706:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735408128:12345-0@lo:13: Request processed in 62us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528323.776715:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788528323.776757:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3c7f100 x1875407735408256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528323.776834:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735408256:0@lo:13: 00010000:00080000:3.0:1788528323.776848:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6f08700 x1875407735408128/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528323.776859:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735408128:0@lo:13: 00000020:00000004:2.0:1788528324.052265:0:10031:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788528324.052483:0:10031:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788528324.739005:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528324.799745:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788528324.799770:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc374d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735408384:0@lo:41: 00000100:00100000:1.0:1788528324.799840:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528324.799951:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735408384 00000100:00100000:2.0:1788528324.799959:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735408384 00000100:00100000:2.0:1788528324.800011:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788528324.800021:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735408384:12345-0@lo:41: 00000004:00000024:2.0:1788528324.800055:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446469632 avail 1300230144 00000100:00100000:2.0:1788528324.800105:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735408384:12345-0@lo:41: Request processed in 85us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528324.800111:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788528324.800156:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc374d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735408384:0@lo:41: 00000020:00000004:3.0:1788528325.051970:0:10079:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788528325.051980:0:10079:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1788528325.381680:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528325.381813:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719628928 00000100:00100000:1.0:1788528325.381826:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719628928 00000100:00100000:1.0:1788528325.381889:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 189 00000100:00100000:1.0:1788528325.381900:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2402:x1875407719628928:12345-192.168.203.38@tcp:250: 00010000:00080000:1.0:1788528325.381944:0:6501:0:(ldlm_lib.c:1458:target_handle_connect()) MGS: connection from 834ce1d3-c286-4bf4-af56-ae8f56d93ddf@192.168.203.38@tcp t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:1.0:1788528325.381983:0:6501:0:(genops.c:1385:class_connect()) connect: client 834ce1d3-c286-4bf4-af56-ae8f56d93ddf, cookie 0x892c60dda91c7989 00000100:00080000:1.0:1788528325.382384:0:6501:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d19000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788528325.382519:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+5:2402:x1875407719628928:12345-192.168.203.38@tcp:250: Request processed in 619us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528325.382528:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 189 00000100:00100000:0.0:1788528325.391392:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528325.391683:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719629056 00000100:00100000:3.0:1788528325.391697:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719629056 00000100:00100000:3.0:1788528325.391793:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 190 00000100:00100000:3.0:1788528325.391805:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+5:6158:x1875407719629056:12345-192.168.203.38@tcp:101: 00010000:00010000:3.0:1788528325.391836:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528325.391861:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c14ab400/0x892c60dda91c7990 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfb2c expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528325.391896:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c14ab400/0x892c60dda91c7990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb2c expref: 6 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528325.391909:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c14ab400/0x892c60dda91c7990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb2c expref: 6 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528325.391920:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c14ab400, rc 0) 00000100:00100000:3.0:1788528325.392010:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+6:6158:x1875407719629056:12345-192.168.203.38@tcp:101: Request processed in 207us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528325.392027:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 190 00000100:00100000:2.0:1788528325.395861:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528325.396206:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719629184 00000100:00100000:1.0:1788528325.396220:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719629184 00000100:00100000:1.0:1788528325.396284:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 191 00000100:00100000:1.0:1788528325.396295:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+6:6158:x1875407719629184:12345-192.168.203.38@tcp:501: 00000100:00100000:1.0:1788528325.396489:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+6:6158:x1875407719629184:12345-192.168.203.38@tcp:501: Request processed in 195us (641us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788528325.396498:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 191 00000100:00100000:1.0:1788528325.404473:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528325.404590:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719629312 00000100:00100000:2.0:1788528325.404603:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719629312 00000100:00100000:2.0:1788528325.404670:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 192 00000100:00100000:2.0:1788528325.404682:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+6:6158:x1875407719629312:12345-192.168.203.38@tcp:101: 00010000:00010000:2.0:1788528325.404704:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528325.404725:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9101851600/0x892c60dda91c7997 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfb33 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528325.404762:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101851600/0x892c60dda91c7997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb33 expref: 7 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528325.404772:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9101851600/0x892c60dda91c7997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb33 expref: 7 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528325.404797:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101851600, rc 0) 00000100:00100000:2.0:1788528325.404864:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+7:6158:x1875407719629312:12345-192.168.203.38@tcp:101: Request processed in 185us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528325.404869:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 192 00000100:00100000:0.0:1788528325.407767:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528325.407957:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719629440 00000100:00100000:3.0:1788528325.407970:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719629440 00000100:00100000:3.0:1788528325.408054:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 193 00000100:00100000:3.0:1788528325.408068:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+7:6158:x1875407719629440:12345-192.168.203.38@tcp:501: 00000100:00100000:3.0:1788528325.408285:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+8:6158:x1875407719629440:12345-192.168.203.38@tcp:501: Request processed in 219us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528325.408294:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 193 00000100:00100000:3.0:1788528325.410515:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528325.412957:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719629568 00000100:00100000:1.0:1788528325.412977:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719629568 00000100:00100000:1.0:1788528325.413061:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 194 00000100:00100000:1.0:1788528325.413090:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+8:6158:x1875407719629568:12345-192.168.203.38@tcp:503: 00000100:00100000:1.0:1788528325.413832:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+8:6158:x1875407719629568:12345-192.168.203.38@tcp:503: Request processed in 741us (3324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528325.413841:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 194 00000100:00100000:1.0:1788528325.421951:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528325.422117:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719629696 00000100:00100000:2.0:1788528325.422130:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719629696 00000100:00100000:2.0:1788528325.422192:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 195 00000100:00100000:2.0:1788528325.422205:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+8:6176:x1875407719629696:12345-192.168.203.38@tcp:502: 00000100:00100000:2.0:1788528325.422806:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+8:6176:x1875407719629696:12345-192.168.203.38@tcp:502: Request processed in 602us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528325.422815:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 195 00000100:00100000:0.0:1788528325.457448:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528325.457774:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719629824 00000100:00100000:1.0:1788528325.457787:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719629824 00000100:00100000:1.0:1788528325.457862:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 196 00000100:00100000:1.0:1788528325.457882:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+8:6176:x1875407719629824:12345-192.168.203.38@tcp:502: 00000100:00100000:1.0:1788528325.458516:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+8:6176:x1875407719629824:12345-192.168.203.38@tcp:502: Request processed in 633us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528325.458526:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 196 00000100:00100000:3.0:1788528325.463674:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528325.464085:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719629952 00000100:00100000:2.0:1788528325.464098:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719629952 00000100:00100000:2.0:1788528325.464162:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 197 00000100:00100000:2.0:1788528325.464175:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+8:6158:x1875407719629952:12345-192.168.203.38@tcp:101: 00010000:00010000:2.0:1788528325.464197:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528325.464221:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9101850a00/0x892c60dda91c799e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfb64 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528325.464255:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101850a00/0x892c60dda91c799e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb64 expref: 9 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528325.464442:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9101850a00/0x892c60dda91c799e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb64 expref: 9 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528325.464457:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101850a00, rc 0) 00000100:00100000:2.0:1788528325.464746:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+9:6158:x1875407719629952:12345-192.168.203.38@tcp:101: Request processed in 572us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528325.464754:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 197 00000100:00100000:2.0:1788528325.482765:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528325.484477:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719630080 00000100:00100000:1.0:1788528325.484492:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719630080 00000100:00100000:1.0:1788528325.484726:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 198 00000100:00100000:1.0:1788528325.484742:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+9:6158:x1875407719630080:12345-192.168.203.38@tcp:256: 20000000:01000000:1.0:1788528325.484768:0:6501:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788528325.484794:0:6501:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788528325.484799:0:6501:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788528325.484802:0:6501:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788528325.484805:0:6501:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788528325.484807:0:6501:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1788528325.488658:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+9:6158:x1875407719630080:12345-192.168.203.38@tcp:256: Request processed in 3905us (5892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528325.488675:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 198 00000100:00100000:3.0:1788528325.493703:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528325.493973:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719630208 00000100:00100000:2.0:1788528325.493986:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719630208 00000100:00100000:2.0:1788528325.494065:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 199 00000100:00100000:2.0:1788528325.494077:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+9:6158:x1875407719630208:12345-192.168.203.38@tcp:101: 00010000:00010000:2.0:1788528325.494100:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528325.494122:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9101851000/0x892c60dda91c79a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfb6b expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528325.494213:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101851000/0x892c60dda91c79a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb6b expref: 10 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528325.494226:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9101851000/0x892c60dda91c79a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb6b expref: 10 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528325.494237:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101851000, rc 0) 00000100:00100000:2.0:1788528325.494372:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:6158:x1875407719630208:12345-192.168.203.38@tcp:101: Request processed in 297us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528325.494381:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 199 00000100:00100000:2.0:1788528325.501705:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528325.501836:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719630336 00000100:00100000:1.0:1788528325.501846:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719630336 00000100:00100000:1.0:1788528325.501949:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 200 00000100:00100000:1.0:1788528325.501962:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:6158:x1875407719630336:12345-192.168.203.38@tcp:501: 00000100:00100000:1.0:1788528325.502182:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:6158:x1875407719630336:12345-192.168.203.38@tcp:501: Request processed in 222us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528325.502191:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 200 00000100:00100000:0.0:1788528325.505544:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528325.506488:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719630464 00000100:00100000:3.0:1788528325.506505:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719630464 00000100:00100000:3.0:1788528325.506872:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 201 00000100:00100000:3.0:1788528325.506884:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:6158:x1875407719630464:12345-192.168.203.38@tcp:503: 00000100:00100000:3.0:1788528325.507400:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:6158:x1875407719630464:12345-192.168.203.38@tcp:503: Request processed in 515us (1867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528325.507409:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 201 00000100:00100000:0.0:1788528325.511794:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528325.511978:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719630592 00000100:00100000:3.0:1788528325.511992:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719630592 00000100:00100000:3.0:1788528325.512067:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 202 00000100:00100000:3.0:1788528325.512079:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:6179:x1875407719630592:12345-192.168.203.38@tcp:502: 00000100:00100000:3.0:1788528325.512284:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:6179:x1875407719630592:12345-192.168.203.38@tcp:502: Request processed in 206us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528325.512293:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 202 00000100:00100000:2.0:1788528325.519030:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528325.519196:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719630720 00000100:00100000:3.0:1788528325.519210:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719630720 00000100:00100000:3.0:1788528325.519533:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 203 00000100:00100000:3.0:1788528325.519546:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:6179:x1875407719630720:12345-192.168.203.38@tcp:502: 00000100:00100000:3.0:1788528325.519844:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:6179:x1875407719630720:12345-192.168.203.38@tcp:502: Request processed in 300us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528325.519853:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 203 00000100:00100000:0.0:1788528325.524259:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528325.524311:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528325.524352:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719630848 00000100:00100000:1.0:1788528325.524366:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719630848 00000100:00100000:1.0:1788528325.524415:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719631104 00000100:00100000:1.0:1788528325.524419:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719631104 00000100:00100000:1.0:1788528325.524444:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:1.0:1788528325.524454:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2402:x1875407719630848:12345-192.168.203.38@tcp:38: 00010000:00080000:1.0:1788528325.524494:0:8449:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from 80304108-f3b9-46ea-888c-b2a7ec20e3e2@192.168.203.38@tcp t0 exp 0000000000000000 cur 194 last 0 00000100:00100000:0.0:1788528325.524543:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:0.0:1788528325.524548:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2402:x1875407719631104:12345-192.168.203.38@tcp:38: 00000020:00000080:1.0:1788528325.524584:0:8449:0:(genops.c:1385:class_connect()) connect: client 80304108-f3b9-46ea-888c-b2a7ec20e3e2, cookie 0x892c60dda91c79ac 00010000:00080000:0.0:1788528325.524585:0:6510:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from 80304108-f3b9-46ea-888c-b2a7ec20e3e2@192.168.203.38@tcp t0 exp 0000000000000000 cur 194 last 0 00000004:00100000:1.0:1788528325.524617:0:8449:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000020:00000080:0.0:1788528325.524622:0:6510:0:(genops.c:1385:class_connect()) connect: client 80304108-f3b9-46ea-888c-b2a7ec20e3e2, cookie 0x892c60dda91c79b3 00000004:00100000:0.0:1788528325.524635:0:6510:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788528325.524874:0:8449:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d1a800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788528325.524903:0:6510:0:(import.c:65:import_set_state_nolock()) ffff8a90fe6b9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788528325.525107:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2402:x1875407719631104:12345-192.168.203.38@tcp:38: Request processed in 555us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528325.525115:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:1.0:1788528325.525394:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2402:x1875407719630848:12345-192.168.203.38@tcp:38: Request processed in 938us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528325.525402:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7 00010000:00010000:3.0:1788528325.758828:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528326.532674:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528326.535175:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528326.539748:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528326.546645:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719631232 00000100:00100000:3.0:1788528326.546669:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719631232 00000100:00100000:3.0:1788528326.546781:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719630976 00000100:00100000:3.0:1788528326.546785:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719630976 00000100:00100000:3.0:1788528326.546831:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:3.0:1788528326.546844:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:0:x1875407719631232:12345-192.168.203.38@tcp:41: 00000100:00080000:2.0:1788528326.546848:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788528326.546855:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788528326.546877:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:2.0:1788528326.546890:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:0:x1875407719630976:12345-192.168.203.38@tcp:41: 00000004:00000024:3.0:1788528326.546935:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446469632 avail 1300230144 00000004:00000024:2.0:1788528326.546936:0:6508:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788528326.547032:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:0:x1875407719631232:12345-192.168.203.38@tcp:41: Request processed in 190us (14488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528326.547041:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:2.0:1788528326.547051:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:0:x1875407719630976:12345-192.168.203.38@tcp:41: Request processed in 164us (11884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528326.547064:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:1.0:1788528326.547428:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719631360 00000100:00100000:1.0:1788528326.547433:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719631360 00000100:00100000:1.0:1788528326.547497:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:1.0:1788528326.547505:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:6158:x1875407719631360:12345-192.168.203.38@tcp:41: 00000004:00000024:1.0:1788528326.547520:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788528326.547721:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:6158:x1875407719631360:12345-192.168.203.38@tcp:41: Request processed in 217us (7989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528326.547729:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:3.0:1788528326.554177:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528326.554333:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719631488 00000100:00100000:2.0:1788528326.554347:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719631488 00000100:00100000:2.0:1788528326.554421:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:2.0:1788528326.554433:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:6158:x1875407719631488:12345-192.168.203.38@tcp:40: 00000100:00100000:2.0:1788528326.554548:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:6158:x1875407719631488:12345-192.168.203.38@tcp:40: Request processed in 116us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528326.554590:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:3.0:1788528326.556372:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528326.556864:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719631616 00000100:00100000:0.0:1788528326.556896:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719631616 00000100:00100000:0.0:1788528326.556966:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:0.0:1788528326.556976:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2402:x1875407719631616:12345-192.168.203.38@tcp:8: 00010000:00080000:0.0:1788528326.557015:0:8725:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from 80304108-f3b9-46ea-888c-b2a7ec20e3e2@192.168.203.38@tcp t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:0.0:1788528326.557070:0:8725:0:(genops.c:1385:class_connect()) connect: client 80304108-f3b9-46ea-888c-b2a7ec20e3e2, cookie 0x892c60dda91c79ba 00002000:00100000:0.0:1788528326.557085:0:8725:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 80304108-f3b9-46ea-888c-b2a7ec20e3e2/ffff8a90fe6bb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788528326.557106:0:8725:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788528326.558312:0:8725:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788528326.558362:0:8725:0:(import.c:65:import_set_state_nolock()) ffff8a90fe6ba800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788528326.558447:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2402:x1875407719631616:12345-192.168.203.38@tcp:8: Request processed in 1470us (2085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528326.558457:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:3.0:1788528326.566991:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528326.567185:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719631872 00000100:00100000:2.0:1788528326.567198:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719631872 00000100:00100000:2.0:1788528326.567272:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:2.0:1788528326.567292:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:6158:x1875407719631872:12345-192.168.203.38@tcp:900: 00000100:00100000:2.0:1788528326.567390:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:6158:x1875407719631872:12345-192.168.203.38@tcp:900: Request processed in 99us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528326.567399:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:3.0:1788528326.567754:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528326.567886:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719632000 00000100:00100000:1.0:1788528326.567892:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719632000 00000100:00100000:1.0:1788528326.567942:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 204 00000100:00100000:1.0:1788528326.567950:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:2405:x1875407719632000:12345-192.168.203.38@tcp:400: 00000100:00100000:1.0:1788528326.568017:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:2405:x1875407719632000:12345-192.168.203.38@tcp:400: Request processed in 68us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528326.568025:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 204 00000100:00100000:0.0:1788528326.568120:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528326.568209:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719631744 00000100:00100000:1.0:1788528326.568214:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719631744 00000100:00100000:1.0:1788528326.568246:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:1.0:1788528326.568252:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2402:x1875407719631744:12345-192.168.203.38@tcp:8: 00010000:00080000:1.0:1788528326.568296:0:8423:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from 80304108-f3b9-46ea-888c-b2a7ec20e3e2@192.168.203.38@tcp t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:1.0:1788528326.568332:0:8423:0:(genops.c:1385:class_connect()) connect: client 80304108-f3b9-46ea-888c-b2a7ec20e3e2, cookie 0x892c60dda91c79c1 00002000:00100000:1.0:1788528326.568347:0:8423:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 80304108-f3b9-46ea-888c-b2a7ec20e3e2/ffff8a8fc3d1f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788528326.568369:0:8423:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788528326.568603:0:8423:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788528326.568638:0:8423:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d18000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788528326.568677:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2402:x1875407719631744:12345-192.168.203.38@tcp:8: Request processed in 423us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528326.568684:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:0.0:1788528326.577442:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528326.577721:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719632128 00000100:00100000:1.0:1788528326.577734:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719632128 00000100:00100000:1.0:1788528326.577803:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:1.0:1788528326.577815:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:6158:x1875407719632128:12345-192.168.203.38@tcp:33: 00000004:00080000:1.0:1788528326.600132:0:6511:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 22186us 00000004:00200000:1.0:1788528326.629714:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788528326.629872:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:6158:x1875407719632128:12345-192.168.203.38@tcp:33: Request processed in 52049us (52435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528326.629886:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 0 00010000:00010000:0.0:1788528326.782777:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528326.883863:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528326.884297:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719632256 00000100:00100000:1.0:1788528326.884307:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719632256 00000100:00100000:1.0:1788528326.884363:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:1.0:1788528326.884372:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:6197:x1875407719632256:12345-192.168.203.38@tcp:101: 00010000:00010000:1.0:1788528326.884390:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528326.884459:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16a00/0x892c60dda91c79c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfb9c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528326.884519:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c79cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528326.884532:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c79cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528326.884595:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c79cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528326.884645:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788528326.884648:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788528326.884663:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c79cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528326.884686:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16a00/0x892c60dda91c79c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb9c expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528326.884703:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c79cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb9c expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528326.884725:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c3ab0100) 00010000:00010000:1.0:1788528326.884728:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788528326.884732:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e16c00, rc 0) 00000100:00100000:1.0:1788528326.884846:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:6197:x1875407719632256:12345-192.168.203.38@tcp:101: Request processed in 474us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528326.884853:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 13 00010000:00010000:1.0:1788528327.806778:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528327.871107:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735408512:0@lo:41: 00000100:00100000:3.0:1788528327.871126:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788528327.871144:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc374dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735408640:0@lo:13: 00000100:00100000:2.0:1788528327.871181:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528327.871188:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528327.871264:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735408640 00000100:00100000:2.0:1788528327.871271:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735408640 00000100:00100000:2.0:1788528327.871329:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788528327.871340:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735408640:12345-0@lo:13: 00002000:00000024:2.0:1788528327.871370:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788528327.871417:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875407735409024:0@lo:400: 00000100:00100000:2.0:1788528327.871426:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735408640:12345-0@lo:13: Request processed in 88us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528327.871433:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788528327.871455:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788528327.871473:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735408896:0@lo:400: 00000100:00100000:0.0:1788528327.873251:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528327.873339:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735409536:0@lo:400: 00000100:00100000:0.0:1788528327.873394:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528327.873425:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735410048:0@lo:400: 00000100:00100000:0.0:1788528327.873453:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528327.873787:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735409024 00000100:00100000:2.0:1788528327.873795:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735409024 00000100:00100000:1.0:1788528327.875443:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735409152:0@lo:400: 00000100:00100000:1.0:1788528327.875519:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528327.875588:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735409664:0@lo:400: 00000100:00100000:1.0:1788528327.875670:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735408512 00000100:00100000:1.0:1788528327.875677:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735408512 00000100:00100000:1.0:1788528327.875716:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735409152 00000100:00100000:1.0:1788528327.875719:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735409152 00000100:00100000:1.0:1788528327.875733:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788528327.875740:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735408512:12345-0@lo:41: 00000004:00000024:1.0:1788528327.875773:0:9268:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788528327.875815:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735408512:12345-0@lo:41: Request processed in 75us (4635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528327.875822:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788528327.875837:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788528327.875842:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735409152:12345-0@lo:400: 00000100:00100000:1.0:1788528327.875865:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735409152:12345-0@lo:400: Request processed in 23us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528327.875871:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1788528327.884818:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc374dc00 x1875407735408640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528327.884835:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1788528327.884868:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc374dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735408640:0@lo:13: 00000100:00100000:3.0:1788528327.884913:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735408768:0@lo:400: 00000100:00100000:3.0:1788528327.884971:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528327.885003:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1875407735409280:0@lo:400: 00000100:00100000:3.0:1788528327.885026:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528327.886482:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1875407735409792:0@lo:400: 00000100:00100000:3.0:1788528327.886526:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528327.895325:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735409280 00000100:00100000:2.0:1788528327.895340:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735409280 00000100:00100000:2.0:1788528327.895414:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788528327.895426:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875407735409024:12345-0@lo:400: 00000100:00100000:2.0:1788528327.895520:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875407735409024:12345-0@lo:400: Request processed in 97us (24062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528327.895527:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788528327.895543:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788528327.895550:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875407735409280:12345-0@lo:400: 00000100:00100000:2.0:1788528327.895594:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875407735409280:12345-0@lo:400: Request processed in 45us (10566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528327.895600:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788528327.895621:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788528327.895721:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735408768 00000100:00100000:2.0:1788528327.895726:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735408768 00000100:00100000:2.0:1788528327.895756:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788528327.895763:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:3640:x1875407735408768:12345-0@lo:400: 00000100:00100000:2.0:1788528327.895797:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:3640:x1875407735408768:12345-0@lo:400: Request processed in 35us (10825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528327.895803:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788528327.901216:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735408768:0@lo:400: 00000100:00100000:3.0:1788528327.901239:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1875407735409280:0@lo:400: 00000100:00100000:3.0:1788528327.901264:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788528327.901293:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735410176:0@lo:13: 00000100:00100000:3.0:1788528327.901349:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528327.901393:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735410176 00000100:00100000:3.0:1788528327.901400:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735410176 00000100:00100000:3.0:1788528327.901455:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788528327.901587:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735410176:12345-0@lo:13: 00002000:00000024:3.0:1788528327.901607:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788528327.901646:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735410176:12345-0@lo:13: Request processed in 183us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528327.901652:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788528327.901672:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788528327.901696:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6da3480 x1875407735410176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528327.901706:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788528327.901720:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735410176:0@lo:13: 00000100:00100000:3.0:1788528327.901736:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735409792 00000100:00100000:3.0:1788528327.901740:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735409792 00000100:00100000:3.0:1788528327.901768:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788528327.901774:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875407735409792:12345-0@lo:400: 00000100:00100000:3.0:1788528327.901809:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875407735409792:12345-0@lo:400: Request processed in 35us (15282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528327.901815:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1788528327.901831:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788528327.901846:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1875407735409792:0@lo:400: 00000100:00100000:3.0:1788528327.901884:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528327.901920:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735409408:0@lo:400: 00000100:00100000:3.0:1788528327.901942:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528327.901973:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1875407735409920:0@lo:400: 00000100:00100000:3.0:1788528327.903568:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528327.905759:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735409536 00000100:00100000:1.0:1788528327.905774:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735409536 00000100:00080000:1.0:1788528327.905821:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788528327.905878:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735410048 00000100:00100000:1.0:1788528327.905882:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735410048 00000100:00100000:1.0:1788528327.905924:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788528327.905934:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735409536:12345-0@lo:400: 00000100:00100000:2.0:1788528327.906406:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735408896 00000100:00100000:2.0:1788528327.906412:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735408896 00000100:00100000:2.0:1788528327.906445:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735409408 00000100:00100000:2.0:1788528327.906449:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735409408 00000100:00100000:2.0:1788528327.906636:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735409920 00000100:00100000:2.0:1788528327.906640:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735409920 00000100:00100000:2.0:1788528327.906659:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788528327.906665:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735408896:12345-0@lo:400: 00000100:00100000:0.0:1788528327.906787:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735408512:0@lo:41: 00000100:00100000:0.0:1788528327.906823:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875407735409024:0@lo:400: 00000100:00100000:0.0:1788528327.906894:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788528327.906917:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735410048:12345-0@lo:400: 00000100:00100000:0.0:1788528327.907003:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735410048:12345-0@lo:400: Request processed in 89us (33536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528327.907012:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788528327.907050:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90faa09500 x1875407735410048/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528327.907061:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735410048:0@lo:400: 00000100:00100000:0.0:1788528327.907101:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528327.907651:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735409664 00000100:00100000:0.0:1788528327.907656:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735409664 00000100:00100000:0.0:1788528327.907683:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788528327.907689:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735409664:12345-0@lo:400: 00000100:00100000:0.0:1788528327.907726:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735409664:12345-0@lo:400: Request processed in 37us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528327.907733:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788528327.907760:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6ea2d80 x1875407735409664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528327.907769:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735409664:0@lo:400: 00000100:00100000:0.0:1788528327.907791:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735409152:0@lo:400: 00000100:00080000:0.0:1788528327.907822:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788528327.907826:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788528327.907855:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788528327.907864:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735409408:12345-0@lo:400: 00000100:00100000:0.0:1788528327.907895:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735409408:12345-0@lo:400: Request processed in 34us (5952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528327.907901:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788528327.907937:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788528327.907944:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875407735409920:12345-0@lo:400: 00000100:00100000:0.0:1788528327.907975:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875407735409920:12345-0@lo:400: Request processed in 32us (4426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528327.907981:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1788528327.908612:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6ea3480 x1875407735409920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528327.908623:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1875407735409920:0@lo:400: 00010000:00080000:3.0:1788528327.908647:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6ea1880 x1875407735409408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528327.908656:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735409408:0@lo:400: 00000100:00100000:1.0:1788528327.908843:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735409536:12345-0@lo:400: Request processed in 2910us (35447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528327.908851:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788528327.908949:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6ea0e00 x1875407735409536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528327.908959:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735409536:0@lo:400: 00000100:00100000:2.0:1788528327.909343:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735408896:12345-0@lo:400: Request processed in 2675us (7456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528327.909353:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788528327.909438:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735408896:0@lo:400: 00010000:00010000:0.0:1788528328.830758:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528328.896321:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735410304:0@lo:13: 00000100:00100000:1.0:1788528328.896404:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528328.896583:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735410304 00000100:00100000:2.0:1788528328.896591:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735410304 00000100:00100000:2.0:1788528328.896634:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788528328.896643:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735410304:12345-0@lo:13: 00002000:00000024:2.0:1788528328.896672:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788528328.896791:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788528328.896804:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735410432:0@lo:13: 00000100:00100000:0.0:1788528328.896835:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528328.898438:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735410432 00000100:00100000:3.0:1788528328.898449:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735410432 00000100:00100000:3.0:1788528328.898518:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788528328.898528:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735410432:12345-0@lo:13: 00002000:00000024:3.0:1788528328.898549:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788528328.898634:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735410432:12345-0@lo:13: Request processed in 107us (1798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528328.898641:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788528328.898950:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90faa0b480 x1875407735410432/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528328.898970:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735410432:0@lo:13: 00000100:00100000:2.0:1788528328.913464:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735410304:12345-0@lo:13: Request processed in 16811us (17048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528328.913481:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788528328.913702:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6fec380 x1875407735410304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528328.913726:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735410304:0@lo:13: 00000100:00100000:0.0:1788528329.442949:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528329.443088:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719632384 00000100:00100000:3.0:1788528329.443098:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719632384 00000100:00100000:3.0:1788528329.443182:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:3.0:1788528329.443193:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:6250:x1875407719632384:12345-192.168.203.38@tcp:41: 00000004:00000024:3.0:1788528329.443229:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788528329.443299:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:6250:x1875407719632384:12345-192.168.203.38@tcp:41: Request processed in 108us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528329.443306:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00080000:0.0:1788528329.443387:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788528329.448074:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528329.448232:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719632512 00000100:00100000:3.0:1788528329.448243:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719632512 00000100:00100000:3.0:1788528329.448321:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:3.0:1788528329.448333:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:6250:x1875407719632512:12345-192.168.203.38@tcp:41: 00000004:00000024:3.0:1788528329.448385:0:8449:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446469632 avail 1300230144 00000100:00100000:3.0:1788528329.448799:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:6250:x1875407719632512:12345-192.168.203.38@tcp:41: Request processed in 466us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528329.448807:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00080000:0.0:1788528329.449269:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788528329.452698:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528329.452779:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719632640 00000100:00100000:3.0:1788528329.452789:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719632640 00000100:00100000:3.0:1788528329.452877:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:3.0:1788528329.452888:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:6250:x1875407719632640:12345-192.168.203.38@tcp:13: 00002000:00000024:3.0:1788528329.452923:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788528329.453356:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:6250:x1875407719632640:12345-192.168.203.38@tcp:13: Request processed in 469us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528329.453363:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00080000:0.0:1788528329.453460:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788528329.482696:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528329.490381:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719632768 00000100:00100000:3.0:1788528329.490405:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719632768 00000100:00100000:0.0:1788528329.490734:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:0.0:1788528329.490745:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:6250:x1875407719632768:12345-192.168.203.38@tcp:13: 00002000:00000024:0.0:1788528329.490770:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788528329.490839:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:6250:x1875407719632768:12345-192.168.203.38@tcp:13: Request processed in 96us (8152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528329.490845:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00080000:1.0:1788528329.490972:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788528329.854782:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528329.918808:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc374c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735410560:0@lo:41: 00000100:00100000:0.0:1788528329.918886:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528329.919165:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735410560 00000100:00100000:1.0:1788528329.919174:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735410560 00000100:00100000:1.0:1788528329.919219:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788528329.919228:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735410560:12345-0@lo:41: 00000004:00000024:1.0:1788528329.919262:0:9268:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446469632 avail 1300230144 00000100:00100000:1.0:1788528329.919313:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735410560:12345-0@lo:41: Request processed in 86us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528329.919319:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788528329.919678:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc374c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735410560:0@lo:41: 00010000:00010000:3.0:1788528330.878757:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788528330.944825:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 80304108-f3b9-46ea-888c-b2a7ec20e3e2 00010000:00010000:0.0:1788528331.905897:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788528331.967812:0:7440:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 80304108-f3b9-46ea-888c-b2a7ec20e3e2 00000001:00100000:2.0:1788528331.968820:0:6487:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 80304108-f3b9-46ea-888c-b2a7ec20e3e2 00000100:00100000:2.0:1788528331.974374:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528331.974420:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528331.974456:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528331.974487:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528331.974513:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528331.974541:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719633024 00000100:00100000:2.0:1788528331.974550:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719633024 00000100:00100000:2.0:1788528331.974634:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719633152 00000100:00100000:2.0:1788528331.974637:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719633152 00000100:00100000:2.0:1788528331.974677:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:2.0:1788528331.974687:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2406:x1875407719633024:12345-192.168.203.38@tcp:400: 00000100:00100000:2.0:1788528331.974754:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2406:x1875407719633024:12345-192.168.203.38@tcp:400: Request processed in 69us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528331.974762:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:2.0:1788528331.974779:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:2.0:1788528331.974785:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2405:x1875407719633152:12345-192.168.203.38@tcp:400: 00000100:00100000:2.0:1788528331.974810:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2405:x1875407719633152:12345-192.168.203.38@tcp:400: Request processed in 26us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528331.974816:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:2.0:1788528331.974835:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719633280 00000100:00100000:2.0:1788528331.974839:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719633280 00000100:00100000:2.0:1788528331.974859:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719633408 00000100:00100000:2.0:1788528331.974862:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719633408 00000100:00100000:2.0:1788528331.974895:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:2.0:1788528331.974902:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2406:x1875407719633280:12345-192.168.203.38@tcp:400: 00000100:00100000:2.0:1788528331.974929:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2406:x1875407719633280:12345-192.168.203.38@tcp:400: Request processed in 28us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528331.974935:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:2.0:1788528331.974946:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:2.0:1788528331.974952:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2405:x1875407719633408:12345-192.168.203.38@tcp:400: 00000100:00100000:2.0:1788528331.974975:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2405:x1875407719633408:12345-192.168.203.38@tcp:400: Request processed in 23us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528331.974980:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00080000:2.0:1788528331.974994:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788528331.975158:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719632896 00000100:00100000:0.0:1788528331.975162:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719632896 00000100:00100000:0.0:1788528331.975190:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 206 00000100:00100000:0.0:1788528331.975196:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d9d54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:2405:x1875407719632896:12345-192.168.203.38@tcp:400: 00000100:00100000:0.0:1788528331.975220:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d9d54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:2405:x1875407719632896:12345-192.168.203.38@tcp:400: Request processed in 25us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528331.975226:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 206 00000100:00080000:2.0:1788528331.977885:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788528331.977890:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788528331.977892:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1788528332.453411:0:10177:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788528332.926821:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528332.990917:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735410816:0@lo:13: 00000100:00100000:2.0:1788528332.990992:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528332.991118:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788528332.991134:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735410944:0@lo:41: 00000100:00100000:2.0:1788528332.991142:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788528332.991156:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735410688:0@lo:13: 00000100:00100000:1.0:1788528332.991174:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528332.991192:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528332.991312:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735411200:0@lo:400: 00000100:00100000:0.0:1788528332.991345:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528332.991365:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735411712:0@lo:400: 00000100:00100000:0.0:1788528332.991385:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528332.991425:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735410944 00000100:00100000:1.0:1788528332.991433:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735410944 00000100:00100000:2.0:1788528332.991453:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735411328:0@lo:400: 00000100:00100000:1.0:1788528332.991479:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788528332.991490:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735410944:12345-0@lo:41: 00000100:00100000:2.0:1788528332.991498:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528332.991519:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735411840:0@lo:400: 00000004:00000024:1.0:1788528332.991527:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788528332.991545:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528332.991587:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735412352:0@lo:400: 00000100:00100000:1.0:1788528332.991597:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735410944:12345-0@lo:41: Request processed in 107us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528332.991605:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788528332.991613:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528332.991640:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735411072:0@lo:400: 00000100:00100000:1.0:1788528332.991677:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528332.991712:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735411584:0@lo:400: 00000100:00100000:1.0:1788528332.991736:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528332.991755:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735412096:0@lo:400: 00000100:00100000:1.0:1788528332.991777:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528332.991807:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735410944:0@lo:41: 00000100:00100000:1.0:1788528332.991824:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788528332.991829:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735411456:0@lo:400: 00000100:00100000:1.0:1788528332.991850:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528332.991862:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735411840 00000100:00100000:2.0:1788528332.991877:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735411840 00000100:00100000:1.0:1788528332.991882:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735411968:0@lo:400: 00000100:00100000:1.0:1788528332.991909:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528332.991951:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735412224:0@lo:400: 00000100:00100000:0.0:1788528332.991989:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528332.992017:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735411200 00000100:00100000:0.0:1788528332.992021:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735411200 00000100:00100000:0.0:1788528332.992043:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735411712 00000100:00100000:0.0:1788528332.992046:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735411712 00000100:00100000:0.0:1788528332.992060:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735411328 00000100:00100000:0.0:1788528332.992062:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735411328 00000100:00100000:0.0:1788528332.992071:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735411584 00000100:00100000:0.0:1788528332.992073:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735411584 00000100:00100000:0.0:1788528332.992096:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735412096 00000100:00100000:0.0:1788528332.992099:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735412096 00000100:00100000:0.0:1788528332.992110:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735412224 00000100:00100000:0.0:1788528332.992113:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735412224 00000100:00100000:0.0:1788528332.992125:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788528332.992131:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735411200:12345-0@lo:400: 00000100:00100000:0.0:1788528332.992172:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735411200:12345-0@lo:400: Request processed in 40us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528332.992178:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788528332.992190:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788528332.992196:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735411712:12345-0@lo:400: 00000100:00100000:0.0:1788528332.992222:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735411712:12345-0@lo:400: Request processed in 27us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528332.992228:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788528332.992239:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788528332.992244:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735411328:12345-0@lo:400: 00000100:00100000:0.0:1788528332.992274:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735411328:12345-0@lo:400: Request processed in 29us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528332.992280:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788528332.992290:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788528332.992296:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735411584:12345-0@lo:400: 00000100:00100000:0.0:1788528332.992323:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735411584:12345-0@lo:400: Request processed in 27us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528332.992328:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788528332.992338:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788528332.992344:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735412096:12345-0@lo:400: 00000100:00100000:0.0:1788528332.992367:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735412096:12345-0@lo:400: Request processed in 24us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528332.992379:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788528332.992390:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788528332.992396:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735412224:12345-0@lo:400: 00000100:00100000:0.0:1788528332.992423:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735412224:12345-0@lo:400: Request processed in 27us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528332.992428:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788528332.992657:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735410816 00000100:00100000:3.0:1788528332.992662:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735410816 00000100:00100000:3.0:1788528332.992692:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735410688 00000100:00100000:3.0:1788528332.992695:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735410688 00000100:00100000:3.0:1788528332.992712:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788528332.992719:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735410816:12345-0@lo:13: 00002000:00000024:3.0:1788528332.992740:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788528332.992773:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735410816:12345-0@lo:13: Request processed in 55us (1782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528332.992788:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788528332.992800:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788528332.992805:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735410688:12345-0@lo:13: 00002000:00000024:3.0:1788528332.992813:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788528332.992836:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735410688:12345-0@lo:13: Request processed in 31us (1647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528332.992842:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788528332.993885:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735411584:0@lo:400: 00000100:00100000:1.0:1788528332.993903:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735412096:0@lo:400: 00000100:00100000:1.0:1788528332.994074:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735411072 00000100:00100000:1.0:1788528332.994080:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735411072 00000100:00100000:2.0:1788528332.994239:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735412352 00000100:00100000:2.0:1788528332.994244:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735412352 00000100:00100000:2.0:1788528332.994279:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735411968 00000100:00100000:2.0:1788528332.994282:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735411968 00000100:00100000:2.0:1788528332.994302:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788528332.994310:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735411840:12345-0@lo:400: 00000100:00100000:2.0:1788528332.994365:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735411840:12345-0@lo:400: Request processed in 56us (2820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528332.994372:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788528332.994385:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788528332.994390:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735412352:12345-0@lo:400: 00000100:00100000:2.0:1788528332.994415:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735412352:12345-0@lo:400: Request processed in 25us (2803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528332.994442:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788528332.994455:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788528332.994462:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735411968:12345-0@lo:400: 00000100:00100000:2.0:1788528332.994750:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735411968:12345-0@lo:400: Request processed in 288us (2841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528332.994757:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788528332.994777:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788528332.994783:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788528332.994785:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788528332.994789:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788528332.994933:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735411200:0@lo:400: 00000100:00100000:3.0:1788528332.995211:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735411456 00000100:00100000:3.0:1788528332.995334:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735411456 00000100:00100000:3.0:1788528332.995372:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788528332.995379:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735411456:12345-0@lo:400: 00010000:00080000:0.0:1788528332.995487:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90faa09180 x1875407735411712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528332.995499:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735411712:0@lo:400: 00000100:00100000:1.0:1788528332.995521:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788528332.995531:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+27:3638:x1875407735411072:12345-0@lo:400: 00000100:00100000:2.0:1788528332.995641:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735411328:0@lo:400: 00010000:00080000:2.0:1788528332.995684:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90faa08e00 x1875407735411840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528332.995694:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735411840:0@lo:400: 00010000:00080000:2.0:1788528332.995708:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f8e20a80 x1875407735412352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528332.995716:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735412352:0@lo:400: 00010000:00080000:2.0:1788528332.995727:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6fec380 x1875407735410688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528332.995741:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735410688:0@lo:13: 00010000:00080000:2.0:1788528332.995753:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6da1880 x1875407735410816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528332.995764:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735410816:0@lo:13: 00010000:00080000:2.0:1788528332.995842:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90faa09f80 x1875407735411968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528332.995859:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735411968:0@lo:400: 00000001:00100000:2.0:1788528332.996686:0:8416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 80304108-f3b9-46ea-888c-b2a7ec20e3e2 00000100:00100000:3.0:1788528332.996797:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735411456:12345-0@lo:400: Request processed in 1414us (4942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528332.996807:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1788528332.996807:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90faa0ad80 x1875407735412224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528332.996822:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735412224:0@lo:400: 00000100:00100000:2.0:1788528332.996905:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735411456:0@lo:400: 00000100:00100000:2.0:1788528332.996940:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735411072:0@lo:400: 00000100:00100000:1.0:1788528332.996988:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+27:3638:x1875407735411072:12345-0@lo:400: Request processed in 1408us (5261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528332.996998:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00010000:00010000:2.0:1788528333.950698:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528334.015720:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc374c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735412608:0@lo:13: 00000100:00100000:2.0:1788528334.015796:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528334.015852:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788528334.015858:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735412480:0@lo:13: 00000100:00100000:2.0:1788528334.015899:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528334.015927:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735412608 00000100:00100000:2.0:1788528334.015934:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735412608 00000100:00100000:1.0:1788528334.015972:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735412480 00000100:00100000:1.0:1788528334.015978:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735412480 00000100:00100000:2.0:1788528334.015989:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788528334.016002:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735412608:12345-0@lo:13: 00000100:00100000:1.0:1788528334.016011:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788528334.016021:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735412480:12345-0@lo:13: 00002000:00000024:1.0:1788528334.016044:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1788528334.016054:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788528334.016253:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788528334.016285:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6da0e00 x1875407735412480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528334.016302:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735412480:0@lo:13: 00000100:00100000:2.0:1788528334.016416:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735412608:12345-0@lo:13: Request processed in 417us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528334.016423:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1788528334.016636:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc374c700 x1875407735412608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528334.016649:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc374c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735412608:0@lo:13: 00000100:00100000:1.0:1788528334.018420:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735412480:12345-0@lo:13: Request processed in 2394us (2513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528334.018433:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1788528334.975695:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528335.040052:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788528335.040088:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc374c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735412736:0@lo:41: 00000100:00100000:2.0:1788528335.040195:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528335.040275:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735412736 00000100:00100000:2.0:1788528335.040286:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735412736 00000100:00100000:2.0:1788528335.040346:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788528335.040358:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735412736:12345-0@lo:41: 00000004:00000024:2.0:1788528335.040414:0:9268:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446469632 avail 1300230144 00000100:00100000:2.0:1788528335.040469:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735412736:12345-0@lo:41: Request processed in 113us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528335.040477:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788528335.040535:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc374c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735412736:0@lo:41: 00010000:00010000:3.0:1788528335.998694:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788528336.548854:0:10324:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd46aeda60 20000000:00000080:2.0:1788528336.548945:0:10324:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a8fc37d2c00 uarg=0000000000000000 20000000:01000000:2.0:1788528336.549072:0:10324:0:(mgs_llog.c:2012:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788528336.549075:0:10324:0:(mgs_llog.c:6075:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788528336.549079:0:10324:0:(mgs_llog.c:6106:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788528336.549085:0:10324:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788528336.549091:0:10324:0:(mgs_llog.c:4187:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788528336.549170:0:10324:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788528336.549174:0:10324:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788528336.550212:0:10325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1788528336.550538:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1788528336.550620:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1788528336.550637:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:2.0:1788528336.550649:0:10324:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788528336.550652:0:10324:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788528336.551902:0:10326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1788528336.552735:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1788528336.552785:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1788528336.552802:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1788528336.552818:0:10324:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788528336.552821:0:10324:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788528336.553684:0:10327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1788528336.554184:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1788528336.554215:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1788528336.554235:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:3.0:1788528336.554248:0:10324:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788528336.554324:0:10324:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788528336.554817:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:3.0:1788528336.555016:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:3.0:1788528336.555038:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:3.0:1788528336.555054:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:3.0:1788528336.555065:0:10324:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788528336.555067:0:10324:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788528336.555635:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1788528336.555819:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1788528336.555842:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1788528336.555870:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:3.0:1788528336.555888:0:10324:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788528336.555916:0:10324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a90c14aae00/0x892c60dda91c79d6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.555939:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c13fce00/0x892c60dda91c7847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7840 expref: 26 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.555949:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a8fc26e3c00/0x892c60dda91c7855 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c784e expref: 26 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.555956:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c787f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7878 expref: 26 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.555963:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90f6e17200/0x892c60dda91c78be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c78b7 expref: 26 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.555970:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a8fc26e2200/0x892c60dda91c78cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c78c5 expref: 26 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.555978:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a8fc26e2600/0x892c60dda91c78da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c78d3 expref: 26 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.555986:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c14abc00/0x892c60dda91c78e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c78e1 expref: 26 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.556002:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c14aba00/0x892c60dda91c7904 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c78fd expref: 26 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.556010:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a8fc26e2800/0x892c60dda91c7927 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7920 expref: 26 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.556016:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a8fc26e3600/0x892c60dda91c7935 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c792e expref: 26 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.556023:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7958 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7951 expref: 26 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.556030:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90f6e17800/0x892c60dda91c7982 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c797b expref: 26 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.556041:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c14ab400/0x892c60dda91c7990 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb2c expref: 9 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.556049:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9101851600/0x892c60dda91c7997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb33 expref: 9 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.556058:0:10324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a90c14aae00/0x892c60dda91c79d6 lrc: 17/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.556182:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9101851600/0x892c60dda91c7997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb33 expref: 9 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.556202:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a9101851600/0x892c60dda91c7997 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb33 expref: 9 pid: 6500 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528336.556232:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fec380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875407735412864:192.168.203.38@tcp:104: 00010000:00010000:3.0:1788528336.556445:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c14ab400/0x892c60dda91c7990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb2c expref: 9 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.556456:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a90c14ab400/0x892c60dda91c7990 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb2c expref: 9 pid: 6502 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528336.556465:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875407735412992:192.168.203.38@tcp:104: 00010000:00010000:3.0:1788528336.556496:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90f6e17800/0x892c60dda91c7982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c797b expref: 26 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.556505:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a90f6e17800/0x892c60dda91c7982 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c797b expref: 26 pid: 6500 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528336.556515:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875407735413120:0@lo:104: 00000100:00100000:3.0:1788528336.561140:0:10324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528336.561237:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00010000:00010000:3.0:1788528336.561320:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c7951 expref: 26 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528336.561340:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528336.561376:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719633664 00000100:00100000:0.0:1788528336.561386:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719633664 00010000:00010000:0.0:1788528336.561435:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c14ab400/0x892c60dda91c7990 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb2c expref: 10 pid: 6502 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.561453:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7958 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c7951 expref: 26 pid: 6501 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528336.561468:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719633536 00000100:00100000:3.0:1788528336.561469:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875407735413248:0@lo:104: 00000100:00100000:0.0:1788528336.561495:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719633536 00010000:00010000:0.0:1788528336.561510:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9101851600/0x892c60dda91c7997 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb33 expref: 11 pid: 6500 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.561528:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a8fc26e3600/0x892c60dda91c7935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c792e expref: 26 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528336.561532:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1788528336.561537:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a8fc26e3600/0x892c60dda91c7935 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c792e expref: 26 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528336.561537:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:0.0:1788528336.561578:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90efa86850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+11:2403:x1875407719633664:12345-192.168.203.38@tcp:103: 00000100:00100000:1.0:1788528336.561586:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788528336.561596:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528336.561604:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c14ab400/0x892c60dda91c7990 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb2c expref: 11 pid: 6502 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528336.561609:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735413120 00000100:00100000:1.0:1788528336.561615:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735413120 00000100:00100000:3.0:1788528336.561640:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875407735413376:0@lo:104: 00000100:00100000:1.0:1788528336.561653:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735413248 00000100:00100000:1.0:1788528336.561657:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735413248 00000100:00100000:3.0:1788528336.561673:0:10324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528336.561679:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788528336.561689:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+4:10324:x1875407735413120:12345-0@lo:104: 00010000:00010000:1.0:1788528336.561704:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c797b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7982 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528336.561731:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:2.0:1788528336.561744:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+11:2404:x1875407719633536:12345-192.168.203.38@tcp:103: 00010000:00010000:2.0:1788528336.561755:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528336.561761:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9101851600/0x892c60dda91c7997 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb33 expref: 11 pid: 6500 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.561763:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788528336.561876:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+4:10324:x1875407735413120:12345-0@lo:104: Request processed in 190us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528336.561884:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788528336.561944:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735413376 00000100:00100000:1.0:1788528336.561948:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735413376 00000100:00100000:1.0:1788528336.561963:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788528336.561968:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+4:10324:x1875407735413248:12345-0@lo:104: 00010000:00010000:1.0:1788528336.561977:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7951 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7958 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.562012:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788528336.562017:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+4:10324:x1875407735413248:12345-0@lo:104: Request processed in 49us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528336.562023:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788528336.562035:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788528336.562041:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+3:10324:x1875407735413376:12345-0@lo:104: 00010000:00010000:1.0:1788528336.562049:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2a00/0x892c60dda91c792e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7935 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.562082:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788528336.562086:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+3:10324:x1875407735413376:12345-0@lo:104: Request processed in 46us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528336.562311:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1788528336.562353:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788528336.562360:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c797b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7982 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.562368:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101851200 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528336.562379:0:8440:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c797b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c7982 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.562389:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c797b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c7982 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528336.562397:0:8440:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c797b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c7982 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528336.562403:0:8440:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788528336.562440:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c797b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7982 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.562447:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528336.562469:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c797b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7982 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.562476:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c797b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7982 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.562489:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788528336.562492:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7951 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7958 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.562498:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101851a00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528336.562501:0:8440:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7951 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c7958 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.562508:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c7958 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.562513:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c14ab400/0x892c60dda91c7990 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb2c expref: 11 pid: 6502 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528336.562533:0:8440:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c7958 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528336.562539:0:8440:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788528336.562545:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788528336.562580:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7951 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7958 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.562588:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528336.562606:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7951 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7958 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.562613:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7951 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7958 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.562623:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788528336.562624:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90efa86850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+11:2403:x1875407719633664:12345-192.168.203.38@tcp:103: Request processed in 1075us (1388us total) trans 0 rc 0/0 00010000:00010000:1.0:1788528336.562629:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2a00/0x892c60dda91c792e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7935 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528336.562637:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 27 00010000:00010000:1.0:1788528336.562639:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e2a00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528336.562644:0:8440:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2a00/0x892c60dda91c792e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c7935 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.562652:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2a00/0x892c60dda91c792e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c7935 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528336.562659:0:8440:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2a00/0x892c60dda91c792e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c7935 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528336.562664:0:8440:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788528336.562688:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2a00/0x892c60dda91c792e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7935 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.562694:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528336.562701:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2a00/0x892c60dda91c792e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7935 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.562707:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2a00/0x892c60dda91c792e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7935 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.562708:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528336.562720:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528336.562722:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528336.562725:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528336.562733:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528336.562756:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735413504:0@lo:103: 00000100:00100000:1.0:1788528336.562795:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528336.562853:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735413504 00000100:00100000:0.0:1788528336.562859:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735413504 00010000:00010000:0.0:1788528336.562879:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90f6e17800/0x892c60dda91c7982 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c797b expref: 27 pid: 6500 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528336.562900:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788528336.562907:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+27:3640:x1875407735413504:12345-0@lo:103: 00010000:00010000:0.0:1788528336.562916:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528336.562920:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90f6e17800/0x892c60dda91c7982 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c797b expref: 27 pid: 6500 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.562942:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90f6e17800/0x892c60dda91c7982 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c797b expref: 27 pid: 6500 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.562954:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528336.562955:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735413632:0@lo:103: 00000100:00100000:1.0:1788528336.562995:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528336.562999:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+27:3640:x1875407735413504:12345-0@lo:103: Request processed in 91us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528336.563008:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788528336.563023:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735413632 00000100:00100000:1.0:1788528336.563025:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788528336.563028:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735413632 00000100:00100000:1.0:1788528336.563034:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735413760:0@lo:103: 00010000:00010000:0.0:1788528336.563045:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7958 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7951 expref: 27 pid: 6501 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528336.563065:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528336.563066:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788528336.563260:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735413632:12345-0@lo:103: 00010000:00010000:0.0:1788528336.563270:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528336.563274:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7958 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7951 expref: 27 pid: 6501 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.563282:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7958 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c7951 expref: 27 pid: 6501 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.563292:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528336.563331:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735413632:12345-0@lo:103: Request processed in 256us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528336.563337:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788528336.563349:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735413760 00000100:00100000:0.0:1788528336.563353:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735413760 00010000:00010000:0.0:1788528336.563365:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a8fc26e3600/0x892c60dda91c7935 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c792e expref: 27 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528336.563393:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788528336.563399:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735413760:12345-0@lo:103: 00010000:00010000:0.0:1788528336.563407:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528336.563411:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a8fc26e3600/0x892c60dda91c7935 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c792e expref: 27 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.563419:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a8fc26e3600/0x892c60dda91c7935 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c792e expref: 27 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.563429:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528336.563451:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735413760:12345-0@lo:103: Request processed in 53us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528336.563457:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788528336.563502:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735413504:0@lo:103: 00000100:00100000:1.0:1788528336.563936:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735413760:0@lo:103: 00000100:00100000:1.0:1788528336.563944:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735413632:0@lo:103: 00010000:00010000:2.0:1788528336.565193:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9101851600/0x892c60dda91c7997 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb33 expref: 10 pid: 6500 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528336.565223:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528336.565520:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:2404:x1875407719633536:12345-192.168.203.38@tcp:103: Request processed in 3777us (4176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528336.565531:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 28 00010000:00010000:3.0:1788528336.565860:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a8fc26e2800/0x892c60dda91c7927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c7920 expref: 26 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.565951:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a8fc26e2800/0x892c60dda91c7927 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c7920 expref: 26 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528336.565969:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875407735413888:0@lo:104: 00000100:00100000:3.0:1788528336.566037:0:10324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788528336.566144:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c14aba00/0x892c60dda91c7904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c78fd expref: 26 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.566153:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a90c14aba00/0x892c60dda91c7904 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c78fd expref: 26 pid: 6501 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528336.566161:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875407735414016:0@lo:104: 00000100:00100000:3.0:1788528336.566185:0:10324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788528336.568890:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c14abc00/0x892c60dda91c78e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c78e1 expref: 26 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.568912:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a90c14abc00/0x892c60dda91c78e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c78e1 expref: 26 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528336.568930:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875407735414144:0@lo:104: 00000100:00100000:3.0:1788528336.568996:0:10324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528336.570177:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735413888 00000100:00100000:1.0:1788528336.570178:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735414016 00000100:00100000:1.0:1788528336.570191:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735414016 00000100:00100000:0.0:1788528336.570191:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735413888 00000100:00100000:1.0:1788528336.570281:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788528336.570292:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dd052447-840d-4bcc-891b-140c465c7625+4:10324:x1875407735414016:12345-0@lo:104: 00010000:00010000:1.0:1788528336.570312:0:8437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17400/0x892c60dda91c78fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7904 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.570425:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788528336.570433:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dd052447-840d-4bcc-891b-140c465c7625+4:10324:x1875407735414016:12345-0@lo:104: Request processed in 142us (4245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528336.570441:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788528336.570493:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788528336.570499:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+3:10324:x1875407735413888:12345-0@lo:104: 00010000:00010000:1.0:1788528336.570509:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7920 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7927 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.570582:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788528336.570589:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+3:10324:x1875407735413888:12345-0@lo:104: Request processed in 90us (4552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528336.570595:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:1.0:1788528336.570613:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788528336.570620:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17400/0x892c60dda91c78fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7904 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.570629:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17400 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528336.570634:0:6497:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17400/0x892c60dda91c78fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c7904 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.570643:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17400/0x892c60dda91c78fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c7904 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.570648:0:8438:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:1.0:1788528336.570651:0:6497:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17400/0x892c60dda91c78fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c7904 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.570654:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7920 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7927 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528336.570658:0:6497:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788528336.570661:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850800 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:0.0:1788528336.570664:0:8438:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7920 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c7927 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.570670:0:8438:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c7927 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528336.570677:0:8438:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c7927 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528336.570689:0:8438:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788528336.570714:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17400/0x892c60dda91c78fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7904 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.570722:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528336.570754:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17400/0x892c60dda91c78fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7904 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.570761:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17400/0x892c60dda91c78fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7904 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.570776:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528336.570777:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528336.570779:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528336.570807:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735414400:0@lo:103: 00010000:00010000:0.0:1788528336.570873:0:8438:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7920 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7927 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.570881:0:8438:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788528336.570888:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7920 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7927 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.570895:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c7920 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7927 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.570906:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528336.570908:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528336.570910:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528336.570932:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735414272:0@lo:103: 00000100:00100000:1.0:1788528336.571495:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528336.571607:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735414400 00000100:00100000:2.0:1788528336.571615:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735414400 00010000:00010000:2.0:1788528336.571648:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c14aba00/0x892c60dda91c7904 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c78fd expref: 27 pid: 6501 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528336.571687:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788528336.571694:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+27:3639:x1875407735414400:12345-0@lo:103: 00000100:00100000:0.0:1788528336.571842:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528336.571891:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735414272 00000100:00100000:0.0:1788528336.571896:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735414272 00010000:00010000:0.0:1788528336.571915:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a8fc26e2800/0x892c60dda91c7927 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7920 expref: 28 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528336.571939:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788528336.571945:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd052447-840d-4bcc-891b-140c465c7625+28:3640:x1875407735414272:12345-0@lo:103: 00010000:00010000:0.0:1788528336.571954:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528336.571959:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a8fc26e2800/0x892c60dda91c7927 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7920 expref: 28 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.572059:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a8fc26e2600/0x892c60dda91c78da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c78d3 expref: 28 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.572091:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a8fc26e2600/0x892c60dda91c78da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c78d3 expref: 28 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528336.572102:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f0a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875407735414528:0@lo:104: 00010000:00010000:2.0:1788528336.572137:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528336.572143:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c14aba00/0x892c60dda91c7904 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c78fd expref: 28 pid: 6501 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528336.572144:0:10324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528336.572249:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735414144 00000100:00100000:1.0:1788528336.572308:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735414144 00000100:00100000:1.0:1788528336.572342:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735414528 00000100:00100000:1.0:1788528336.572345:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735414528 00000100:00100000:1.0:1788528336.572356:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788528336.572361:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+4:10324:x1875407735414144:12345-0@lo:104: 00010000:00010000:1.0:1788528336.572374:0:6491:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa400/0x892c60dda91c78e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c78e8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.572415:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788528336.572420:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+4:10324:x1875407735414144:12345-0@lo:104: Request processed in 59us (3425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528336.572427:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788528336.572442:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788528336.572446:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+3:10324:x1875407735414528:12345-0@lo:104: 00010000:00010000:1.0:1788528336.572461:0:6491:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c78d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c78da expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.572489:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788528336.572494:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+3:10324:x1875407735414528:12345-0@lo:104: Request processed in 47us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528336.572500:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:1.0:1788528336.572727:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788528336.572734:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa400/0x892c60dda91c78e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c78e8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.572787:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c14aa400 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528336.572793:0:8440:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa400/0x892c60dda91c78e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c78e8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.572803:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa400/0x892c60dda91c78e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c78e8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528336.572811:0:8440:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa400/0x892c60dda91c78e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c78e8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528336.572817:0:8440:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788528336.572955:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa400/0x892c60dda91c78e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c78e8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.572964:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528336.572983:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa400/0x892c60dda91c78e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c78e8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.572989:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c14aa400/0x892c60dda91c78e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c78e8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.573012:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528336.573015:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c78d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c78da expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.573020:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c14ab000 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528336.573023:0:8440:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c78d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c78da expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.573031:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c78d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c78da expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528336.573037:0:8440:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c78d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c78da expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528336.573043:0:8440:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788528336.573058:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c78d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c78da expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.573064:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528336.573070:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c78d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c78da expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.573076:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c78d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c78da expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.573086:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528336.573087:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528336.573089:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528336.573103:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735414784:0@lo:103: 00000100:00100000:1.0:1788528336.573147:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528336.573179:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788528336.573186:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735414656:0@lo:103: 00000100:00100000:1.0:1788528336.573209:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528336.573230:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1788528336.573239:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:2.0:1788528336.573947:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c14aba00/0x892c60dda91c7904 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c78fd expref: 28 pid: 6501 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.574122:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a8fc26e2200/0x892c60dda91c78cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c78c5 expref: 28 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.574135:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a8fc26e2200/0x892c60dda91c78cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c78c5 expref: 28 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528336.574148:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875407735414912:0@lo:104: 00000100:00100000:3.0:1788528336.574194:0:10324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788528336.574241:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90f6e17200/0x892c60dda91c78be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c78b7 expref: 28 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.574250:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a90f6e17200/0x892c60dda91c78be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c78b7 expref: 28 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528336.574426:0:6491:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788528336.574440:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735414912 00000100:00100000:1.0:1788528336.574448:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735414912 00000100:00100000:1.0:1788528336.574492:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788528336.574501:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+3:10324:x1875407735414912:12345-0@lo:104: 00010000:00010000:1.0:1788528336.574513:0:6491:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c78c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c78cc expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528336.579127:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875407735415040:0@lo:104: 00010000:00010000:2.0:1788528336.579168:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788528336.579222:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788528336.579232:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+3:10324:x1875407735414912:12345-0@lo:104: Request processed in 4730us (5036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528336.579243:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788528336.579260:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+28:3639:x1875407735414400:12345-0@lo:103: Request processed in 7567us (7769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528336.579268:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788528336.579304:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735414784 00000100:00100000:2.0:1788528336.579314:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735414784 00010000:00010000:2.0:1788528336.579351:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a8fc26e2600/0x892c60dda91c78da lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c78d3 expref: 28 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528336.579392:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735414656 00000100:00100000:2.0:1788528336.579396:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735414656 00010000:00010000:2.0:1788528336.579414:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c14abc00/0x892c60dda91c78e8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c78e1 expref: 29 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528336.579428:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788528336.579436:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90efa84050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+29:3638:x1875407735414784:12345-0@lo:103: 00010000:00010000:2.0:1788528336.579452:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528336.579457:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a8fc26e2600/0x892c60dda91c78da lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c78d3 expref: 29 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528336.579468:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a8fc26e2600/0x892c60dda91c78da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c78d3 expref: 29 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528336.579481:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528336.579514:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90efa84050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+29:3638:x1875407735414784:12345-0@lo:103: Request processed in 80us (6367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528336.579521:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788528336.579534:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788528336.579540:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+28:3638:x1875407735414656:12345-0@lo:103: 00010000:00010000:2.0:1788528336.579547:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528336.579572:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c14abc00/0x892c60dda91c78e8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c78e1 expref: 28 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528336.579582:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c14abc00/0x892c60dda91c78e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c78e1 expref: 28 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528336.579592:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528336.579625:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+28:3638:x1875407735414656:12345-0@lo:103: Request processed in 85us (6415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528336.579631:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788528336.579678:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735414400:0@lo:103: 00010000:00010000:1.0:1788528336.579714:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528336.579722:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c78c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c78cc expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.579731:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17600 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528336.579736:0:8439:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c78c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c78cc expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.579746:0:8439:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c78c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c78cc expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528336.579766:0:8439:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c78c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c78cc expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528336.579774:0:8439:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788528336.579810:0:8439:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c78c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c78cc expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.579817:0:8439:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528336.579840:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c78c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c78cc expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.579857:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a8fc26e2800/0x892c60dda91c7927 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c7920 expref: 27 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.579858:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c78c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c78cc expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.579876:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788528336.579879:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528336.579881:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528336.579883:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528336.582192:0:10324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788528336.582348:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c787f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c7878 expref: 27 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.582366:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c787f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c7878 expref: 27 pid: 6501 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528336.582384:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875407735415296:0@lo:104: 00000100:00100000:3.0:1788528336.582464:0:10324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788528336.582693:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a8fc26e3c00/0x892c60dda91c7855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c784e expref: 27 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.582703:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a8fc26e3c00/0x892c60dda91c7855 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c784e expref: 27 pid: 6500 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528336.582712:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875407735415424:0@lo:104: 00000100:00100000:3.0:1788528336.582737:0:10324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528336.582755:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735415040 00000100:00100000:1.0:1788528336.582766:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735415040 00000100:00100000:1.0:1788528336.582821:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735415296 00000100:00100000:1.0:1788528336.582825:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735415296 00000100:00100000:1.0:1788528336.582839:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788528336.582941:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+4:10324:x1875407735415040:12345-0@lo:104: 00010000:00010000:1.0:1788528336.582959:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c78b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c78be expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.583023:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788528336.583030:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+4:10324:x1875407735415040:12345-0@lo:104: Request processed in 173us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528336.583050:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788528336.583073:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788528336.583079:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+3:10324:x1875407735415296:12345-0@lo:104: 00010000:00010000:1.0:1788528336.583088:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7878 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c787f expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.583130:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788528336.583136:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+3:10324:x1875407735415296:12345-0@lo:104: Request processed in 58us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528336.583142:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1788528336.583171:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788528336.583177:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c78b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c78be expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.583185:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101851e00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528336.583190:0:6497:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c78b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c78be expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.583200:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c78b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c78be expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528336.583209:0:6497:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c78b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c78be expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528336.583215:0:6497:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788528336.583242:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c78b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c78be expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.583324:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528336.583416:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c78b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c78be expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.583430:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c78b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c78be expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.583447:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528336.583450:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7878 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c787f expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.583457:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101851400 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528336.583460:0:6497:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7878 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c787f expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.583467:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c787f expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528336.583474:0:6497:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c787f expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528336.583479:0:6497:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788528336.583495:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7878 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c787f expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.583502:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528336.583515:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7878 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c787f expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.583522:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7878 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c787f expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.583531:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528336.583539:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528336.583541:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528336.583660:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735415680:0@lo:103: 00000100:00100000:1.0:1788528336.583699:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788528336.584248:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c13fce00/0x892c60dda91c7847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c7840 expref: 27 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.584264:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a90c13fce00/0x892c60dda91c7847 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c7840 expref: 27 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528336.584277:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875407735415808:0@lo:104: 00000100:00100000:3.0:1788528336.584308:0:10324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528336.584441:0:10324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1fd6f00 going to sleep for 11 seconds 00010000:00010000:3.0:1788528336.584472:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101851600/0x892c60dda91c7997 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb33 expref: 9 pid: 6500 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528336.584485:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fec380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875407735412864:192.168.203.38@tcp:104: 00010000:00010000:3.0:1788528336.584499:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c14ab400/0x892c60dda91c7990 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb2c expref: 8 pid: 6502 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528336.584509:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875407735412992:192.168.203.38@tcp:104: 00010000:00010000:3.0:1788528336.584520:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90f6e17800/0x892c60dda91c7982 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c797b expref: 27 pid: 6500 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528336.584571:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875407735413120:0@lo:104: 00010000:00010000:3.0:1788528336.584587:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7958 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c7951 expref: 26 pid: 6501 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528336.584596:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875407735413248:0@lo:104: 00010000:00010000:3.0:1788528336.584606:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc26e3600/0x892c60dda91c7935 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c792e expref: 25 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528336.584614:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875407735413376:0@lo:104: 00010000:00010000:3.0:1788528336.584623:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc26e2800/0x892c60dda91c7927 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c7920 expref: 24 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528336.584631:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875407735413888:0@lo:104: 00010000:00010000:3.0:1788528336.584641:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c14aba00/0x892c60dda91c7904 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c78fd expref: 23 pid: 6501 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528336.584649:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875407735414016:0@lo:104: 00010000:00010000:3.0:1788528336.584662:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c14abc00/0x892c60dda91c78e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c78e1 expref: 22 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528336.584671:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875407735414144:0@lo:104: 00010000:00010000:3.0:1788528336.584680:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc26e2600/0x892c60dda91c78da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c78d3 expref: 21 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528336.584689:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f0a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875407735414528:0@lo:104: 00000100:00100000:3.0:1788528336.584698:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875407735414912:0@lo:104: 00000100:00100000:3.0:1788528336.584715:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875407735415040:0@lo:104: 00000100:00100000:3.0:1788528336.584723:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875407735415296:0@lo:104: 00010000:00010000:0.0:1788528336.585888:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528336.585902:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528336.585928:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735415552:0@lo:103: 00000100:00100000:0.0:1788528336.586072:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528336.586196:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788528336.586204:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735415168:0@lo:103: 00000100:00100000:0.0:1788528336.586230:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528336.586265:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735415680 00000100:00100000:0.0:1788528336.586275:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735415680 00010000:00010000:0.0:1788528336.586317:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c787f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7878 expref: 21 pid: 6501 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528336.586349:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735415552 00000100:00100000:0.0:1788528336.586353:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735415552 00010000:00010000:0.0:1788528336.586366:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90f6e17200/0x892c60dda91c78be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c78b7 expref: 22 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528336.586377:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735415168 00000100:00100000:0.0:1788528336.586380:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735415168 00010000:00010000:0.0:1788528336.586389:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a8fc26e2200/0x892c60dda91c78cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c78c5 expref: 23 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528336.586404:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788528336.586412:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd052447-840d-4bcc-891b-140c465c7625+23:3637:x1875407735415680:12345-0@lo:103: 00010000:00010000:0.0:1788528336.586426:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528336.586432:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c787f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7878 expref: 23 pid: 6501 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.586460:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c787f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c7878 expref: 23 pid: 6501 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.586481:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c787f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c7878 expref: 23 pid: 6501 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.586502:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528336.586543:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd052447-840d-4bcc-891b-140c465c7625+22:3637:x1875407735415680:12345-0@lo:103: Request processed in 131us (2844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528336.586550:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788528336.586590:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788528336.586597:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd052447-840d-4bcc-891b-140c465c7625+21:3640:x1875407735415552:12345-0@lo:103: 00010000:00010000:0.0:1788528336.586605:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528336.586610:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90f6e17200/0x892c60dda91c78be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c78b7 expref: 21 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.586618:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90f6e17200/0x892c60dda91c78be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c78b7 expref: 21 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.586628:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90f6e17200/0x892c60dda91c78be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c78b7 expref: 21 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.586637:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528336.586663:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd052447-840d-4bcc-891b-140c465c7625+20:3640:x1875407735415552:12345-0@lo:103: Request processed in 66us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528336.586669:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788528336.586682:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788528336.586688:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd052447-840d-4bcc-891b-140c465c7625+19:3640:x1875407735415168:12345-0@lo:103: 00010000:00010000:0.0:1788528336.586702:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788528336.586797:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735414656:0@lo:103: 00010000:00010000:0.0:1788528336.586815:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a8fc26e2200/0x892c60dda91c78cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c78c5 expref: 19 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528336.586816:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735414784:0@lo:103: 00010000:00010000:0.0:1788528336.586855:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a8fc26e2200/0x892c60dda91c78cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c78c5 expref: 19 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.586870:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc26e2200/0x892c60dda91c78cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c78c5 expref: 19 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.586882:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528336.586917:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd052447-840d-4bcc-891b-140c465c7625+18:3640:x1875407735415168:12345-0@lo:103: Request processed in 229us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528336.586925:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788528336.587458:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735415424 00000100:00100000:1.0:1788528336.587466:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735415424 00000100:00100000:1.0:1788528336.587995:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735415808 00000100:00100000:1.0:1788528336.588000:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735415808 00000100:00100000:3.0:1788528336.588048:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788528336.588061:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dd052447-840d-4bcc-891b-140c465c7625+4:10324:x1875407735415424:12345-0@lo:104: 00010000:00010000:3.0:1788528336.588079:0:8437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c784e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7855 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.588155:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788528336.588161:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dd052447-840d-4bcc-891b-140c465c7625+4:10324:x1875407735415424:12345-0@lo:104: Request processed in 104us (5424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528336.588168:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788528336.588184:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788528336.588191:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dd052447-840d-4bcc-891b-140c465c7625+3:10324:x1875407735415808:12345-0@lo:104: 00010000:00010000:3.0:1788528336.588199:0:8437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7840 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7847 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.588232:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788528336.588238:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dd052447-840d-4bcc-891b-140c465c7625+3:10324:x1875407735415808:12345-0@lo:104: Request processed in 48us (3930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528336.588244:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788528336.588283:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875407735415424:0@lo:104: 00000100:00100000:3.0:1788528336.588294:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875407735415808:0@lo:104: 00010000:00010000:3.0:1788528336.588385:0:10324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a90c14aae00/0x892c60dda91c79d6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.588654:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788528336.588663:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c784e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7855 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.588672:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17c00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528336.588676:0:8440:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c784e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c7855 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.588686:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c784e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c7855 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528336.588694:0:8440:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c784e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c7855 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528336.588701:0:8440:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788528336.588825:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c784e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7855 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.588834:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788528336.588955:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735415680:0@lo:103: 00000100:00100000:0.0:1788528336.588986:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788528336.588997:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735415936:0@lo:103: 00010000:00010000:1.0:1788528336.589007:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c784e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7855 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.589014:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c784e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7855 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.589041:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788528336.589041:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788528336.589044:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7840 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7847 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.589050:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850200 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528336.589053:0:8440:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7840 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c7847 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.589060:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c7847 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528336.589066:0:8440:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c7847 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528336.589071:0:8440:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788528336.589154:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735415936 00000100:00100000:2.0:1788528336.589160:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735415936 00010000:00010000:2.0:1788528336.589184:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a8fc26e3c00/0x892c60dda91c7855 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c784e expref: 18 pid: 6500 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528336.589206:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735415168:0@lo:103: 00000100:00100000:2.0:1788528336.589208:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788528336.589215:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+18:3637:x1875407735415936:12345-0@lo:103: 00000100:00100000:0.0:1788528336.589217:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735415552:0@lo:103: 00010000:00010000:2.0:1788528336.589226:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528336.589231:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a8fc26e3c00/0x892c60dda91c7855 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c784e expref: 18 pid: 6500 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528336.589242:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a8fc26e3c00/0x892c60dda91c7855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c784e expref: 18 pid: 6500 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528336.589257:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc26e3c00/0x892c60dda91c7855 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c784e expref: 18 pid: 6500 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528336.589266:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd052447-840d-4bcc-891b-140c465c7625+17:3640:x1875407735414272:12345-0@lo:103: Request processed in 17322us (17425us total) trans 0 rc 0/0 00010000:00010000:2.0:1788528336.589269:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528336.589274:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788528336.589298:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+16:3637:x1875407735415936:12345-0@lo:103: Request processed in 84us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528336.589304:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788528336.589320:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735414272:0@lo:103: 00000100:00100000:0.0:1788528336.589337:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735415936:0@lo:103: 00010000:00010000:1.0:1788528336.589504:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7840 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7847 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.589511:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528336.589534:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7840 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7847 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.589541:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7840 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7847 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528336.589578:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788528336.589594:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735416064:0@lo:103: 00000100:00100000:0.0:1788528336.589624:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528336.589654:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735416064 00000100:00100000:0.0:1788528336.589658:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735416064 00010000:00010000:0.0:1788528336.589676:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c13fce00/0x892c60dda91c7847 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7840 expref: 16 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528336.589696:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788528336.589703:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd052447-840d-4bcc-891b-140c465c7625+16:3640:x1875407735416064:12345-0@lo:103: 00010000:00010000:0.0:1788528336.589821:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528336.589827:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c13fce00/0x892c60dda91c7847 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7840 expref: 16 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.589837:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c13fce00/0x892c60dda91c7847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c7840 expref: 16 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.589865:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c13fce00/0x892c60dda91c7847 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c7840 expref: 16 pid: 6502 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.589880:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a90c14aae00/0x892c60dda91c79d6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.589889:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c14aae00/0x892c60dda91c79d6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.589906:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a90c14aae00/0x892c60dda91c79d6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.589915:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a90c14aae00/0x892c60dda91c79d6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.589934:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a90c14aae00/0x892c60dda91c79d6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.589940:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a90c14aae00/0x892c60dda91c79d6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.589945:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c14aae00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528336.589950:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a90c14aae00/0x892c60dda91c79d6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.589959:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a90c14aae00/0x892c60dda91c79d6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528336.590066:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528336.590068:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528336.590070:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528336.590077:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528336.590270:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a90c14aae00/0x892c60dda91c79d6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528336.590282:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528336.590325:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd052447-840d-4bcc-891b-140c465c7625+15:3640:x1875407735416064:12345-0@lo:103: Request processed in 622us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528336.590332:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788528336.590508:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735416064:0@lo:103: 00010000:00010000:3.0:1788528336.590591:0:10324:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a90c14aae00/0x892c60dda91c79d6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.590608:0:10324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a90c14aae00/0x892c60dda91c79d6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528336.590615:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c14aae00/0x892c60dda91c79d6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528337.023821:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528337.101882:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528337.101947:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528337.101980:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719633792 00000100:00100000:0.0:1788528337.101995:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528337.102027:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719633792 00000100:00100000:0.0:1788528337.102055:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528337.102092:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719634048 00000100:00100000:0.0:1788528337.102097:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719634048 00000100:00100000:2.0:1788528337.102127:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719633920 00000100:00100000:2.0:1788528337.102132:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719633920 00000100:00100000:0.0:1788528337.102149:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719634176 00000100:00100000:0.0:1788528337.102155:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719634176 00000100:00100000:2.0:1788528337.102167:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:2.0:1788528337.102180:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2406:x1875407719633792:12345-192.168.203.38@tcp:400: 00000100:00100000:2.0:1788528337.102279:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2406:x1875407719633792:12345-192.168.203.38@tcp:400: Request processed in 102us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528337.102288:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:2.0:1788528337.102312:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:0.0:1788528337.102318:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:2.0:1788528337.102325:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2406:x1875407719633920:12345-192.168.203.38@tcp:400: 00000100:00100000:0.0:1788528337.102332:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2406:x1875407719634048:12345-192.168.203.38@tcp:400: 00000100:00100000:2.0:1788528337.102356:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2406:x1875407719633920:12345-192.168.203.38@tcp:400: Request processed in 33us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528337.102363:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:0.0:1788528337.102381:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2406:x1875407719634048:12345-192.168.203.38@tcp:400: Request processed in 53us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528337.102390:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:3.0:1788528337.102635:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:3.0:1788528337.102646:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2406:x1875407719634176:12345-192.168.203.38@tcp:400: 00000100:00100000:3.0:1788528337.102698:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2406:x1875407719634176:12345-192.168.203.38@tcp:400: Request processed in 54us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528337.102704:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00080000:3.0:1788528337.102725:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788528337.102730:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788528337.102732:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788528337.102735:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788528338.047450:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528338.110989:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788528338.111028:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735416192:0@lo:41: 00000100:00100000:1.0:1788528338.111155:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788528338.111165:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735416320:0@lo:13: 10000000:01000000:0.0:1788528338.111898:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788528338.111905:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff8a8fc1fe4800 from 48 10000000:01000000:0.0:1788528338.111910:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788528338.111955:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3a00/0x892c60dda91c79dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.111968:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3a00/0x892c60dda91c79dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.111981:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3a00/0x892c60dda91c79dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528338.112000:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f4aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735416576:0@lo:101: 00000100:00100000:0.0:1788528338.112505:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528338.112589:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1c59cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528338.112618:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735416576 00000100:00100000:0.0:1788528338.112627:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735416576 00000100:00100000:0.0:1788528338.112690:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788528338.112702:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+15:6506:x1875407735416576:12345-0@lo:101: 00010000:00010000:0.0:1788528338.112718:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528338.112736:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc26e2400/0x892c60dda91c79e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c79dd expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.112764:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc26e2400/0x892c60dda91c79e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c79dd expref: 16 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528338.112878:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528338.112928:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788528338.112987:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc26e2400/0x892c60dda91c79e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c79dd expref: 16 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.112999:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e2400, rc 0) 00000100:00100000:0.0:1788528338.113046:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+16:6506:x1875407735416576:12345-0@lo:101: Request processed in 347us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528338.113054:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788528338.113092:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788528338.113106:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735416448:0@lo:13: 00000100:00100000:0.0:1788528338.113161:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f4aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735416576:0@lo:101: 00010000:00010000:0.0:1788528338.113179:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3a00/0x892c60dda91c79dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c79e4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.113190:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3a00/0x892c60dda91c79dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c79e4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788528338.113439:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1788528338.114053:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788528338.114254:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788528338.114283:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 120 off8536 00000040:00080000:0.0:1788528338.114379:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 168 off8704 00000040:00080000:0.0:1788528338.114397:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8928 00000040:00080000:0.0:1788528338.114411:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9152 00000040:00080000:0.0:1788528338.114423:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 120 off9272 00000040:00080000:0.0:1788528338.114436:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 168 off9440 00000040:00080000:0.0:1788528338.114450:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].8, 224 off9664 00000040:00080000:0.0:1788528338.114465:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].9, 224 off9888 00000040:00080000:0.0:1788528338.114479:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].10, 120 off10008 00000040:00080000:0.0:1788528338.114505:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].11, 224 off10232 00000040:00080000:0.0:1788528338.114519:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].12, 224 off10456 00000040:00080000:0.0:1788528338.114533:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].13, 88 off10544 00000040:00080000:0.0:1788528338.114546:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].14, 128 off10672 00000040:00080000:0.0:1788528338.114593:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].15, 144 off10816 00000040:00080000:0.0:1788528338.114607:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].16, 160 off10976 00000040:00080000:0.0:1788528338.114620:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].17, 224 off11200 00000040:00080000:0.0:1788528338.114632:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].18, 224 off11424 00000040:00080000:0.0:1788528338.114650:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].19, 80 off11504 00000040:00080000:0.0:1788528338.114665:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].20, 224 off11728 00000040:00080000:0.0:1788528338.114682:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].21, 224 off11952 00000040:00080000:0.0:1788528338.114693:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].22, 88 off12040 00000040:00080000:0.0:1788528338.114707:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].23, 128 off12168 00000040:00080000:0.0:1788528338.114718:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].24, 144 off12312 00000040:00080000:0.0:1788528338.114730:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].25, 160 off12472 00000040:00080000:0.0:1788528338.114752:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].26, 224 off12696 00000040:00080000:0.0:1788528338.115267:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].27, 224 off12920 00000040:00080000:0.0:1788528338.115507:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].28, 80 off13000 00000040:00080000:0.0:1788528338.115526:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].29, 224 off13224 00000040:00080000:0.0:1788528338.115543:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].30, 224 off13448 00000040:00080000:0.0:1788528338.115601:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].31, 88 off13536 00000040:00080000:0.0:1788528338.115616:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].32, 128 off13664 00000040:00080000:0.0:1788528338.115626:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].33, 144 off13808 00000040:00080000:0.0:1788528338.115639:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].34, 128 off13936 00000040:00080000:0.0:1788528338.115655:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].35, 224 off14160 00000040:00080000:0.0:1788528338.115668:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].36, 224 off14384 00000040:00080000:0.0:1788528338.115683:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].37, 80 off14464 00000040:00080000:0.0:1788528338.115695:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].38, 224 off14688 00000040:00080000:0.0:1788528338.115708:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].39, 224 off14912 00000040:00080000:0.0:1788528338.115721:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].40, 88 off15000 00000040:00080000:0.0:1788528338.115759:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].41, 128 off15128 00000040:00080000:0.0:1788528338.115855:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].42, 144 off15272 00000040:00080000:0.0:1788528338.115881:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].43, 128 off15400 00000040:00080000:0.0:1788528338.115908:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].44, 224 off15624 00000040:00080000:0.0:1788528338.115922:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].45, 224 off15848 00000040:00080000:0.0:1788528338.115935:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].46, 80 off15928 00000040:00080000:0.0:1788528338.115962:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].47, 224 off16152 00000040:00080000:0.0:1788528338.115968:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1788528338.116060:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528338.116105:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735416320 00000100:00100000:0.0:1788528338.116111:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f4aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735416704:0@lo:501: 00000100:00100000:1.0:1788528338.116116:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735416320 00000100:00100000:0.0:1788528338.116190:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528338.116219:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1c59f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788528338.116375:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735416448 00000100:00100000:1.0:1788528338.116380:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735416448 00000100:00100000:1.0:1788528338.116420:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788528338.116434:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735416320:12345-0@lo:13: 00002000:00000024:1.0:1788528338.116493:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528338.116632:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735416960:0@lo:400: 00000100:00100000:0.0:1788528338.116698:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735416704 00000100:00100000:0.0:1788528338.116703:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735416704 00000100:00100000:0.0:1788528338.116735:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788528338.116743:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+16:6506:x1875407735416704:12345-0@lo:501: 00000100:00100000:2.0:1788528338.116941:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735416832:0@lo:400: 00000100:00100000:2.0:1788528338.116982:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528338.116997:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735416320:12345-0@lo:13: Request processed in 566us (4117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528338.117008:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788528338.117014:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735416832 00000100:00100000:2.0:1788528338.117019:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735416832 00000100:00100000:1.0:1788528338.117032:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788528338.117043:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735416448:12345-0@lo:13: 00000100:00100000:2.0:1788528338.117057:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00002000:00000024:1.0:1788528338.117057:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528338.117068:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735416832:12345-0@lo:400: 00000100:00100000:1.0:1788528338.117096:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735416448:12345-0@lo:13: Request processed in 55us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528338.117103:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788528338.117114:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735416832:12345-0@lo:400: Request processed in 48us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528338.117123:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788528338.117136:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735417088:0@lo:400: 00000100:00100000:2.0:1788528338.117167:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735416832:0@lo:400: 00000100:00100000:2.0:1788528338.117186:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1875407735417344:0@lo:400: 00000100:00100000:2.0:1788528338.117212:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528338.117233:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1875407735417856:0@lo:400: 00000100:00100000:2.0:1788528338.117255:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528338.117488:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+16:6506:x1875407735416704:12345-0@lo:501: Request processed in 745us (1296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528338.117495:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00080000:0.0:1788528338.117526:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788528338.117541:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528338.117590:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1875407735417472:0@lo:400: 00000100:00100000:0.0:1788528338.117615:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528338.117636:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735417984:0@lo:400: 00000100:00100000:1.0:1788528338.117646:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528338.117667:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528338.117672:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735417600:0@lo:400: 00000100:00100000:1.0:1788528338.117704:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788528338.117745:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc327d880 x1875407735416448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528338.118039:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735416192 00000100:00100000:1.0:1788528338.118040:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735416448:0@lo:13: 00000100:00100000:0.0:1788528338.118047:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735416192 00000100:00100000:1.0:1788528338.118067:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788528338.118077:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735417216:0@lo:400: 00000100:00100000:0.0:1788528338.118093:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735416960 00000100:00100000:0.0:1788528338.118097:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735416960 00000100:00100000:1.0:1788528338.118114:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528338.118116:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788528338.118126:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3639:x1875407735416192:12345-0@lo:41: 00000100:00100000:1.0:1788528338.118134:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735417728:0@lo:400: 00000004:00000024:0.0:1788528338.118174:0:9268:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788528338.118220:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3639:x1875407735416192:12345-0@lo:41: Request processed in 96us (5291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528338.118227:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788528338.118240:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528338.118242:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735417216 00000100:00100000:0.0:1788528338.118246:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735417216 00000100:00100000:0.0:1788528338.118265:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788528338.118272:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735416960:12345-0@lo:400: 00000100:00100000:1.0:1788528338.118282:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735417344 00000100:00100000:1.0:1788528338.118288:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735417344 00000100:00100000:1.0:1788528338.118323:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735417856 00000100:00100000:1.0:1788528338.118327:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735417856 00000100:00100000:1.0:1788528338.118340:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735417472 00000100:00100000:1.0:1788528338.118343:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735417472 00000100:00100000:1.0:1788528338.118355:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735417088 00000100:00100000:1.0:1788528338.118357:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735417088 00000100:00100000:1.0:1788528338.118370:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735417984 00000100:00100000:1.0:1788528338.118373:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735417984 00000100:00100000:0.0:1788528338.118387:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735416960:12345-0@lo:400: Request processed in 115us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528338.118394:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788528338.118405:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788528338.118412:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735417216:12345-0@lo:400: 00000100:00100000:0.0:1788528338.118441:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735417216:12345-0@lo:400: Request processed in 30us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528338.118447:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788528338.118487:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735416960:0@lo:400: 00000100:00100000:0.0:1788528338.118512:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788528338.118518:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875407735417344:12345-0@lo:400: 00000100:00100000:0.0:1788528338.118547:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875407735417344:12345-0@lo:400: Request processed in 30us (1335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528338.118577:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788528338.118590:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788528338.118596:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875407735417856:12345-0@lo:400: 00000100:00100000:0.0:1788528338.118624:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875407735417856:12345-0@lo:400: Request processed in 29us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528338.118637:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788528338.118649:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788528338.118654:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875407735417472:12345-0@lo:400: 00000100:00100000:1.0:1788528338.118686:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788528338.118689:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875407735417472:12345-0@lo:400: Request processed in 34us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528338.118697:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788528338.118700:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735417088:12345-0@lo:400: 00000100:00100000:0.0:1788528338.118712:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788528338.118720:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735417984:12345-0@lo:400: 00000100:00100000:1.0:1788528338.118745:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735417088:12345-0@lo:400: Request processed in 49us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528338.118753:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788528338.118759:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735417984:12345-0@lo:400: Request processed in 39us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528338.118830:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788528338.119000:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735417600 00010000:00080000:0.0:1788528338.119003:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6f4b480 x1875407735417472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528338.119006:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735417600 00000100:00100000:0.0:1788528338.119018:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1875407735417472:0@lo:400: 00010000:00080000:0.0:1788528338.119034:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6fd5f80 x1875407735417984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528338.119043:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735417728 00000100:00100000:0.0:1788528338.119044:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735417984:0@lo:400: 00000100:00100000:1.0:1788528338.119049:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735417728 00000100:00100000:1.0:1788528338.119081:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788528338.119088:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f4aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735416704:0@lo:501: 00000100:00100000:1.0:1788528338.119093:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735417600:12345-0@lo:400: 00000100:00100000:1.0:1788528338.119135:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735417600:12345-0@lo:400: Request processed in 47us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528338.119147:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735418112:0@lo:503: 00000100:00100000:1.0:1788528338.119153:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788528338.119200:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528338.119217:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1c59f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788528338.119232:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735418112 00000100:00100000:0.0:1788528338.119236:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735418112 00000100:00100000:1.0:1788528338.119244:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788528338.119254:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735417728:12345-0@lo:400: 00000100:00100000:0.0:1788528338.119269:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788528338.119285:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+16:6506:x1875407735418112:12345-0@lo:503: 00000100:00100000:1.0:1788528338.119290:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735417728:12345-0@lo:400: Request processed in 38us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528338.119298:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788528338.119320:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788528338.119325:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788528338.119327:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788528338.119357:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6ea3480 x1875407735416320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528338.119381:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735416320:0@lo:13: 00000100:00100000:0.0:1788528338.119482:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+16:6506:x1875407735418112:12345-0@lo:503: Request processed in 199us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528338.119490:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788528338.119540:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735418112:0@lo:503: 00000100:00100000:1.0:1788528338.119648:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735417216:0@lo:400: 00010000:00080000:1.0:1788528338.119662:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6f4b100 x1875407735417728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528338.119672:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735417728:0@lo:400: 00000100:00100000:1.0:1788528338.119685:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735417088:0@lo:400: 00010000:00080000:1.0:1788528338.119697:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6f48380 x1875407735417600/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528338.119707:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735417600:0@lo:400: 00000100:00100000:1.0:1788528338.119841:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1875407735417344:0@lo:400: 00000100:00100000:1.0:1788528338.119862:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1875407735417856:0@lo:400: 00000100:00100000:1.0:1788528338.119882:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735416192:0@lo:41: 00000040:00080000:0.0:1788528338.120197:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788528338.120282:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735418240:0@lo:502: 00000100:00100000:0.0:1788528338.120410:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528338.120446:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1c59f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788528338.120530:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735418240 00000100:00100000:1.0:1788528338.120537:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735418240 00000100:00100000:1.0:1788528338.120857:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788528338.120866:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+16:6506:x1875407735418240:12345-0@lo:502: 00000100:00100000:1.0:1788528338.121164:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+16:6506:x1875407735418240:12345-0@lo:502: Request processed in 298us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528338.121173:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788528338.121258:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735418240:0@lo:502: 00000040:00080000:0.0:1788528338.122001:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788528338.122049:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 120 off8536 00000040:00080000:0.0:1788528338.122064:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 168 off8704 00000040:00080000:0.0:1788528338.122075:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8928 00000040:00080000:0.0:1788528338.122086:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9152 00000040:00080000:0.0:1788528338.122098:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 120 off9272 00000040:00080000:0.0:1788528338.122132:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 168 off9440 00000040:00080000:0.0:1788528338.122147:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9664 00000040:00080000:0.0:1788528338.122159:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 224 off9888 00000040:00080000:0.0:1788528338.122171:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 120 off10008 00000040:00080000:0.0:1788528338.122325:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10232 00000040:00080000:0.0:1788528338.122531:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 224 off10456 00000040:00080000:0.0:1788528338.122547:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 88 off10544 00000040:00080000:0.0:1788528338.122685:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].14, 128 off10672 00000040:00080000:0.0:1788528338.122701:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].15, 144 off10816 00000040:00080000:0.0:1788528338.122715:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].16, 160 off10976 00000040:00080000:0.0:1788528338.122727:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].17, 224 off11200 00000040:00080000:0.0:1788528338.122739:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].18, 224 off11424 00000040:00080000:0.0:1788528338.122751:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].19, 80 off11504 00000040:00080000:0.0:1788528338.122943:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].20, 224 off11728 00000040:00080000:0.0:1788528338.122961:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].21, 224 off11952 00000040:00080000:0.0:1788528338.122973:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].22, 88 off12040 00000040:00080000:0.0:1788528338.123001:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].23, 128 off12168 00000040:00080000:0.0:1788528338.123018:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].24, 144 off12312 00000040:00080000:0.0:1788528338.123033:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].25, 160 off12472 00000040:00080000:0.0:1788528338.123045:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].26, 224 off12696 00000040:00080000:0.0:1788528338.123057:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].27, 224 off12920 00000040:00080000:0.0:1788528338.123068:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].28, 80 off13000 00000040:00080000:0.0:1788528338.123081:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].29, 224 off13224 00000040:00080000:0.0:1788528338.123093:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].30, 224 off13448 00000040:00080000:0.0:1788528338.123104:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].31, 88 off13536 00000040:00080000:0.0:1788528338.123116:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].32, 128 off13664 00000040:00080000:0.0:1788528338.123129:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].33, 144 off13808 00000040:00080000:0.0:1788528338.123142:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].34, 128 off13936 00000040:00080000:0.0:1788528338.123155:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].35, 224 off14160 00000040:00080000:0.0:1788528338.123168:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].36, 224 off14384 00000040:00080000:0.0:1788528338.123181:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].37, 80 off14464 00000040:00080000:0.0:1788528338.123193:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].38, 224 off14688 00000040:00080000:0.0:1788528338.123222:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].39, 224 off14912 00000040:00080000:0.0:1788528338.123240:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].40, 88 off15000 00000040:00080000:0.0:1788528338.123252:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].41, 128 off15128 00000040:00080000:0.0:1788528338.123265:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].42, 144 off15272 00000040:00080000:0.0:1788528338.123277:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].43, 128 off15400 00000040:00080000:0.0:1788528338.123291:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].44, 224 off15624 00000040:00080000:0.0:1788528338.123305:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].45, 224 off15848 00000040:00080000:0.0:1788528338.123319:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].46, 80 off15928 00000040:00080000:0.0:1788528338.123332:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].47, 224 off16152 00000040:00080000:0.0:1788528338.123345:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].48, 232 off16384 00000100:00100000:0.0:1788528338.123414:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735418368:0@lo:502: 00000100:00100000:0.0:1788528338.123508:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528338.126069:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1c59f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788528338.128778:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735418368 00000100:00100000:2.0:1788528338.128803:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735418368 00000100:00100000:2.0:1788528338.128909:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788528338.128921:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+16:6506:x1875407735418368:12345-0@lo:502: 00000100:00100000:2.0:1788528338.129176:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+16:6506:x1875407735418368:12345-0@lo:502: Request processed in 257us (5668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528338.129185:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788528338.129425:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735418368:0@lo:502: 00000040:00080000:1.0:1788528338.129830:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].49, 224 off16608 00000040:00080000:1.0:1788528338.130032:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].50, 120 off16728 00000100:00100000:1.0:1788528338.130085:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735418496:0@lo:502: 00000100:00100000:1.0:1788528338.130161:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528338.130270:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ee4180 going to sleep for 11 seconds 00000100:00100000:0.0:1788528338.130327:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735418496 00000100:00100000:0.0:1788528338.130334:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735418496 00000100:00100000:0.0:1788528338.130390:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788528338.130400:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+16:6506:x1875407735418496:12345-0@lo:502: 00000100:00100000:0.0:1788528338.130665:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+16:6506:x1875407735418496:12345-0@lo:502: Request processed in 265us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528338.130673:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788528338.130740:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735418496:0@lo:502: 00000040:00080000:1.0:1788528338.130791:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].51, 224 off16952 00000040:00080000:1.0:1788528338.130801:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000040:00080000:3.0:1788528338.132621:0:10343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 52 count 51 00000020:01000000:1.0:1788528338.133154:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788528338.133171:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788528338.133183:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3a00/0x892c60dda91c79dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c79e4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528338.133205:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3a00/0x892c60dda91c79dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c79e4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528338.133220:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788528338.133223:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1788528338.133234:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788528338.133289:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c79eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528338.133297:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c79eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528338.133308:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c79eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528338.133332:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735418624:0@lo:101: 00000100:00100000:1.0:1788528338.133398:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528338.133442:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ee4180 going to sleep for 11 seconds 00000100:00100000:0.0:1788528338.133596:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735418624 00000100:00100000:0.0:1788528338.133605:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735418624 00000100:00100000:0.0:1788528338.133650:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788528338.133659:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+16:6506:x1875407735418624:12345-0@lo:101: 00010000:00010000:0.0:1788528338.133673:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528338.133696:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc26e2e00/0x892c60dda91c79f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c79eb expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.133721:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc26e2e00/0x892c60dda91c79f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c79eb expref: 17 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.133733:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc26e2e00/0x892c60dda91c79f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c79eb expref: 17 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.133742:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e2e00, rc 0) 00000100:00100000:0.0:1788528338.133787:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+17:6506:x1875407735418624:12345-0@lo:101: Request processed in 129us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528338.133795:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788528338.135265:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735418624:0@lo:101: 00010000:00010000:1.0:1788528338.135292:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c79eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c79f2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528338.135304:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c79eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c79f2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788528338.135499:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788528338.136160:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788528338.136898:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788528338.137899:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 128 off8544 00000040:00080000:1.0:1788528338.138110:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 112 off8656 00000040:00080000:1.0:1788528338.138129:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].4, 224 off8880 00000040:00080000:1.0:1788528338.138144:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].5, 224 off9104 00000040:00080000:1.0:1788528338.138158:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].6, 80 off9184 00000040:00080000:1.0:1788528338.138310:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].7, 224 off9408 00000040:00080000:1.0:1788528338.138319:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788528338.138431:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735418752:0@lo:501: 00000100:00100000:1.0:1788528338.138514:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528338.138823:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ee4180 going to sleep for 11 seconds 00000100:00100000:0.0:1788528338.151007:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735418752 00000100:00100000:0.0:1788528338.151026:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735418752 00000100:00100000:0.0:1788528338.151116:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788528338.151128:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+17:6506:x1875407735418752:12345-0@lo:501: 00000100:00100000:0.0:1788528338.152008:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+17:6506:x1875407735418752:12345-0@lo:501: Request processed in 881us (13491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528338.152018:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788528338.152225:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735418752:0@lo:501: 00000100:00100000:2.0:1788528338.152290:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735418880:0@lo:503: 00000100:00100000:2.0:1788528338.152345:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528338.152385:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c39040c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528338.152543:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735418880 00000100:00100000:0.0:1788528338.152549:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735418880 00000100:00100000:0.0:1788528338.152616:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788528338.152624:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+17:6506:x1875407735418880:12345-0@lo:503: 00000100:00100000:0.0:1788528338.153065:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+17:6506:x1875407735418880:12345-0@lo:503: Request processed in 440us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528338.153073:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788528338.155388:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735418880:0@lo:503: 00000040:00080000:1.0:1788528338.156355:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788528338.156444:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735419008:0@lo:502: 00000100:00100000:1.0:1788528338.156523:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528338.156664:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ee4900 going to sleep for 11 seconds 00000100:00100000:0.0:1788528338.157153:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735419008 00000100:00100000:0.0:1788528338.157161:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735419008 00000100:00100000:0.0:1788528338.157268:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788528338.157279:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+17:6506:x1875407735419008:12345-0@lo:502: 00000100:00100000:0.0:1788528338.157409:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+17:6506:x1875407735419008:12345-0@lo:502: Request processed in 132us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528338.157416:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788528338.157494:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735419008:0@lo:502: 00000040:00080000:1.0:1788528338.157745:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788528338.157775:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 00000040:00080000:1.0:1788528338.157789:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1788528338.157803:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788528338.157817:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1788528338.157830:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1788528338.157859:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 00000040:00080000:1.0:1788528338.157872:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1788528338.157884:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 120 off9752 00000100:00100000:1.0:1788528338.157909:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735419136:0@lo:502: 00000100:00100000:1.0:1788528338.157968:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528338.162962:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ee4900 going to sleep for 11 seconds 00000100:00100000:2.0:1788528338.163375:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735419136 00000100:00100000:2.0:1788528338.163384:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735419136 00000100:00100000:2.0:1788528338.163439:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788528338.163449:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+17:6506:x1875407735419136:12345-0@lo:502: 00000100:00100000:2.0:1788528338.163881:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+17:6506:x1875407735419136:12345-0@lo:502: Request processed in 432us (5912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528338.163890:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788528338.164148:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735419136:0@lo:502: 00000040:00080000:1.0:1788528338.164367:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9976 00000040:00080000:1.0:1788528338.164384:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1788528338.166030:0:10344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528338.166041:0:10344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528338.166044:0:10344:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788528338.166050:0:10344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788528338.166059:0:10344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528338.166062:0:10344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528338.166063:0:10344:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788528338.166073:0:10344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788528338.166362:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788528338.166377:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788528338.166388:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c79eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c79f2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528338.166406:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c79eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c79f2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528338.166416:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788528338.166419:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff8a8fc1fe4800 from 1 10000000:01000000:2.0:1788528338.166422:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788528338.166458:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c79f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528338.166466:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c79f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528338.166476:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c79f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528338.166499:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735419264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788528338.166612:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528338.166650:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c39046c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528338.166962:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735419264 00000100:00100000:0.0:1788528338.166972:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735419264 00000100:00100000:0.0:1788528338.167016:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788528338.167025:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+17:6506:x1875407735419264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788528338.167038:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528338.167052:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc26e3000/0x892c60dda91c7a00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c79f9 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.167077:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc26e3000/0x892c60dda91c7a00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c79f9 expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.167101:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc26e3000/0x892c60dda91c7a00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c79f9 expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.167111:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e3000, rc 0) 00000100:00100000:0.0:1788528338.167162:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735419264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528338.167169:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788528338.167462:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735419264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528338.167480:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c79f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a00 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528338.167491:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c79f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7a00 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528338.167614:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735419392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528338.167645:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528338.167690:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c39046c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528338.167868:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735419392 00000100:00100000:1.0:1788528338.167874:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735419392 00000100:00100000:1.0:1788528338.167901:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788528338.167908:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735419392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788528338.168015:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735419392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (367us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788528338.168022:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788528338.168207:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735419392:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788528338.168221:0:6506:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.203.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:2.0:1788528338.168374:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735419520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528338.168402:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528338.168423:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c39046c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528338.168482:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735419520 00000100:00100000:0.0:1788528338.168487:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735419520 00000100:00100000:0.0:1788528338.168507:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788528338.168513:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735419520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788528338.168612:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735419520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (208us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788528338.168620:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788528338.168647:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735419520:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788528338.168665:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788528338.168674:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c79f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a00 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.168802:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c79f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a00 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528338.168813:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788528338.168816:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff8a90fa76f800 from 48 10000000:01000000:0.0:1788528338.168818:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788528338.168849:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2000/0x892c60dda91c7a07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.168866:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2000/0x892c60dda91c7a07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.168875:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2000/0x892c60dda91c7a07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528338.168888:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735419648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788528338.168914:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528338.169050:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695180 going to sleep for 11 seconds 00000100:00100000:0.0:1788528338.169063:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735419648 00000100:00100000:0.0:1788528338.169067:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735419648 00000100:00100000:0.0:1788528338.169086:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788528338.169092:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+18:6506:x1875407735419648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788528338.169100:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528338.169111:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc26e2c00/0x892c60dda91c7a0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7a07 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.169130:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc26e2c00/0x892c60dda91c7a0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7a07 expref: 19 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.169139:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc26e2c00/0x892c60dda91c7a0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7a07 expref: 19 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.169147:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e2c00, rc 0) 00000100:00100000:0.0:1788528338.169174:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735419648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528338.169371:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788528338.169411:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735419648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788528338.169423:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2000/0x892c60dda91c7a07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a0e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.169432:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2000/0x892c60dda91c7a07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7a0e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788528338.169913:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 48 count 48 00000040:00080000:0.0:1788528338.170465:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788528338.171483:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788528338.171524:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788528338.171540:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788528338.171587:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788528338.171607:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788528338.171621:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788528338.171634:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788528338.171647:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788528338.171660:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788528338.171672:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788528338.171879:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788528338.171895:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788528338.172052:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788528338.172073:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788528338.172086:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788528338.172101:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788528338.172115:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788528338.172130:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788528338.172143:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788528338.172155:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788528338.172169:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788528338.172312:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788528338.172333:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788528338.172359:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788528338.172371:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1788528338.172385:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1788528338.172398:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1788528338.172411:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1788528338.172440:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1788528338.172456:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1788528338.172470:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1788528338.172482:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1788528338.172494:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1788528338.172507:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1788528338.172519:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1788528338.172532:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1788528338.172544:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1788528338.173098:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1788528338.173123:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1788528338.173136:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1788528338.173148:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1788528338.173161:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1788528338.173174:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1788528338.173323:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1788528338.173357:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1788528338.173374:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1788528338.173405:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1788528338.173411:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 47 count 48 00000100:00100000:1.0:1788528338.173524:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735419776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788528338.173821:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528338.173917:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528338.174073:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735419776 00000100:00100000:0.0:1788528338.174080:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735419776 00000100:00100000:0.0:1788528338.174153:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788528338.174163:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735419776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788528338.174488:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735419776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 326us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528338.174496:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788528338.174859:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735419776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528338.174901:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735419904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788528338.175129:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528338.175199:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3904780 going to sleep for 11 seconds 00000100:00100000:3.0:1788528338.175332:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735419904 00000100:00100000:3.0:1788528338.175338:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735419904 00000100:00100000:3.0:1788528338.175418:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788528338.175428:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735419904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788528338.175527:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735419904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528338.175534:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788528338.175970:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735419904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788528338.176419:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788528338.176499:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735420032:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788528338.176549:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528338.177869:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3904780 going to sleep for 11 seconds 00000100:00100000:1.0:1788528338.178100:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735420032 00000100:00100000:1.0:1788528338.178109:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735420032 00000100:00100000:3.0:1788528338.178417:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788528338.178428:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735420032:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788528338.179121:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735420032:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 690us (2567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528338.179142:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788528338.184917:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735420032:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788528338.186781:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788528338.186829:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788528338.186860:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788528338.186874:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788528338.186888:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788528338.186901:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788528338.186913:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788528338.186926:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788528338.186940:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788528338.186966:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788528338.186997:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788528338.187012:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788528338.187025:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788528338.187038:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788528338.187051:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788528338.187064:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788528338.187077:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788528338.187090:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788528338.187103:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788528338.187115:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788528338.187128:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788528338.187141:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788528338.187156:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788528338.187188:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788528338.187203:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788528338.187217:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788528338.188247:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788528338.188285:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788528338.188301:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788528338.188315:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788528338.188328:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788528338.188341:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788528338.188356:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788528338.188369:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788528338.188384:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788528338.188397:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788528338.188411:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788528338.188424:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788528338.188439:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788528338.188473:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788528338.188489:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788528338.188505:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788528338.188518:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788528338.188544:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788528338.188575:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788528338.188603:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788528338.188617:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788528338.188631:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788528338.188700:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735420160:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788528338.188775:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528338.188821:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3904780 going to sleep for 11 seconds 00000100:00100000:2.0:1788528338.188860:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735420160 00000100:00100000:2.0:1788528338.188867:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735420160 00000100:00100000:2.0:1788528338.188913:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788528338.188922:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735420160:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788528338.189484:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735420160:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 560us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528338.189492:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788528338.189573:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735420160:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788528338.190055:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788528338.190081:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788528338.190109:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735420288:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788528338.190149:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528338.190170:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3dadf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788528338.190317:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735420288 00000100:00100000:2.0:1788528338.190324:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735420288 00000100:00100000:2.0:1788528338.190352:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788528338.190359:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735420288:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788528338.190436:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735420288:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 77us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528338.190453:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788528338.190491:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735420288:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788528338.190525:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788528338.190532:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000040:00080000:1.0:1788528338.196407:0:10345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1788528338.196590:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788528338.196611:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788528338.196624:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2000/0x892c60dda91c7a07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a0e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528338.196635:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2000/0x892c60dda91c7a07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a0e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528338.196649:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788528338.196652:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788528338.196655:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788528338.196700:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7a15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528338.196707:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7a15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528338.196718:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7a15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528338.196743:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735420416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788528338.196812:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528338.196866:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3904780 going to sleep for 11 seconds 00000100:00100000:1.0:1788528338.197154:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735420416 00000100:00100000:1.0:1788528338.197161:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735420416 00000100:00100000:1.0:1788528338.197218:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788528338.197237:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+19:6506:x1875407735420416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788528338.197250:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528338.197264:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90f6e17400/0x892c60dda91c7a1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7a15 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528338.197287:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90f6e17400/0x892c60dda91c7a1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7a15 expref: 20 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528338.197298:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90f6e17400/0x892c60dda91c7a1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7a15 expref: 20 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528338.197307:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e17400, rc 0) 00000100:00100000:1.0:1788528338.197353:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+20:6506:x1875407735420416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528338.197359:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788528338.197401:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735420416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788528338.197415:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7a15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a1c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528338.197424:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7a15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7a1c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788528338.197576:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1788528338.197831:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788528338.198316:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788528338.198344:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1788528338.198357:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1788528338.198369:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1788528338.198382:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1788528338.198395:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1788528338.198407:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1788528338.198419:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1788528338.198433:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1788528338.198451:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1788528338.198456:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 11 00000100:00100000:1.0:1788528338.198518:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735420544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788528338.198589:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528338.198624:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ee4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788528338.198647:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735420544 00000100:00100000:1.0:1788528338.198652:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735420544 00000100:00100000:2.0:1788528338.200119:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788528338.200151:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+20:6506:x1875407735420544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528338.200459:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+20:6506:x1875407735420544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 314us (1869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528338.200468:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788528338.200892:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735420544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788528338.201381:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735420672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788528338.201443:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528338.201492:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695000 going to sleep for 11 seconds 00000100:00100000:2.0:1788528338.201590:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735420672 00000100:00100000:2.0:1788528338.201598:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735420672 00000100:00100000:2.0:1788528338.201631:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788528338.201638:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+20:6506:x1875407735420672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788528338.201912:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+20:6506:x1875407735420672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 273us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528338.201930:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788528338.202460:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735420672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788528338.205414:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788528338.205534:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735420800:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788528338.205647:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528338.205795:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695000 going to sleep for 11 seconds 00000100:00100000:2.0:1788528338.206222:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735420800 00000100:00100000:2.0:1788528338.206236:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735420800 00000100:00100000:2.0:1788528338.206281:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788528338.206290:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+20:6506:x1875407735420800:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788528338.206412:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+20:6506:x1875407735420800:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 121us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528338.206419:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788528338.206720:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735420800:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788528338.207123:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788528338.207160:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1788528338.207174:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1788528338.207200:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1788528338.207215:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1788528338.207289:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1788528338.207307:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1788528338.207318:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1788528338.207330:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:0.0:1788528338.207342:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:0.0:1788528338.207373:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:0.0:1788528338.207390:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:0.0:1788528338.207422:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735420928:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788528338.207470:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528338.207501:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695000 going to sleep for 11 seconds 00000100:00100000:2.0:1788528338.207826:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735420928 00000100:00100000:2.0:1788528338.207847:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735420928 00000100:00100000:2.0:1788528338.207882:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788528338.207889:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+20:6506:x1875407735420928:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788528338.208411:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+20:6506:x1875407735420928:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 520us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528338.208420:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788528338.213181:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735420928:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788528338.213349:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:0.0:1788528338.213366:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788528338.214519:0:10346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528338.214530:0:10346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528338.214533:0:10346:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788528338.214538:0:10346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788528338.214547:0:10346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528338.214550:0:10346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528338.214600:0:10346:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788528338.214605:0:10346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1788528338.215080:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788528338.215091:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788528338.215102:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7a15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a1c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.215114:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7a15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a1c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528338.215125:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788528338.215128:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff8a90fa76f800 from 1 10000000:01000000:0.0:1788528338.215131:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788528338.215175:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c7a23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.215184:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c7a23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.215194:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c7a23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528338.215218:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735421056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788528338.215345:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528338.215420:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695000 going to sleep for 11 seconds 00000100:00100000:2.0:1788528338.220459:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735421056 00000100:00100000:2.0:1788528338.220493:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735421056 00000100:00100000:3.0:1788528338.220664:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788528338.220674:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+20:6506:x1875407735421056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788528338.221043:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528338.221063:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c14aae00/0x892c60dda91c7a2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7a23 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528338.221090:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c14aae00/0x892c60dda91c7a2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7a23 expref: 21 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528338.221100:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c14aae00/0x892c60dda91c7a2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7a23 expref: 21 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528338.221108:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c14aae00, rc 0) 00000100:00100000:3.0:1788528338.221182:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+21:6506:x1875407735421056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 510us (5838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528338.221188:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788528338.221483:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735421056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788528338.221503:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c7a23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a2a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.221513:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c7a23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7a2a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528338.221635:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735421184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788528338.221672:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528338.221818:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695000 going to sleep for 11 seconds 00000100:00100000:0.0:1788528338.224813:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735421184 00000100:00100000:0.0:1788528338.224828:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735421184 00000100:00100000:0.0:1788528338.224905:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788528338.224916:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+21:6506:x1875407735421184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788528338.225078:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+21:6506:x1875407735421184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (3405us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788528338.225104:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788528338.225261:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735421184:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788528338.225284:0:6506:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.203.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:3.0:1788528338.225342:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735421312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528338.225377:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528338.225412:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1fd6840 going to sleep for 11 seconds 00000100:00100000:2.0:1788528338.225533:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735421312 00000100:00100000:2.0:1788528338.225538:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735421312 00000100:00100000:2.0:1788528338.225594:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788528338.225602:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+21:6506:x1875407735421312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528338.225658:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+21:6506:x1875407735421312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 57us (282us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788528338.225665:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788528338.225812:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735421312:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788528338.225843:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788528338.225855:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c7a23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a2a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528338.225879:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c7a23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a2a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528338.225891:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788528338.225894:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff8a90f5add000 from 48 10000000:01000000:3.0:1788528338.225899:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788528338.225924:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c14abc00/0x892c60dda91c7a31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528338.225932:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c14abc00/0x892c60dda91c7a31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528338.225941:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c14abc00/0x892c60dda91c7a31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528338.225966:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735421440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788528338.225994:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528338.226020:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1fd6840 going to sleep for 11 seconds 00000100:00100000:0.0:1788528338.226145:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735421440 00000100:00100000:0.0:1788528338.226150:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735421440 00000100:00100000:0.0:1788528338.226173:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788528338.226180:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+21:6506:x1875407735421440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788528338.226189:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528338.226201:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc26e3c00/0x892c60dda91c7a38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7a31 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.226222:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc26e3c00/0x892c60dda91c7a38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7a31 expref: 22 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.226292:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc26e3c00/0x892c60dda91c7a38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7a31 expref: 22 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.226302:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e3c00, rc 0) 00000100:00100000:0.0:1788528338.226333:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+22:6506:x1875407735421440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528338.226339:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788528338.226530:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735421440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788528338.226542:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c14abc00/0x892c60dda91c7a31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a38 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528338.226580:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c14abc00/0x892c60dda91c7a31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7a38 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788528338.226745:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 48 count 48 00000040:00080000:3.0:1788528338.227221:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788528338.227897:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1788528338.228341:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1788528338.228362:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1788528338.228378:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1788528338.228392:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1788528338.228408:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1788528338.228422:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1788528338.228438:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1788528338.228453:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1788528338.228467:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1788528338.228483:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1788528338.228496:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1788528338.228511:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1788528338.228525:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1788528338.228539:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1788528338.228598:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1788528338.228618:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1788528338.228633:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1788528338.228648:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1788528338.228662:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1788528338.228749:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1788528338.228772:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1788528338.228788:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1788528338.228802:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1788528338.228818:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1788528338.228841:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1788528338.228857:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1788528338.228867:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1788528338.228901:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1788528338.228918:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1788528338.228946:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1788528338.229458:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1788528338.229479:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1788528338.229494:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1788528338.229521:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1788528338.229535:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1788528338.229549:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1788528338.230171:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1788528338.230188:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1788528338.230202:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1788528338.230217:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1788528338.230465:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1788528338.230487:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1788528338.230502:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1788528338.230537:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1788528338.230575:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1788528338.230619:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1788528338.230625:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 47 count 48 00000100:00100000:3.0:1788528338.231361:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735421568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528338.231430:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528338.231526:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1fd6840 going to sleep for 11 seconds 00000100:00100000:0.0:1788528338.235787:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735421568 00000100:00100000:0.0:1788528338.235807:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735421568 00000100:00100000:1.0:1788528338.236173:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788528338.236184:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+22:6506:x1875407735421568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788528338.236484:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+22:6506:x1875407735421568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 302us (5053us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528338.236493:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788528338.236622:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735421568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528338.236673:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735421696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788528338.236732:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528338.236767:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1fd6840 going to sleep for 11 seconds 00000100:00100000:0.0:1788528338.237034:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735421696 00000100:00100000:0.0:1788528338.237040:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735421696 00000100:00100000:0.0:1788528338.237068:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788528338.237074:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+22:6506:x1875407735421696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788528338.237165:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+22:6506:x1875407735421696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528338.237172:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788528338.237409:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735421696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788528338.238083:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788528338.238150:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735421824:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788528338.238198:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528338.238221:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1fd6840 going to sleep for 11 seconds 00000100:00100000:1.0:1788528338.238409:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735421824 00000100:00100000:1.0:1788528338.238421:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735421824 00000100:00100000:1.0:1788528338.238452:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788528338.238459:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c8116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+22:6506:x1875407735421824:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788528338.238872:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c8116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+22:6506:x1875407735421824:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 413us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528338.238880:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788528338.239132:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735421824:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788528338.239384:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1788528338.239411:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1788528338.239426:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1788528338.239440:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1788528338.239454:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1788528338.239468:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1788528338.239480:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1788528338.239494:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1788528338.239506:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1788528338.239518:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1788528338.239534:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1788528338.240100:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1788528338.240121:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1788528338.240134:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1788528338.240147:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1788528338.240161:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1788528338.240174:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1788528338.240187:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1788528338.240200:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1788528338.240214:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1788528338.240305:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1788528338.240327:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1788528338.240342:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1788528338.240356:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1788528338.240370:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1788528338.240385:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1788528338.240397:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1788528338.240426:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1788528338.240441:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1788528338.240453:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1788528338.240464:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1788528338.240476:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1788528338.240502:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1788528338.240514:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1788528338.240526:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1788528338.240538:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1788528338.240549:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1788528338.241862:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1788528338.241887:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1788528338.241900:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1788528338.241912:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1788528338.242091:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1788528338.242111:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1788528338.242148:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1788528338.242163:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1788528338.242175:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1788528338.242187:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1788528338.242198:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1788528338.242318:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735421952:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788528338.242399:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528338.242518:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1fd6840 going to sleep for 11 seconds 00000100:00100000:2.0:1788528338.245400:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735421952 00000100:00100000:2.0:1788528338.245417:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735421952 00000100:00100000:3.0:1788528338.246081:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788528338.246093:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c8116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+22:6506:x1875407735421952:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788528338.246919:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c8116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+22:6506:x1875407735421952:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 824us (4515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528338.246929:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788528338.253549:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735421952:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788528338.254015:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1788528338.254045:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1788528338.254086:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735422080:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788528338.254157:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528338.254199:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c67ef9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528338.254324:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735422080 00000100:00100000:0.0:1788528338.254332:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735422080 00000100:00100000:0.0:1788528338.254373:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788528338.254382:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c8116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+22:6506:x1875407735422080:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788528338.254505:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c8116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+22:6506:x1875407735422080:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 122us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528338.254512:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788528338.255114:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735422080:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788528338.255168:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:2.0:1788528338.255177:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000040:00080000:0.0:1788528338.262888:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:2.0:1788528338.263110:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788528338.263130:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788528338.263141:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c14abc00/0x892c60dda91c7a31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a38 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528338.263153:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c14abc00/0x892c60dda91c7a31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a38 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528338.263168:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788528338.263171:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1788528338.263174:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788528338.263220:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c7a3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528338.263229:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c7a3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528338.263241:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c7a3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528338.263266:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735422208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788528338.263333:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528338.263432:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3d49540 going to sleep for 11 seconds 00000100:00100000:3.0:1788528338.264758:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735422208 00000100:00100000:3.0:1788528338.264770:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735422208 00000100:00100000:3.0:1788528338.264825:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788528338.264845:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+22:6506:x1875407735422208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788528338.264860:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528338.264887:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c14aba00/0x892c60dda91c7a46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7a3f expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528338.264914:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c14aba00/0x892c60dda91c7a46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7a3f expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528338.264925:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c14aba00/0x892c60dda91c7a46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7a3f expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528338.264933:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c14aba00, rc 0) 00000100:00100000:3.0:1788528338.265156:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+23:6506:x1875407735422208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 322us (1822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528338.265163:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788528338.265282:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735422208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788528338.265302:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c7a3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a46 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.265311:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c7a3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7a46 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788528338.265477:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 43 count 43 00000040:00080000:0.0:1788528338.266263:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788528338.266467:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].1, 224 off8416 00000040:00080000:0.0:1788528338.266493:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].2, 136 off8552 00000040:00080000:0.0:1788528338.266510:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].3, 176 off8728 00000040:00080000:0.0:1788528338.266525:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].4, 224 off8952 00000040:00080000:0.0:1788528338.266536:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].5, 224 off9176 00000040:00080000:0.0:1788528338.266549:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].6, 120 off9296 00000040:00080000:0.0:1788528338.266780:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].7, 112 off9408 00000040:00080000:0.0:1788528338.266798:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].8, 160 off9568 00000040:00080000:0.0:1788528338.266812:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].9, 224 off9792 00000040:00080000:0.0:1788528338.266826:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].10, 224 off10016 00000040:00080000:0.0:1788528338.266869:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].11, 88 off10104 00000040:00080000:0.0:1788528338.266896:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].12, 144 off10248 00000040:00080000:0.0:1788528338.266910:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].13, 152 off10400 00000040:00080000:0.0:1788528338.266924:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].14, 168 off10568 00000040:00080000:0.0:1788528338.266939:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].15, 224 off10792 00000040:00080000:0.0:1788528338.266951:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].16, 224 off11016 00000040:00080000:0.0:1788528338.267050:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].17, 80 off11096 00000040:00080000:0.0:1788528338.267065:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].18, 224 off11320 00000040:00080000:0.0:1788528338.267078:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].19, 224 off11544 00000040:00080000:0.0:1788528338.267093:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].20, 160 off11704 00000040:00080000:0.0:1788528338.267106:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].21, 224 off11928 00000040:00080000:0.0:1788528338.267118:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].22, 224 off12152 00000040:00080000:0.0:1788528338.267131:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].23, 80 off12232 00000040:00080000:0.0:1788528338.267146:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].24, 224 off12456 00000040:00080000:0.0:1788528338.267159:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].25, 224 off12680 00000040:00080000:0.0:1788528338.267172:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].26, 88 off12768 00000040:00080000:0.0:1788528338.267204:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].27, 144 off12912 00000040:00080000:0.0:1788528338.267220:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].28, 152 off13064 00000040:00080000:0.0:1788528338.267233:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].29, 136 off13200 00000040:00080000:0.0:1788528338.267246:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].30, 224 off13424 00000040:00080000:0.0:1788528338.267259:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].31, 224 off13648 00000040:00080000:0.0:1788528338.267271:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].32, 80 off13728 00000040:00080000:0.0:1788528338.267284:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].33, 224 off13952 00000040:00080000:0.0:1788528338.267296:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].34, 224 off14176 00000040:00080000:0.0:1788528338.267309:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].35, 88 off14264 00000040:00080000:0.0:1788528338.267321:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].36, 144 off14408 00000040:00080000:0.0:1788528338.267334:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].37, 152 off14560 00000040:00080000:0.0:1788528338.267347:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].38, 136 off14696 00000040:00080000:0.0:1788528338.267361:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].39, 224 off14920 00000040:00080000:0.0:1788528338.267374:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].40, 224 off15144 00000040:00080000:0.0:1788528338.267387:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].41, 80 off15224 00000040:00080000:0.0:1788528338.267410:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].42, 224 off15448 00000040:00080000:0.0:1788528338.267415:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 43 00000100:00100000:0.0:1788528338.267509:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735422336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788528338.267939:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528338.268085:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3a94e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788528338.268131:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735422336 00000100:00100000:3.0:1788528338.268138:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735422336 00000100:00100000:3.0:1788528338.268216:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788528338.268225:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+23:6506:x1875407735422336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528338.268358:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+23:6506:x1875407735422336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528338.268366:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788528338.268445:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735422336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788528338.268481:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735422464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788528338.268522:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528338.268875:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ee4000 going to sleep for 11 seconds 00000100:00100000:0.0:1788528338.269101:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735422464 00000100:00100000:0.0:1788528338.269107:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735422464 00000100:00100000:0.0:1788528338.269139:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788528338.269146:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+23:6506:x1875407735422464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788528338.269253:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+23:6506:x1875407735422464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528338.269260:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788528338.269343:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735422464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788528338.270097:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788528338.270180:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735422592:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788528338.270227:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528338.270293:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ee4000 going to sleep for 11 seconds 00000100:00100000:2.0:1788528338.270347:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735422592 00000100:00100000:2.0:1788528338.270362:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735422592 00000100:00100000:0.0:1788528338.270516:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788528338.270526:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+23:6506:x1875407735422592:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788528338.270930:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+23:6506:x1875407735422592:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 405us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528338.270937:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788528338.271079:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735422592:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788528338.271255:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].1, 224 off8416 00000040:00080000:0.0:1788528338.271284:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].2, 136 off8552 00000040:00080000:0.0:1788528338.271297:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].3, 176 off8728 00000040:00080000:0.0:1788528338.271309:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].4, 224 off8952 00000040:00080000:0.0:1788528338.271321:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].5, 224 off9176 00000040:00080000:0.0:1788528338.271334:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].6, 120 off9296 00000040:00080000:0.0:1788528338.271346:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].7, 112 off9408 00000040:00080000:0.0:1788528338.271372:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].8, 160 off9568 00000040:00080000:0.0:1788528338.271389:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].9, 224 off9792 00000040:00080000:0.0:1788528338.271401:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].10, 224 off10016 00000040:00080000:0.0:1788528338.271412:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].11, 88 off10104 00000040:00080000:0.0:1788528338.271426:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].12, 144 off10248 00000040:00080000:0.0:1788528338.271438:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].13, 152 off10400 00000040:00080000:0.0:1788528338.271450:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].14, 168 off10568 00000040:00080000:0.0:1788528338.271463:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].15, 224 off10792 00000040:00080000:0.0:1788528338.271476:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].16, 224 off11016 00000040:00080000:0.0:1788528338.271488:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].17, 80 off11096 00000040:00080000:0.0:1788528338.271500:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].18, 224 off11320 00000040:00080000:0.0:1788528338.271527:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].19, 224 off11544 00000040:00080000:0.0:1788528338.271540:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].20, 160 off11704 00000040:00080000:0.0:1788528338.272247:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].21, 224 off11928 00000040:00080000:0.0:1788528338.272278:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].22, 224 off12152 00000040:00080000:0.0:1788528338.272293:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].23, 80 off12232 00000040:00080000:0.0:1788528338.272323:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].24, 224 off12456 00000040:00080000:0.0:1788528338.272341:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].25, 224 off12680 00000040:00080000:0.0:1788528338.272355:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].26, 88 off12768 00000040:00080000:0.0:1788528338.272369:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].27, 144 off12912 00000040:00080000:0.0:1788528338.272381:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].28, 152 off13064 00000040:00080000:0.0:1788528338.272395:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].29, 136 off13200 00000040:00080000:0.0:1788528338.272407:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].30, 224 off13424 00000040:00080000:0.0:1788528338.272418:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].31, 224 off13648 00000040:00080000:0.0:1788528338.272429:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].32, 80 off13728 00000040:00080000:0.0:1788528338.272440:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].33, 224 off13952 00000040:00080000:0.0:1788528338.272453:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].34, 224 off14176 00000040:00080000:0.0:1788528338.272465:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].35, 88 off14264 00000040:00080000:0.0:1788528338.272478:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].36, 144 off14408 00000040:00080000:0.0:1788528338.272491:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].37, 152 off14560 00000040:00080000:0.0:1788528338.272503:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].38, 136 off14696 00000040:00080000:0.0:1788528338.272517:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].39, 224 off14920 00000040:00080000:0.0:1788528338.272543:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].40, 224 off15144 00000040:00080000:1.0:1788528338.273094:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].41, 80 off15224 00000040:00080000:1.0:1788528338.273117:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].42, 224 off15448 00000040:00080000:1.0:1788528338.273131:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].43, 224 off15672 00000040:00080000:1.0:1788528338.273144:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].44, 120 off15792 00000100:00100000:1.0:1788528338.273190:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735422720:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788528338.273263:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528338.273467:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ee49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528338.273530:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735422720 00000100:00100000:3.0:1788528338.273538:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735422720 00000100:00100000:3.0:1788528338.273725:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788528338.273735:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+23:6506:x1875407735422720:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788528338.273926:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+23:6506:x1875407735422720:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 192us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528338.273934:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788528338.274294:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735422720:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788528338.274410:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].45, 224 off16016 00000040:00080000:3.0:1788528338.274429:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1788528338.275282:0:10348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788528338.275292:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528338.275294:0:10348:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788528338.275300:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788528338.275310:0:10348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788528338.275313:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528338.275314:0:10348:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788528338.275317:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 46 count 46 00000020:01000000:1.0:1788528338.275434:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1788528338.275446:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788528338.275457:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c7a3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a46 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528338.275467:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c7a3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a46 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528338.275477:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788528338.275479:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff8a90f5add000 from 1 10000000:01000000:1.0:1788528338.275482:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788528338.275512:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16a00/0x892c60dda91c7a4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528338.275520:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16a00/0x892c60dda91c7a4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528338.275529:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16a00/0x892c60dda91c7a4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528338.275549:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735422848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788528338.275645:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528338.275677:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ee40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528338.276096:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735422848 00000100:00100000:3.0:1788528338.276104:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735422848 00000100:00100000:3.0:1788528338.276154:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788528338.276164:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+23:6506:x1875407735422848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788528338.276178:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528338.276192:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c14ab400/0x892c60dda91c7a54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7a4d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528338.276218:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c14ab400/0x892c60dda91c7a54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7a4d expref: 24 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528338.276229:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c14ab400/0x892c60dda91c7a54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7a4d expref: 24 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528338.276238:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c14ab400, rc 0) 00000100:00100000:3.0:1788528338.276291:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735422848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528338.276298:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788528338.276376:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735422848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528338.276392:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16a00/0x892c60dda91c7a4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a54 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528338.276402:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16a00/0x892c60dda91c7a4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7a54 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528338.276465:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735422976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528338.276493:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528338.276520:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3d493c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528338.276592:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735422976 00000100:00100000:3.0:1788528338.276596:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735422976 00000100:00100000:3.0:1788528338.276623:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788528338.276630:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735422976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528338.276702:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735422976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 72us (208us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788528338.276710:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788528338.276738:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735422976:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788528338.276750:0:6506:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.203.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:3.0:1788528338.276785:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735423104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528338.276811:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528338.276829:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735423104 00000100:00100000:3.0:1788528338.276842:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735423104 00000100:00100000:3.0:1788528338.276860:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788528338.276865:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735423104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528338.276903:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735423104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 37us (91us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788528338.276910:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788528338.276931:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1fd6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528338.276942:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735423104:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788528338.277183:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788528338.277192:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16a00/0x892c60dda91c7a4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a54 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528338.277201:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16a00/0x892c60dda91c7a4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a54 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528338.277210:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788528338.277212:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff8a90c7f88000 from 48 10000000:01000000:3.0:1788528338.277223:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788528338.277244:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c14abe00/0x892c60dda91c7a5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528338.277251:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c14abe00/0x892c60dda91c7a5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528338.277259:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c14abe00/0x892c60dda91c7a5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528338.277273:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735423232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788528338.277303:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528338.277324:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735423232 00000100:00100000:3.0:1788528338.277327:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735423232 00000100:00100000:3.0:1788528338.277346:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788528338.277353:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735423232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788528338.277360:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528338.277370:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c14ab200/0x892c60dda91c7a62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7a5b expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528338.277387:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c14ab200/0x892c60dda91c7a62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7a5b expref: 25 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528338.277396:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c14ab200/0x892c60dda91c7a62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7a5b expref: 25 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528338.277403:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c14ab200, rc 0) 00000100:00100000:3.0:1788528338.277427:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735423232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528338.277432:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788528338.277461:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695600 going to sleep for 11 seconds 00000100:00100000:3.0:1788528338.277473:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735423232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788528338.277483:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c14abe00/0x892c60dda91c7a5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a62 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528338.277491:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c14abe00/0x892c60dda91c7a5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7a62 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528338.277514:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735423360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528338.277536:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528338.277714:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735423360 00000100:00100000:3.0:1788528338.277719:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735423360 00000100:00100000:3.0:1788528338.277736:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788528338.277741:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735423360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528338.277830:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735423360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528338.277852:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788528338.277873:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695600 going to sleep for 11 seconds 00000100:00100000:3.0:1788528338.277885:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735423360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528338.277909:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735423488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788528338.277948:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528338.278228:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735423488 00000100:00100000:3.0:1788528338.278233:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735423488 00000100:00100000:3.0:1788528338.278251:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788528338.278257:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735423488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788528338.278332:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735423488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528338.278345:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788528338.278375:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695600 going to sleep for 11 seconds 00000100:00100000:3.0:1788528338.278387:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735423488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788528338.278783:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:10349:1875407735423616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788528338.278820:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528338.278879:0:10349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695900 going to sleep for 11 seconds 00000100:00100000:2.0:1788528338.279107:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735423616 00000100:00100000:2.0:1788528338.279113:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735423616 00000100:00100000:2.0:1788528338.279172:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788528338.279181:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+25:10349:x1875407735423616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788528338.279294:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+25:10349:x1875407735423616:12345-0@lo:502:llog_process_th.0 Request processed in 115us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528338.279302:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788528338.279368:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:10349:1875407735423616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788528338.279407:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:10349:1875407735423744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788528338.279441:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528338.279542:0:10349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695900 going to sleep for 11 seconds 00000100:00100000:1.0:1788528338.279889:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735423744 00000100:00100000:1.0:1788528338.279895:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735423744 00000100:00100000:3.0:1788528338.280180:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788528338.280189:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+25:10349:x1875407735423744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788528338.280347:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+25:10349:x1875407735423744:12345-0@lo:502:llog_process_th.0 Request processed in 158us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528338.280355:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788528338.280491:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:10349:1875407735423744:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788528338.280515:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788528338.280947:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788528338.281019:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788528338.281032:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c14abe00/0x892c60dda91c7a5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a62 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528338.281043:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c14abe00/0x892c60dda91c7a5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a62 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528338.281053:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788528338.281062:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1788528338.281065:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788528338.281092:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c7a69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528338.281100:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c7a69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528338.281110:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c7a69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528338.281127:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735423872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788528338.281165:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528338.281200:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c2b57e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788528338.281241:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735423872 00000100:00100000:0.0:1788528338.281248:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735423872 00000100:00100000:0.0:1788528338.281286:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788528338.281293:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735423872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788528338.281303:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528338.281314:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc26e2a00/0x892c60dda91c7a70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7a69 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.281335:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc26e2a00/0x892c60dda91c7a70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7a69 expref: 26 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.281353:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc26e2a00/0x892c60dda91c7a70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7a69 expref: 26 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.281360:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e2a00, rc 0) 00000100:00100000:0.0:1788528338.281405:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735423872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528338.281411:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788528338.281478:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735423872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528338.281491:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c7a69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a70 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528338.281500:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c7a69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7a70 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528338.281535:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735424000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528338.281588:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528338.281605:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3d49b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788528338.281660:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735424000 00000100:00100000:0.0:1788528338.281664:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735424000 00000100:00100000:0.0:1788528338.281694:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788528338.281701:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735424000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788528338.281808:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735424000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528338.281814:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788528338.281853:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735424000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788528338.281895:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735424128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788528338.281934:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528338.282037:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735424128 00000100:00100000:2.0:1788528338.282042:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735424128 00000100:00100000:2.0:1788528338.282061:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788528338.282066:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735424128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788528338.282135:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735424128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528338.282142:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788528338.282185:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f5a63780 going to sleep for 11 seconds 00000100:00100000:0.0:1788528338.282200:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735424128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788528338.282826:0:10350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:10350:1875407735424256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788528338.282877:0:10350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528338.282904:0:10350:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f5a63480 going to sleep for 11 seconds 00000100:00100000:2.0:1788528338.282940:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735424256 00000100:00100000:2.0:1788528338.282945:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735424256 00000100:00100000:2.0:1788528338.283031:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788528338.283038:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+26:10350:x1875407735424256:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788528338.283124:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+26:10350:x1875407735424256:12345-0@lo:502:llog_process_th.0 Request processed in 86us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528338.283139:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788528338.283200:0:10350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:10350:1875407735424256:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788528338.283225:0:10350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788528338.283234:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528338.283236:0:10350:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788528338.283243:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788528338.283262:0:10350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:10350:1875407735424384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788528338.283295:0:10350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528338.283316:0:10350:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c2b57e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788528338.283352:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735424384 00000100:00100000:0.0:1788528338.283356:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735424384 00000100:00100000:0.0:1788528338.283388:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788528338.283394:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+26:10350:x1875407735424384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788528338.283452:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+26:10350:x1875407735424384:12345-0@lo:502:llog_process_th.0 Request processed in 58us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528338.283459:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788528338.283516:0:10350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:10350:1875407735424384:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788528338.283533:0:10350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788528338.283537:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528338.283539:0:10350:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788528338.283542:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788528338.283733:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1788528338.283741:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788528338.283749:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c7a69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a70 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.283759:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c7a69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a70 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528338.283768:0:6506:0:(mgc_request.c:714:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788528338.283770:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff8a90c7f88000 from 1 10000000:01000000:0.0:1788528338.283773:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788528338.283794:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2600/0x892c60dda91c7a77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.283801:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2600/0x892c60dda91c7a77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.283810:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2600/0x892c60dda91c7a77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528338.283821:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735424512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788528338.283857:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528338.283881:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f5a63900 going to sleep for 11 seconds 00000100:00100000:2.0:1788528338.283919:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735424512 00000100:00100000:2.0:1788528338.283924:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735424512 00000100:00100000:2.0:1788528338.284010:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788528338.284018:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735424512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528338.284026:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528338.284037:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9101851600/0x892c60dda91c7a7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7a77 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528338.284055:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101851600/0x892c60dda91c7a7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7a77 expref: 27 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528338.284064:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9101851600/0x892c60dda91c7a7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7a77 expref: 27 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528338.284073:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101851600, rc 0) 00000100:00100000:2.0:1788528338.284106:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:6506:x1875407735424512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528338.284111:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788528338.284184:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735424512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788528338.284201:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2600/0x892c60dda91c7a77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a7e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528338.284209:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2600/0x892c60dda91c7a77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7a7e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528338.284237:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735424640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788528338.284260:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528338.284281:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f5a63900 going to sleep for 11 seconds 00000100:00100000:2.0:1788528338.284318:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735424640 00000100:00100000:2.0:1788528338.284322:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735424640 00000100:00100000:2.0:1788528338.284350:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788528338.284355:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:6506:x1875407735424640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528338.284425:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:6506:x1875407735424640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 69us (163us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788528338.284432:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788528338.284485:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735424640:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788528338.284496:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788528338.284506:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2600/0x892c60dda91c7a77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a7e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528338.284514:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2600/0x892c60dda91c7a77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a7e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528339.073071:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528339.135342:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788528339.135368:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735424768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788528339.135451:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528339.135752:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735424768 00000100:00100000:2.0:1788528339.135772:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735424768 00000100:00100000:2.0:1788528339.135842:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788528339.135852:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735424768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788528339.135881:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528339.135929:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735424768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528339.135936:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788528339.136053:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6da3480 x1875407735424768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528339.136073:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735424768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788528339.136227:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788528339.136238:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735424896:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788528339.136270:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528339.136341:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735424896 00000100:00100000:2.0:1788528339.136346:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735424896 00000100:00100000:2.0:1788528339.136375:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788528339.136382:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735424896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788528339.136392:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528339.136425:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735424896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528339.136438:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788528339.136546:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90fab2c700 x1875407735424896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528339.136596:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735424896:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788528339.782746:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528339.782842:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719634304 00000100:00100000:3.0:1788528339.782852:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719634304 00000100:00100000:3.0:1788528339.782916:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 262 00000100:00100000:3.0:1788528339.782926:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+8:6172:x1875407719634304:12345-192.168.203.38@tcp:101: 00010000:00010000:3.0:1788528339.782944:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528339.782962:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c14aa400/0x892c60dda91c7a85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfba3 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528339.782990:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c14aa400/0x892c60dda91c7a85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfba3 expref: 9 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528339.783001:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c14aa400/0x892c60dda91c7a85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfba3 expref: 9 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528339.783009:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c14aa400, rc 0) 00000100:00100000:3.0:1788528339.783073:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+9:6172:x1875407719634304:12345-192.168.203.38@tcp:101: Request processed in 148us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528339.783093:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 262 00000100:00100000:2.0:1788528339.793373:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528339.800543:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719634432 00000100:00100000:0.0:1788528339.800632:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719634432 00000100:00100000:0.0:1788528339.801134:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 263 00000100:00100000:0.0:1788528339.801147:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+9:6172:x1875407719634432:12345-192.168.203.38@tcp:501: 00000100:00100000:0.0:1788528339.801324:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+9:6172:x1875407719634432:12345-192.168.203.38@tcp:501: Request processed in 179us (7961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528339.801332:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 263 00000100:00100000:1.0:1788528339.822375:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528339.822866:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719634560 00000100:00100000:2.0:1788528339.822875:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719634560 00000100:00100000:2.0:1788528339.822934:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 264 00000100:00100000:2.0:1788528339.822953:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+9:6172:x1875407719634560:12345-192.168.203.38@tcp:503: 00000100:00100000:2.0:1788528339.823096:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+9:6172:x1875407719634560:12345-192.168.203.38@tcp:503: Request processed in 152us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528339.823104:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 264 00000100:00100000:1.0:1788528339.827644:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528339.827836:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719634688 00000100:00100000:2.0:1788528339.827847:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719634688 00000100:00100000:2.0:1788528339.827907:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 265 00000100:00100000:2.0:1788528339.827917:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+9:6656:x1875407719634688:12345-192.168.203.38@tcp:502: 00000100:00100000:2.0:1788528339.828067:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+9:6656:x1875407719634688:12345-192.168.203.38@tcp:502: Request processed in 151us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528339.828075:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 265 00000100:00100000:1.0:1788528339.844655:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528339.844753:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719634816 00000100:00100000:2.0:1788528339.844763:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719634816 00000100:00100000:2.0:1788528339.844817:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 266 00000100:00100000:2.0:1788528339.844837:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+9:6656:x1875407719634816:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788528339.844971:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+9:6656:x1875407719634816:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 135us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528339.844979:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 266 00000100:00100000:1.0:1788528339.848538:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528339.848836:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719634944 00000100:00100000:0.0:1788528339.848852:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719634944 00000100:00100000:0.0:1788528339.848922:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 267 00000100:00100000:0.0:1788528339.848933:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+9:6172:x1875407719634944:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788528339.848950:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528339.848970:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc26e2800/0x892c60dda91c7a8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfbaa expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528339.848997:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc26e2800/0x892c60dda91c7a8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbaa expref: 10 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528339.849009:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc26e2800/0x892c60dda91c7a8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbaa expref: 10 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528339.849019:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e2800, rc 0) 00000100:00100000:0.0:1788528339.849094:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:6172:x1875407719634944:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 162us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528339.849103:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 267 00000100:00100000:1.0:1788528339.851727:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528339.861570:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719635072 00000100:00100000:3.0:1788528339.861591:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719635072 00000100:00100000:2.0:1788528339.870287:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 268 00000100:00100000:2.0:1788528339.870305:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:6172:x1875407719635072:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528339.871066:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:6172:x1875407719635072:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 760us (19348us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788528339.871078:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 268 00010000:00010000:1.0:1788528340.096779:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528340.159236:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788528340.159269:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735425024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788528340.159374:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528340.159928:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735425024 00000100:00100000:2.0:1788528340.159950:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735425024 00000100:00100000:2.0:1788528340.160019:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788528340.160178:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735425024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788528340.160225:0:9268:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788528340.160303:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735425024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 275us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528340.160311:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788528340.160411:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735425024:0@lo:41:osp-pre-1-0.0 00000020:00000080:1.0:1788528341.092926:0:10387:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdcc5b6ee0 20000000:00000080:1.0:1788528341.092957:0:10387:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a8fc35d5000 uarg=0000000000000000 20000000:01000000:1.0:1788528341.093019:0:10387:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788528341.093026:0:10387:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788528341.093031:0:10387:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788528341.103337:0:10388:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788528341.106459:0:10387:0:(mgs_llog.c:4126:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788528341.116308:0:10387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788528341.116351:0:10387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788528341.116369:0:10387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788528341.116390:0:10387:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788528341.116414:0:10387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7a93 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528341.116436:0:10387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c0030200/0x892c60dda91c76db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c76d4 expref: 26 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528341.116458:0:10387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c0031200/0x892c60dda91c76e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c76e2 expref: 26 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528341.116465:0:10387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9101850400/0x892c60dda91c773d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7736 expref: 26 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528341.116471:0:10387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7871 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c786a expref: 26 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528341.116482:0:10387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9101851000/0x892c60dda91c79a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb6b expref: 9 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528341.116490:0:10387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7a93 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528341.116541:0:10387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9101851000/0x892c60dda91c79a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb6b expref: 9 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528341.117669:0:10387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a9101851000/0x892c60dda91c79a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb6b expref: 9 pid: 6500 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528341.117697:0:10387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875407735425152:192.168.203.38@tcp:104: 00010000:00010000:0.0:1788528341.117866:0:10387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7871 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c786a expref: 26 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528341.117877:0:10387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7871 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c786a expref: 26 pid: 6502 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528341.117887:0:10387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875407735425280:0@lo:104: 00000100:00100000:0.0:1788528341.118443:0:10387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788528341.118501:0:10387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9101850400/0x892c60dda91c773d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c7736 expref: 26 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528341.118511:0:10387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9101850400/0x892c60dda91c773d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c7736 expref: 26 pid: 6500 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528341.118522:0:10387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875407735425408:0@lo:104: 00000100:00100000:0.0:1788528341.118550:0:10387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788528341.118613:0:10387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c0031200/0x892c60dda91c76e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c76e2 expref: 26 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528341.118622:0:10387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a90c0031200/0x892c60dda91c76e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c76e2 expref: 26 pid: 6501 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528341.118631:0:10387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875407735425536:0@lo:104: 00000100:00100000:0.0:1788528341.118658:0:10387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788528341.118686:0:10387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c0030200/0x892c60dda91c76db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c76d4 expref: 26 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528341.118695:0:10387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a90c0030200/0x892c60dda91c76db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c76d4 expref: 26 pid: 6501 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528341.118704:0:10387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875407735425664:0@lo:104: 00000100:00100000:0.0:1788528341.118724:0:10387:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f5a63480 going to sleep for 11 seconds 00000100:00100000:1.0:1788528341.118888:0:6491:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788528341.118908:0:6491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528341.118921:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735425280 00000100:00100000:1.0:1788528341.118930:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735425280 00000100:00100000:1.0:1788528341.118989:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735425408 00000100:00100000:1.0:1788528341.118992:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735425408 00000100:00100000:1.0:1788528341.119007:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735425536 00000100:00100000:1.0:1788528341.119010:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735425536 00000100:00100000:1.0:1788528341.119019:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735425664 00000100:00100000:1.0:1788528341.119021:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735425664 00000100:00100000:1.0:1788528341.119039:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788528341.119049:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+6:10387:x1875407735425280:12345-0@lo:104: 00010000:00010000:1.0:1788528341.119065:0:6491:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c786a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7871 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.119124:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788528341.119130:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+6:10387:x1875407735425280:12345-0@lo:104: Request processed in 83us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528341.119137:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788528341.119158:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788528341.119173:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+5:10387:x1875407735425408:12345-0@lo:104: 00010000:00010000:1.0:1788528341.119181:0:6491:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c7736 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c773d expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.119216:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788528341.119221:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+5:10387:x1875407735425408:12345-0@lo:104: Request processed in 50us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528341.119227:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788528341.119241:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788528341.119247:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+4:10387:x1875407735425536:12345-0@lo:104: 00010000:00010000:1.0:1788528341.119255:0:6491:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c76e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c76e9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.119291:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788528341.119296:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+4:10387:x1875407735425536:12345-0@lo:104: Request processed in 50us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528341.119302:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788528341.119344:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788528341.119351:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+3:10387:x1875407735425664:12345-0@lo:104: 00010000:00010000:1.0:1788528341.119360:0:6491:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a9101850600/0x892c60dda91c76d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c76db expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.119394:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788528341.119400:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+3:10387:x1875407735425664:12345-0@lo:104: Request processed in 50us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528341.119406:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:1.0:1788528341.119425:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788528341.119438:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c786a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7871 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.119446:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16e00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528341.119451:0:8439:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c786a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c7871 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.119462:0:8439:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c786a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c7871 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528341.119471:0:8439:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c786a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c7871 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528341.119477:0:8439:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788528341.119516:0:8439:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c786a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7871 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.119523:0:8439:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528341.119548:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c786a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7871 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.119587:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c786a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7871 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.119604:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788528341.119607:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c7736 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c773d expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.119613:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031e00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528341.119616:0:8439:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c7736 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c773d expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.119633:0:8439:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c7736 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c773d expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528341.119640:0:8439:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c7736 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c773d expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528341.119646:0:8439:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788528341.119663:0:8439:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c7736 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c773d expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.119669:0:8439:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528341.119686:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c7736 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c773d expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.119693:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c7736 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c773d expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.119704:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788528341.119707:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c76e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c76e9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.119713:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c1550800 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528341.119716:0:8439:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c76e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c76e9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.119723:0:8439:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c76e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c76e9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528341.119729:0:8439:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c76e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c76e9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528341.119741:0:8439:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788528341.119757:0:8439:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c76e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c76e9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.119763:0:8439:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528341.119769:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c76e2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c76e9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.119776:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c76e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c76e9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.119788:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528341.119791:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a9101850600/0x892c60dda91c76d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c76db expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.119797:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850600 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528341.119800:0:8439:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a9101850600/0x892c60dda91c76d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c76db expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.119806:0:8439:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a9101850600/0x892c60dda91c76d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c76db expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528341.119824:0:8439:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a9101850600/0x892c60dda91c76d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c76db expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528341.119831:0:8439:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788528341.119845:0:8439:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a9101850600/0x892c60dda91c76d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c76db expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.119851:0:8439:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528341.119866:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a9101850600/0x892c60dda91c76d4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c76db expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.119873:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a9101850600/0x892c60dda91c76d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c76db expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.119888:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528341.119890:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528341.119892:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528341.119901:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528341.119907:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528341.119912:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528341.119935:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735425792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528341.119992:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528341.120030:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788528341.120036:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735426176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528341.120060:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528341.120092:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735425920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528341.120113:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528341.120130:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788528341.120135:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735426048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528341.120155:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528341.120188:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735425792 00000100:00100000:1.0:1788528341.120194:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735425792 00010000:00010000:1.0:1788528341.120223:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7871 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c786a expref: 27 pid: 6502 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528341.120247:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735426176 00000100:00100000:1.0:1788528341.120250:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735426176 00010000:00010000:1.0:1788528341.120270:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c0030200/0x892c60dda91c76db lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c76d4 expref: 28 pid: 6501 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528341.120282:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735425920 00000100:00100000:1.0:1788528341.120287:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735425920 00010000:00010000:1.0:1788528341.120296:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9101850400/0x892c60dda91c773d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7736 expref: 29 pid: 6500 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528341.120305:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735426048 00000100:00100000:1.0:1788528341.120307:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735426048 00010000:00010000:1.0:1788528341.120315:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c0031200/0x892c60dda91c76e9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c76e2 expref: 30 pid: 6501 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528341.120325:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788528341.120331:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90efa87c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd052447-840d-4bcc-891b-140c465c7625+30:3640:x1875407735425792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788528341.120345:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528341.120350:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7871 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c786a expref: 30 pid: 6502 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.120360:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7871 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c786a expref: 30 pid: 6502 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.120380:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528341.120411:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90efa87c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd052447-840d-4bcc-891b-140c465c7625+30:3640:x1875407735425792:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528341.120418:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788528341.120457:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788528341.120463:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd052447-840d-4bcc-891b-140c465c7625+29:3640:x1875407735426176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788528341.120470:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528341.120475:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c0030200/0x892c60dda91c76db lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c76d4 expref: 29 pid: 6501 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.120490:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c0030200/0x892c60dda91c76db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c76d4 expref: 29 pid: 6501 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.120500:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528341.120521:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd052447-840d-4bcc-891b-140c465c7625+29:3640:x1875407735426176:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528341.120528:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788528341.120540:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788528341.120546:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd052447-840d-4bcc-891b-140c465c7625+28:3637:x1875407735425920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788528341.120587:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528341.120592:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9101850400/0x892c60dda91c773d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7736 expref: 28 pid: 6500 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.120600:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9101850400/0x892c60dda91c773d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c7736 expref: 28 pid: 6500 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.120610:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528341.120635:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd052447-840d-4bcc-891b-140c465c7625+28:3637:x1875407735425920:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528341.120641:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788528341.120652:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788528341.120658:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735426048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788528341.120666:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528341.120670:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c0031200/0x892c60dda91c76e9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c76e2 expref: 27 pid: 6501 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.120679:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c0031200/0x892c60dda91c76e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c76e2 expref: 27 pid: 6501 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.120694:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528341.120715:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735426048:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528341.120721:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788528341.120771:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735426176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528341.120781:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735425792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528341.120807:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735426048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528341.120830:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735425920:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788528341.120936:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7871 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c786a expref: 26 pid: 6502 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528341.120950:0:10387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875407735425280:0@lo:104: 00010000:00010000:0.0:1788528341.120959:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101850400/0x892c60dda91c773d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c7736 expref: 25 pid: 6500 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528341.120975:0:10387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875407735425408:0@lo:104: 00010000:00010000:0.0:1788528341.120986:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c0031200/0x892c60dda91c76e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c76e2 expref: 24 pid: 6501 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528341.120994:0:10387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875407735425536:0@lo:104: 00010000:00010000:0.0:1788528341.121002:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c0030200/0x892c60dda91c76db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c76d4 expref: 23 pid: 6501 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528341.121011:0:10387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875407735425664:0@lo:104: 00000100:00100000:1.0:1788528341.128747:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528341.128787:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719635200 00000100:00100000:1.0:1788528341.128799:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719635200 00010000:00010000:1.0:1788528341.128859:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9101851000/0x892c60dda91c79a5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb6b expref: 10 pid: 6500 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528341.128901:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:1.0:1788528341.128912:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:2403:x1875407719635200:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788528341.128930:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528341.128942:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9101851000/0x892c60dda91c79a5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb6b expref: 10 pid: 6500 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.128958:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9101851000/0x892c60dda91c79a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb6b expref: 10 pid: 6500 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.128988:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7a93 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.129022:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7a93 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.129043:0:8441:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7a93 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.129052:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7a93 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.129059:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7a93 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.129067:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7a93 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.129074:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e3200 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528341.129080:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7a93 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.129090:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7a93 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.129101:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7a93 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528341.129112:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528341.129175:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:2403:x1875407719635200:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 265us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528341.129183:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 45 00010000:00010000:0.0:1788528341.129393:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101851000/0x892c60dda91c79a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb6b expref: 9 pid: 6500 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528341.129409:0:10387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875407735425152:192.168.203.38@tcp:104: 00010000:00010000:0.0:1788528341.129447:0:10387:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7a93 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528341.129457:0:10387:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7a93 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528341.129463:0:10387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7a93 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528341.129470:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7a93 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528341.130184:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528341.764694:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528341.764819:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719635328 00000100:00100000:0.0:1788528341.764833:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719635328 00000100:00100000:0.0:1788528341.764906:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 269 00000100:00100000:0.0:1788528341.764925:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+9:6172:x1875407719635328:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788528341.764948:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528341.764973:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7a9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfbb1 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528341.765007:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7a9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbb1 expref: 10 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528341.765020:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7a9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbb1 expref: 10 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528341.765031:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e3800, rc 0) 00000100:00100000:0.0:1788528341.765099:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:6172:x1875407719635328:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 177us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528341.765107:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 269 00000100:00100000:1.0:1788528341.778745:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528341.781271:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719635456 00000100:00100000:2.0:1788528341.781312:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719635456 00000100:00100000:2.0:1788528341.781407:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 270 00000100:00100000:2.0:1788528341.781420:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d9d54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:6172:x1875407719635456:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528341.781653:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d9d54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:6172:x1875407719635456:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 236us (2921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528341.781662:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 270 00000100:00100000:1.0:1788528341.795152:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528341.795260:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719635584 00000100:00100000:0.0:1788528341.795273:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719635584 00000100:00100000:0.0:1788528341.795345:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 271 00000100:00100000:0.0:1788528341.795358:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:6172:x1875407719635584:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788528341.795589:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:6172:x1875407719635584:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 Request processed in 232us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528341.795598:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 271 00000100:00100000:1.0:1788528341.802040:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528341.806213:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719635712 00000100:00100000:3.0:1788528341.806231:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719635712 00000100:00100000:3.0:1788528341.806325:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 272 00000100:00100000:3.0:1788528341.806337:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:6714:x1875407719635712:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788528341.806577:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:6714:x1875407719635712:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 217us (4527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528341.806586:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 272 00000100:00100000:1.0:1788528341.817282:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528341.817412:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719635840 00000100:00100000:3.0:1788528341.817425:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719635840 00000100:00100000:3.0:1788528341.817497:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 273 00000100:00100000:3.0:1788528341.817508:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:6714:x1875407719635840:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788528341.817711:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:6714:x1875407719635840:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 203us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528341.817720:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 273 00010000:00010000:1.0:1788528342.143177:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528342.220124:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528342.220173:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528342.220220:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528342.220246:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528342.220271:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528342.220301:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719636352 00000100:00100000:2.0:1788528342.220314:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719636352 00000100:00100000:2.0:1788528342.220385:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719636480 00000100:00100000:2.0:1788528342.220388:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719636480 00000100:00100000:2.0:1788528342.220419:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:2.0:1788528342.220431:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2404:x1875407719636352:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528342.220525:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2404:x1875407719636352:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 95us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528342.220533:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:2.0:1788528342.220581:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:2.0:1788528342.220590:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2404:x1875407719636480:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528342.220618:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2404:x1875407719636480:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 30us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528342.220625:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:2.0:1788528342.220646:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719635968 00000100:00100000:2.0:1788528342.220658:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719635968 00000100:00100000:2.0:1788528342.220686:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 274 00000100:00100000:2.0:1788528342.220692:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:2404:x1875407719635968:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528342.220791:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:2404:x1875407719635968:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 98us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528342.220799:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 274 00000100:00100000:2.0:1788528342.220841:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719636096 00000100:00100000:2.0:1788528342.220846:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719636096 00000100:00100000:2.0:1788528342.220889:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719636224 00000100:00100000:2.0:1788528342.220893:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719636224 00000100:00100000:2.0:1788528342.220921:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:2.0:1788528342.220928:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2404:x1875407719636096:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528342.220960:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2404:x1875407719636096:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 33us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528342.220967:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:2.0:1788528342.220981:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 65 00000100:00100000:2.0:1788528342.220989:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2404:x1875407719636224:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528342.221012:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2404:x1875407719636224:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 25us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528342.221019:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 65 00000100:00080000:2.0:1788528342.221036:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788528342.221041:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788528342.221045:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788528342.221047:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:1.0:1788528342.910677:0:6506:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:1.0:1788528342.910684:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a8fc1fe4800 from 4 10000000:01000000:1.0:1788528342.910690:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788528342.910735:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16600/0x892c60dda91c7aa1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528342.910747:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16600/0x892c60dda91c7aa1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528342.910758:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16600/0x892c60dda91c7aa1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528342.910785:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735426304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788528342.910863:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528342.910934:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695240 going to sleep for 11 seconds 00000100:00100000:2.0:1788528342.910958:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735426304 00000100:00100000:2.0:1788528342.910975:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735426304 00000100:00100000:2.0:1788528342.911058:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788528342.911683:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+23:6506:x1875407735426304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528342.911705:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528342.911727:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9101850000/0x892c60dda91c7aa8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7aa1 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528342.911765:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101850000/0x892c60dda91c7aa8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7aa1 expref: 24 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528342.911779:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9101850000/0x892c60dda91c7aa8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7aa1 expref: 24 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528342.911790:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101850000, rc 0) 00000100:00100000:2.0:1788528342.911894:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735426304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 217us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528342.912003:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735426304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788528342.912026:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16600/0x892c60dda91c7aa1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7aa8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528342.912038:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16600/0x892c60dda91c7aa1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7aa8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788528342.912293:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788528342.912666:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788528342.912894:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788528342.912925:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 112 off8528 00000040:00080000:0.0:1788528342.912943:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 224 off8752 00000040:00080000:0.0:1788528342.912949:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788528342.913029:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735426432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788528342.913090:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528342.913142:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ee7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788528342.919733:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735426432 00000100:00100000:1.0:1788528342.919754:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735426432 00000100:00100000:1.0:1788528342.919832:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788528342.919844:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735426432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788528342.920085:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735426432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (6993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528342.920094:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788528342.920375:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788528342.920446:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735426432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788528342.920514:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735426560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788528342.931615:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528342.931675:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ee7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788528342.931763:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735426560 00000100:00100000:2.0:1788528342.931771:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735426560 00000100:00100000:2.0:1788528342.931851:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788528342.931862:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735426560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788528342.932013:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735426560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528342.932020:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788528342.936194:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735426560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788528342.937793:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788528342.938032:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735426688:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788528342.938121:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528342.938240:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695300 going to sleep for 11 seconds 00000100:00100000:2.0:1788528342.944740:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735426688 00000100:00100000:2.0:1788528342.944755:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735426688 00000100:00100000:2.0:1788528342.945153:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788528342.945167:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735426688:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788528342.945349:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735426688:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 186us (7227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528342.945366:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788528342.945455:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735426688:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788528342.945729:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788528342.945763:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1788528342.945776:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1788528342.945787:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1788528342.945797:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000100:00100000:1.0:1788528342.945844:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735426816:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788528342.946145:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528342.946445:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695300 going to sleep for 11 seconds 00000100:00100000:3.0:1788528342.946517:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735426816 00000100:00100000:3.0:1788528342.946524:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735426816 00000100:00100000:1.0:1788528342.946646:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788528342.946655:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735426816:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788528342.946819:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735426816:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 165us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528342.946826:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788528342.946880:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735426816:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788528342.947088:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1788528342.947101:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:1.0:1788528342.949107:0:10456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528342.949120:0:10456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528342.949122:0:10456:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788528342.949130:0:10456:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a8fc1fe4800 00000020:00000080:1.0:1788528342.949144:0:10456:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788528342.949220:0:10456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528342.949224:0:10456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528342.949225:0:10456:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788528342.949229:0:10456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 7 00000020:01000000:2.0:1788528342.951201:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788528342.951223:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788528342.951235:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16600/0x892c60dda91c7aa1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7aa8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528342.951248:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16600/0x892c60dda91c7aa1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7aa8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528342.951263:0:6506:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:2.0:1788528342.951265:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a90fa76f800 from 4 10000000:01000000:2.0:1788528342.951268:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788528342.951306:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851800/0x892c60dda91c7aaf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528342.951313:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a9101851800/0x892c60dda91c7aaf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528342.951323:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a9101851800/0x892c60dda91c7aaf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528342.951347:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735426944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788528342.951415:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528342.951456:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c96fed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788528342.953471:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735426944 00000100:00100000:1.0:1788528342.953484:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735426944 00000100:00100000:1.0:1788528342.953541:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788528342.953565:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735426944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788528342.953583:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528342.953600:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90f6e16800/0x892c60dda91c7ab6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7aaf expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528342.953629:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90f6e16800/0x892c60dda91c7ab6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7aaf expref: 25 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528342.953640:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90f6e16800/0x892c60dda91c7ab6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7aaf expref: 25 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528342.953650:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e16800, rc 0) 00000100:00100000:1.0:1788528342.953719:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735426944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (2304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528342.953726:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788528342.953795:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735426944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788528342.953823:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a9101851800/0x892c60dda91c7aaf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7ab6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528342.953832:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a9101851800/0x892c60dda91c7aaf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7ab6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788528342.954012:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788528342.954268:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788528342.954450:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788528342.954476:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1788528342.954495:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1788528342.954500:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788528342.954583:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735427072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788528342.954623:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528342.954648:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f5a63900 going to sleep for 11 seconds 00000100:00100000:1.0:1788528342.954938:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735427072 00000100:00100000:1.0:1788528342.954944:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735427072 00000100:00100000:1.0:1788528342.954977:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788528342.954984:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735427072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788528342.955076:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735427072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528342.955083:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788528342.955120:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735427072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788528342.955148:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735427200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788528342.955188:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528342.955202:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f5a63900 going to sleep for 11 seconds 00000100:00100000:1.0:1788528342.955213:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735427200 00000100:00100000:1.0:1788528342.955216:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735427200 00000100:00100000:1.0:1788528342.955236:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788528342.955242:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735427200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788528342.955313:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735427200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528342.955326:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788528342.955382:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735427200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788528342.955712:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788528342.955762:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735427328:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788528342.955796:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528342.955827:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f5a63900 going to sleep for 11 seconds 00000100:00100000:1.0:1788528342.955839:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735427328 00000100:00100000:1.0:1788528342.955843:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735427328 00000100:00100000:1.0:1788528342.955865:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788528342.955872:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735427328:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788528342.955943:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735427328:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 71us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528342.955950:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788528342.955987:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735427328:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788528342.956125:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788528342.956150:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1788528342.956165:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1788528342.956181:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1788528342.956195:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000100:00100000:1.0:1788528342.956215:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735427456:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788528342.956248:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528342.956262:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f5a63900 going to sleep for 11 seconds 00000100:00100000:1.0:1788528342.956274:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735427456 00000100:00100000:1.0:1788528342.956277:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735427456 00000100:00100000:1.0:1788528342.956298:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788528342.956304:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735427456:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788528342.956371:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735427456:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 66us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528342.956377:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788528342.956416:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735427456:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788528342.956449:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1788528342.956457:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:1.0:1788528342.961598:0:10458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528342.961613:0:10458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528342.961616:0:10458:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788528342.961625:0:10458:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a90fa76f800 00000020:00000080:1.0:1788528342.961628:0:10458:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788528342.961693:0:10458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528342.961697:0:10458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528342.961698:0:10458:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788528342.961701:0:10458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 7 count 7 00000020:01000000:1.0:1788528342.961767:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788528342.961788:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788528342.961811:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851800/0x892c60dda91c7aaf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7ab6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528342.961823:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a9101851800/0x892c60dda91c7aaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7ab6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528342.961841:0:6506:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:1.0:1788528342.961843:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a90f5add000 from 4 10000000:01000000:1.0:1788528342.961846:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788528342.961884:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c7abd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528342.962157:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c7abd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528342.962176:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c7abd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528342.962201:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735427584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788528342.962266:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528342.962304:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f5a633c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528342.962325:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735427584 00000100:00100000:1.0:1788528342.962331:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735427584 00000100:00100000:1.0:1788528342.962371:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788528342.962381:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735427584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788528342.962394:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528342.962405:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90f6e17200/0x892c60dda91c7ac4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7abd expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528342.962429:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90f6e17200/0x892c60dda91c7ac4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7abd expref: 26 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528342.962441:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90f6e17200/0x892c60dda91c7ac4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7abd expref: 26 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528342.962449:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e17200, rc 0) 00000100:00100000:1.0:1788528342.962487:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735427584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528342.962494:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788528342.962540:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735427584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788528342.962573:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c7abd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7ac4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528342.962588:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c7abd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7ac4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788528342.965218:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788528342.965505:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788528342.965709:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].1, 224 off8416 00000040:00080000:1.0:1788528342.965735:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].2, 112 off8528 00000040:00080000:1.0:1788528342.965754:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].3, 224 off8752 00000040:00080000:1.0:1788528342.965759:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 3 count 4 00000100:00100000:1.0:1788528342.965847:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735427712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788528342.969038:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528342.969093:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f5a633c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528342.972477:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735427712 00000100:00100000:0.0:1788528342.972492:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735427712 00000100:00100000:0.0:1788528342.972543:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788528342.972570:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735427712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788528342.972734:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735427712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (3701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528342.972742:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788528342.972864:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735427712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788528342.973118:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735427840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788528342.973167:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528342.973202:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f5a633c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528342.973257:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735427840 00000100:00100000:0.0:1788528342.973262:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735427840 00000100:00100000:0.0:1788528342.973294:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788528342.973301:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735427840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788528342.973380:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735427840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528342.973387:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788528342.973464:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735427840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788528342.975147:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788528342.975232:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735427968:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788528342.975295:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528342.975342:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f5a633c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528342.978339:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735427968 00000100:00100000:0.0:1788528342.978357:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735427968 00000100:00100000:0.0:1788528342.978420:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788528342.978429:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735427968:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788528342.978611:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735427968:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 183us (3316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528342.978620:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788528342.978997:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735427968:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788528342.979215:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].1, 224 off8416 00000040:00080000:1.0:1788528342.979250:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].2, 112 off8528 00000040:00080000:1.0:1788528342.979266:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].3, 224 off8752 00000040:00080000:1.0:1788528342.979292:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].4, 224 off8976 00000040:00080000:1.0:1788528342.979306:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].5, 112 off9088 00000100:00100000:1.0:1788528342.979342:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735428096:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788528342.979393:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528342.979437:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f5a633c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528342.979999:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735428096 00000100:00100000:0.0:1788528342.980006:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735428096 00000100:00100000:0.0:1788528342.980045:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788528342.980053:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735428096:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788528342.980148:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735428096:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 96us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528342.980155:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788528342.980418:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735428096:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788528342.980478:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].6, 224 off9312 00000040:00080000:1.0:1788528342.980489:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:3.0:1788528342.984818:0:10461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788528342.984830:0:10461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528342.984833:0:10461:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788528342.984840:0:10461:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a90f5add000 00000020:00000080:3.0:1788528342.984842:0:10461:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788528342.985042:0:10461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788528342.985047:0:10461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528342.985055:0:10461:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788528342.985058:0:10461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 7 count 7 00000020:01000000:1.0:1788528342.985474:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788528342.985488:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788528342.985500:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c7abd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7ac4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528342.985512:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c7abd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7ac4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528342.985522:0:6506:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:1.0:1788528342.985525:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a90c7f88000 from 4 10000000:01000000:1.0:1788528342.985528:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788528342.985610:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c7acb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528342.985619:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c7acb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528342.985630:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c7acb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528342.985652:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735428224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788528342.985711:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528342.985755:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735428224 00000100:00100000:1.0:1788528342.985761:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735428224 00000100:00100000:1.0:1788528342.985823:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788528342.985833:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735428224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788528342.985845:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528342.985857:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90f6e16200/0x892c60dda91c7ad2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7acb expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528342.985880:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90f6e16200/0x892c60dda91c7ad2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7acb expref: 27 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528342.988012:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90f6e16200/0x892c60dda91c7ad2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7acb expref: 27 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528342.988028:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e16200, rc 0) 00000100:00100000:1.0:1788528342.988093:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+27:6506:x1875407735428224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2261us (2380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528342.988101:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788528342.988165:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f5a633c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528342.988189:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735428224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788528342.988209:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c7acb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7ad2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528342.988220:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c7acb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7ad2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528342.988269:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735428352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788528342.988300:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528342.988338:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735428352 00000100:00100000:1.0:1788528342.988344:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735428352 00000100:00100000:1.0:1788528342.988379:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788528342.988386:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:6506:x1875407735428352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788528342.988490:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:6506:x1875407735428352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528342.988497:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788528342.988517:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f5a633c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528342.988528:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735428352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788528342.988571:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735428480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788528342.988609:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528342.988625:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735428480 00000100:00100000:1.0:1788528342.988629:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735428480 00000100:00100000:1.0:1788528342.988648:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788528342.988654:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:6506:x1875407735428480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788528342.988720:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:6506:x1875407735428480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528342.988728:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788528342.988756:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f5a633c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528342.988767:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735428480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788528342.992208:0:10462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:10462:1875407735428608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788528342.992449:0:10462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528342.992497:0:10462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c5ade000 going to sleep for 11 seconds 00000100:00100000:1.0:1788528342.992549:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735428608 00000100:00100000:1.0:1788528342.992583:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735428608 00000100:00100000:1.0:1788528342.992630:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1788528342.992640:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+27:10462:x1875407735428608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788528342.992767:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+27:10462:x1875407735428608:12345-0@lo:502:llog_process_th.0 Request processed in 128us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528342.992783:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788528342.993071:0:10462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:10462:1875407735428608:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788528342.993100:0:10462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788528342.993113:0:10462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528342.993116:0:10462:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788528342.993123:0:10462:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a90c7f88000 00000020:00000080:3.0:1788528342.993126:0:10462:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788528342.993214:0:10462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:10462:1875407735428736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788528342.993254:0:10462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528342.993275:0:10462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c5ade000 going to sleep for 11 seconds 00000100:00100000:1.0:1788528342.994295:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735428736 00000100:00100000:1.0:1788528342.994305:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735428736 00000100:00100000:1.0:1788528342.994350:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788528342.994358:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:10462:x1875407735428736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788528342.994480:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:10462:x1875407735428736:12345-0@lo:502:llog_process_th.0 Request processed in 121us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528342.994488:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788528342.995012:0:10462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:10462:1875407735428736:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788528342.995043:0:10462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788528342.995050:0:10462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528342.995052:0:10462:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788528342.995056:0:10462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788528342.996703:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788528342.996716:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788528342.996728:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c7acb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7ad2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528342.996741:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c7acb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7ad2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528343.167328:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528343.231974:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735429248:0@lo:400:kworker.0 00000100:00100000:2.0:1788528343.232037:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735428864:0@lo:400:kworker.0 00000100:00100000:0.0:1788528343.232078:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528343.232162:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735429248 00000100:00100000:1.0:1788528343.232172:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735429248 00000100:00100000:1.0:1788528343.232234:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788528343.232244:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735429248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528343.232630:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528343.232691:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735429376:0@lo:400:kworker.0 00000100:00100000:2.0:1788528343.232725:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528343.232761:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735429888:0@lo:400:kworker.0 00000100:00100000:2.0:1788528343.232788:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528343.232829:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735430400:0@lo:400:kworker.0 00000100:00100000:2.0:1788528343.232853:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528343.233243:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735429248:12345-0@lo:400:kworker.0 Request processed in 997us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528343.233244:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735428864 00000100:00100000:2.0:1788528343.233254:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735428864 00000100:00100000:1.0:1788528343.233259:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788528343.233311:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788528343.233323:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735428864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528343.233337:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735429888 00000100:00100000:3.0:1788528343.233345:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735429888 00000100:00100000:2.0:1788528343.233398:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735428864:12345-0@lo:400:kworker.0 Request processed in 76us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528343.233400:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735430400 00000100:00100000:3.0:1788528343.233406:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735430400 00000100:00100000:2.0:1788528343.233413:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788528343.233445:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788528343.233462:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735429888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528343.233515:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735429888:12345-0@lo:400:kworker.0 Request processed in 56us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528343.233523:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788528343.233590:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788528343.233599:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735430400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528343.233632:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735430400:12345-0@lo:400:kworker.0 Request processed in 35us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528343.233638:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788528343.233656:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788528343.233661:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788528343.234289:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735429248:0@lo:400:kworker.0 00000100:00100000:0.0:1788528343.234302:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735429760:0@lo:400:kworker.0 00000100:00100000:0.0:1788528343.234360:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528343.234400:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735430272:0@lo:400:kworker.0 00000100:00100000:0.0:1788528343.234425:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528343.234484:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735429760 00000100:00100000:0.0:1788528343.234488:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735428992:0@lo:400:kworker.0 00000100:00100000:1.0:1788528343.234491:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735429760 00000100:00100000:0.0:1788528343.234525:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528343.234547:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735430272 00000100:00100000:0.0:1788528343.234549:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735429504:0@lo:400:kworker.0 00000100:00100000:1.0:1788528343.234579:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735430272 00000100:00100000:1.0:1788528343.234607:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788528343.234617:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735429760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528343.234665:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735429760:12345-0@lo:400:kworker.0 Request processed in 50us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528343.234672:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788528343.234687:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788528343.234694:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735430272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528343.234702:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528343.234737:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735430272:12345-0@lo:400:kworker.0 Request processed in 44us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528343.234738:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1875407735430016:0@lo:400:kworker.0 00000100:00100000:1.0:1788528343.234751:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788528343.234771:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788528343.234775:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788528343.234777:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788528343.234815:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735430528:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788528343.234909:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528343.234938:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788528343.234945:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735429120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788528343.234967:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528343.234987:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735429632:0@lo:400:kworker.0 00000100:00100000:0.0:1788528343.235075:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528343.235092:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1875407735430144:0@lo:400:kworker.0 00000100:00100000:0.0:1788528343.235118:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528343.235136:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735430656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788528343.235160:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528343.235207:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735429376 00000100:00100000:0.0:1788528343.235212:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735429376 00000100:00100000:1.0:1788528343.235214:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735430528 00000100:00100000:1.0:1788528343.235220:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735430528 00000100:00100000:0.0:1788528343.235245:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735428992 00000100:00100000:0.0:1788528343.235250:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735428992 00000100:00100000:1.0:1788528343.235259:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735430656 00000100:00100000:1.0:1788528343.235265:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735430656 00000100:00100000:0.0:1788528343.235280:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735429120 00000100:00100000:0.0:1788528343.235285:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735429120 00000100:00100000:1.0:1788528343.235294:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788528343.235305:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735430528:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788528343.235314:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788528343.235323:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735429376:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1788528343.235335:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528343.235372:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735429376:12345-0@lo:400:kworker.0 Request processed in 49us (2644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528343.235380:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788528343.235393:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735430528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528343.235399:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788528343.235405:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788528343.235410:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1875407735428992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528343.235425:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788528343.235435:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735430656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788528343.235447:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528343.235458:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1875407735428992:12345-0@lo:400:kworker.0 Request processed in 50us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528343.235466:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788528343.235481:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735430656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528343.235484:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788528343.235494:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735429120:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788528343.235500:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00000024:0.0:1788528343.235523:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788528343.235589:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735429120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528343.235595:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788528343.235699:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735429504 00000100:00100000:0.0:1788528343.235703:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735429504 00000100:00100000:0.0:1788528343.235731:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735430016 00000100:00100000:0.0:1788528343.235734:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735430016 00000100:00100000:0.0:1788528343.235745:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735429632 00000100:00100000:0.0:1788528343.235747:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735429632 00000100:00100000:0.0:1788528343.235756:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735430144 00000100:00100000:0.0:1788528343.235758:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735430144 00000100:00100000:0.0:1788528343.235772:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788528343.235777:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735429504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528343.235893:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735429504:12345-0@lo:400:kworker.0 Request processed in 44us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528343.235901:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788528343.235914:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788528343.235921:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875407735430016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528343.235953:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875407735430016:12345-0@lo:400:kworker.0 Request processed in 32us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528343.235959:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788528343.235981:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788528343.235987:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735429632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528343.236093:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735429632:12345-0@lo:400:kworker.0 Request processed in 105us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528343.236101:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788528343.236117:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788528343.236126:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875407735430144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528343.236170:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875407735430144:12345-0@lo:400:kworker.0 Request processed in 44us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528343.236177:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788528343.236259:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735429120:0@lo:41:osp-pre-0-1.0 00010000:00080000:0.0:1788528343.236280:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6fd5c00 x1875407735429632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528343.236293:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735429632:0@lo:400:kworker.0 00010000:00080000:0.0:1788528343.236310:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6fd7800 x1875407735430144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528343.236321:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1875407735430144:0@lo:400:kworker.0 00010000:00080000:0.0:1788528343.236343:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc327ed80 x1875407735430656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528343.236356:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735430656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788528343.236373:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735428992:0@lo:400:kworker.0 00000100:00100000:0.0:1788528343.236401:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735429504:0@lo:400:kworker.0 00000100:00100000:2.0:1788528343.236418:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735428864:0@lo:400:kworker.0 00000100:00100000:0.0:1788528343.236436:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1875407735430016:0@lo:400:kworker.0 00000100:00100000:2.0:1788528343.236452:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735429376:0@lo:400:kworker.0 00010000:00080000:0.0:1788528343.236461:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6da1880 x1875407735430528/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788528343.236478:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6fd7480 x1875407735429888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528343.236480:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735430528:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788528343.236588:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6fd4000 x1875407735429760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528343.236591:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735429888:0@lo:400:kworker.0 00010000:00080000:2.0:1788528343.236628:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6fd5f80 x1875407735430400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528343.236638:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735430400:0@lo:400:kworker.0 00000100:00100000:0.0:1788528343.236694:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735429760:0@lo:400:kworker.0 00010000:00080000:0.0:1788528343.236714:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6fd6680 x1875407735430272/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528343.236722:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735430272:0@lo:400:kworker.0 00000100:00080000:1.0:1788528343.237319:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788528343.237327:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788528344.194513:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528344.254894:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735430912:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788528344.254895:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735430784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788528344.256940:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528344.257074:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528344.258589:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735430912 00000100:00100000:0.0:1788528344.258600:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735430912 00000100:00100000:0.0:1788528344.258750:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735430784 00000100:00100000:0.0:1788528344.258754:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735430784 00000100:00100000:0.0:1788528344.258770:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788528344.258777:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735430912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788528344.258818:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528344.258890:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735430912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (1955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528344.258896:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788528344.258912:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788528344.258917:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735430784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788528344.258927:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528344.258950:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735430784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (1878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528344.258969:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1788528344.259334:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc30ace00 x1875407735430912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528344.259414:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735430912:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1788528344.259449:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6f49c00 x1875407735430784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528344.259459:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735430784:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788528345.214772:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528345.279339:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735431040:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788528345.279438:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528345.281955:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735431040 00000100:00100000:1.0:1788528345.282267:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735431040 00000100:00100000:2.0:1788528345.286575:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788528345.286591:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735431040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788528345.286651:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788528345.286759:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735431040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 171us (7321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528345.286767:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788528345.286995:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735431040:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788528346.246363:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528347.263790:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528347.339637:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528347.339977:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719636736 00000100:00100000:2.0:1788528347.339987:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719636736 00000100:00100000:2.0:1788528347.340062:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 72 00000100:00100000:2.0:1788528347.340072:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2403:x1875407719636736:12345-192.168.203.38@tcp:400:kworker.0 00000100:00080000:3.0:1788528347.340158:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788528347.342551:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2403:x1875407719636736:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 2469us (2914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528347.342836:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 72 00000100:00100000:1.0:1788528347.343957:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528347.344006:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528347.344040:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528347.344064:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528347.344091:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719636864 00000100:00100000:1.0:1788528347.344100:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719636864 00000100:00100000:1.0:1788528347.344151:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 73 00000100:00100000:1.0:1788528347.344161:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719636864:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528347.344231:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719636864:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 71us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528347.344238:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 73 00000100:00100000:1.0:1788528347.344257:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719636992 00000100:00100000:1.0:1788528347.344260:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719636992 00000100:00100000:1.0:1788528347.344283:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719637120 00000100:00100000:1.0:1788528347.344285:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719637120 00000100:00100000:1.0:1788528347.344302:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:1.0:1788528347.344308:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719636992:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528347.344331:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719636992:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 23us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528347.344350:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:1.0:1788528347.344361:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:1.0:1788528347.344366:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719637120:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528347.344385:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719637120:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 19us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528347.344390:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:2.0:1788528347.344485:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719636608 00000100:00100000:2.0:1788528347.344490:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719636608 00000100:00100000:2.0:1788528347.344525:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 295 00000100:00100000:2.0:1788528347.344533:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:2403:x1875407719636608:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528347.345027:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:2403:x1875407719636608:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 494us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528347.345035:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 295 00000100:00080000:0.0:1788528347.346831:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788528347.346839:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788528347.346843:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:3.0:1788528347.503506:0:10687:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788528348.287152:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528348.351087:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735431168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788528348.351303:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528348.351385:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735431680:0@lo:400:kworker.0 00000100:00100000:3.0:1788528348.351423:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528348.351456:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735432192:0@lo:400:kworker.0 00000100:00100000:3.0:1788528348.351490:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528348.351511:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1875407735432704:0@lo:400:kworker.0 00000100:00100000:3.0:1788528348.351577:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528348.351619:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788528348.351626:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735431552:0@lo:400:kworker.0 00000100:00100000:3.0:1788528348.351653:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528348.351674:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735432064:0@lo:400:kworker.0 00000100:00100000:3.0:1788528348.351699:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528348.351720:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735432576:0@lo:400:kworker.0 00000100:00100000:3.0:1788528348.351746:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528348.351807:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735431296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788528348.351839:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528348.351864:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735431808:0@lo:400:kworker.0 00000100:00100000:3.0:1788528348.351905:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528348.352117:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735432320:0@lo:400:kworker.0 00000100:00100000:3.0:1788528348.352162:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528348.352191:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3d7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735432832:0@lo:400:kworker.0 00000100:00100000:3.0:1788528348.352219:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528348.352417:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788528348.352426:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735431424:0@lo:400:kworker.0 00000100:00100000:3.0:1788528348.352465:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528348.352507:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735431936:0@lo:400:kworker.0 00000100:00100000:3.0:1788528348.352539:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528348.352595:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735432448:0@lo:400:kworker.0 00000100:00100000:3.0:1788528348.352621:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528348.352644:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3d7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735432960:0@lo:400:kworker.0 00000100:00100000:3.0:1788528348.352669:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528348.352722:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735431168 00000100:00100000:3.0:1788528348.352732:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735431168 00000100:00100000:3.0:1788528348.353109:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788528348.353171:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735431168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788528348.353215:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788528348.353384:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735431168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 265us (2082us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528348.353393:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788528348.353426:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735431680 00000100:00100000:3.0:1788528348.353430:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735431680 00000100:00100000:3.0:1788528348.353453:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735431296 00000100:00100000:3.0:1788528348.353456:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735431296 00000100:00100000:3.0:1788528348.353470:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735431936 00000100:00100000:3.0:1788528348.353472:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735431936 00000100:00100000:3.0:1788528348.353491:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788528348.353499:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1875407735431680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528348.353594:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1875407735431680:12345-0@lo:400:kworker.0 Request processed in 39us (2113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528348.353601:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788528348.353614:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788528348.353620:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735431296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788528348.353643:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788528348.353677:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735431296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (1838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528348.353689:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788528348.353702:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788528348.353707:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735431936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528348.353732:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735431936:12345-0@lo:400:kworker.0 Request processed in 25us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528348.353738:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788528348.353756:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735432192 00000100:00100000:3.0:1788528348.353760:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735432192 00000100:00100000:3.0:1788528348.354628:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735432704 00000100:00100000:3.0:1788528348.354636:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735432704 00000100:00100000:3.0:1788528348.354666:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735431552 00000100:00100000:3.0:1788528348.354669:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735431552 00000100:00100000:3.0:1788528348.354683:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735432064 00000100:00100000:3.0:1788528348.354686:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735432064 00000100:00100000:3.0:1788528348.354703:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735432576 00000100:00100000:3.0:1788528348.354706:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735432576 00000100:00100000:3.0:1788528348.354721:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735431808 00000100:00100000:3.0:1788528348.354724:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735431808 00000100:00100000:3.0:1788528348.354743:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788528348.354752:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875407735432192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528348.355191:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735433088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788528348.355253:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528348.355303:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735433088 00000100:00100000:2.0:1788528348.355308:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735433088 00000100:00100000:2.0:1788528348.355343:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788528348.355350:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735433088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788528348.355368:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528348.355415:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735433088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528348.355422:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1788528348.355471:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6f4a680 x1875407735433088/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528348.355506:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735433088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788528348.355745:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735431424 00000100:00100000:2.0:1788528348.355751:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735431424 00000100:00100000:2.0:1788528348.355792:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1788528348.355800:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+27:3639:x1875407735431424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528348.355838:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+27:3639:x1875407735431424:12345-0@lo:400:kworker.0 Request processed in 39us (3373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528348.355845:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1788528348.355874:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735432320 00000100:00100000:2.0:1788528348.355878:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735432320 00000100:00100000:2.0:1788528348.355902:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735432832 00000100:00100000:2.0:1788528348.355905:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735432832 00000100:00100000:2.0:1788528348.355916:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735432448 00000100:00100000:2.0:1788528348.355919:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735432448 00000100:00100000:2.0:1788528348.355931:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735432960 00000100:00100000:2.0:1788528348.355939:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735432960 00000100:00100000:2.0:1788528348.355954:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788528348.355960:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735432320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528348.355994:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735432320:12345-0@lo:400:kworker.0 Request processed in 33us (3831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528348.356001:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788528348.356014:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788528348.356021:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735432832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528348.356046:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875407735432192:12345-0@lo:400:kworker.0 Request processed in 1293us (4553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528348.356057:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788528348.356069:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735432832:12345-0@lo:400:kworker.0 Request processed in 47us (3848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528348.356078:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788528348.356082:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788528348.356093:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875407735432704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528348.356098:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788528348.356120:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735432448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528348.356134:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875407735432704:12345-0@lo:400:kworker.0 Request processed in 43us (4582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528348.356142:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788528348.356160:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735432448:12345-0@lo:400:kworker.0 Request processed in 52us (3537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528348.356170:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788528348.356171:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788528348.356183:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735431552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528348.356190:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788528348.356199:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735432960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528348.356224:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735431552:12345-0@lo:400:kworker.0 Request processed in 42us (4568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528348.356232:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788528348.356240:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735432960:12345-0@lo:400:kworker.0 Request processed in 42us (3570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528348.356246:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788528348.359726:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788528348.359739:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788528348.359743:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788528348.359746:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788528348.359846:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735431552:0@lo:400:kworker.0 00000100:00100000:1.0:1788528348.359953:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735431680:0@lo:400:kworker.0 00010000:00080000:1.0:1788528348.359976:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90faa09f80 x1875407735432192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528348.359989:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735432192:0@lo:400:kworker.0 00010000:00080000:1.0:1788528348.360003:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90faa08a80 x1875407735432704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528348.360011:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1875407735432704:0@lo:400:kworker.0 00010000:00080000:1.0:1788528348.360024:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc327f480 x1875407735431168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528348.360047:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735431168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788528348.360141:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788528348.360173:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735432064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528348.361102:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735432064:12345-0@lo:400:kworker.0 Request processed in 940us (9398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528348.362214:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788528348.362240:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735432576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528348.362326:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735432576:12345-0@lo:400:kworker.0 Request processed in 100us (10580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528348.362333:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788528348.362368:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788528348.362373:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735431808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528348.362393:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735431808:12345-0@lo:400:kworker.0 Request processed in 21us (10490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528348.362397:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788528348.363152:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735432064:0@lo:400:kworker.0 00000100:00100000:0.0:1788528348.363171:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735432576:0@lo:400:kworker.0 00000100:00100000:2.0:1788528348.363266:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735431424:0@lo:400:kworker.0 00000100:00100000:2.0:1788528348.363293:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735431936:0@lo:400:kworker.0 00010000:00080000:2.0:1788528348.363311:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90faa0a300 x1875407735432448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528348.363322:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735432448:0@lo:400:kworker.0 00010000:00080000:2.0:1788528348.363335:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3d7f800 x1875407735432960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528348.363344:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3d7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735432960:0@lo:400:kworker.0 00000100:00100000:2.0:1788528348.363365:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735431296:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528348.363378:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735431808:0@lo:400:kworker.0 00010000:00080000:2.0:1788528348.363390:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90faa08e00 x1875407735432320/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528348.363398:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735432320:0@lo:400:kworker.0 00010000:00080000:2.0:1788528348.363409:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3d7e680 x1875407735432832/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528348.363417:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3d7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735432832:0@lo:400:kworker.0 00000100:00100000:3.0:1788528348.364366:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00010000:1.0:1788528349.312112:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528349.375626:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735433344:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788528349.375709:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528349.375854:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735433216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788528349.376145:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528349.376474:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735433344 00000100:00100000:0.0:1788528349.376482:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735433344 00000100:00100000:1.0:1788528349.377711:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735433216 00000100:00100000:1.0:1788528349.377723:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735433216 00000100:00100000:2.0:1788528349.377726:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788528349.377776:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788528349.377785:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735433216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788528349.377822:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528349.377914:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735433216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (1770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528349.377922:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788528349.377968:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6f4a680 x1875407735433216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528349.377988:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735433216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788528349.378264:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735433344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788528349.378280:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788528349.385911:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735433344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 8162us (10191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528349.385927:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1788528349.386646:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3e57b80 x1875407735433344/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528349.386687:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735433344:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788528350.334704:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528350.399070:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735433472:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788528350.399139:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528350.399476:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735433472 00000100:00100000:3.0:1788528350.399484:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735433472 00000100:00100000:3.0:1788528350.399534:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788528350.399543:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735433472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788528350.399609:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788528350.399654:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735433472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528350.399661:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788528350.399801:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735433472:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788528351.358881:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528352.386153:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528352.478280:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528352.478326:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528352.478353:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528352.478370:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528352.478391:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528352.478415:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719637632 00000100:00100000:2.0:1788528352.478424:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719637632 00000100:00100000:2.0:1788528352.478475:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719637760 00000100:00100000:2.0:1788528352.478479:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719637760 00000100:00100000:2.0:1788528352.478501:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:2.0:1788528352.478509:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2402:x1875407719637632:12345-192.168.203.38@tcp:9:kworker.0 00000020:00000080:2.0:1788528352.478541:0:8421:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c79ba 00000100:00080000:2.0:1788528352.478549:0:8421:0:(import.c:65:import_set_state_nolock()) ffff8a90fe6ba800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788528352.478611:0:8421:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788528352.478772:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+2:2402:x1875407719637632:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 262us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528352.478780:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:2.0:1788528352.478796:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:2.0:1788528352.478803:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2402:x1875407719637760:12345-192.168.203.38@tcp:9:kworker.0 00000020:00000080:2.0:1788528352.478817:0:8421:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c79c1 00000100:00080000:2.0:1788528352.478823:0:8421:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d18000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788528352.478846:0:8421:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788528352.478916:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+2:2402:x1875407719637760:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 114us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528352.478923:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:2.0:1788528352.478941:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719637376 00000100:00100000:2.0:1788528352.478953:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719637376 00000100:00100000:2.0:1788528352.478981:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719637504 00000100:00100000:2.0:1788528352.478984:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719637504 00000100:00100000:2.0:1788528352.479007:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 80 00000100:00100000:2.0:1788528352.479014:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2404:x1875407719637376:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528352.479042:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2404:x1875407719637376:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 29us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528352.479049:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 80 00000100:00100000:2.0:1788528352.479061:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 81 00000100:00100000:2.0:1788528352.479067:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719637504:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528352.479090:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719637504:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 23us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528352.479096:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 81 00000100:00080000:2.0:1788528352.479120:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788528352.479124:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788528352.479126:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788528352.479128:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788528352.479190:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528352.479302:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528352.479381:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719637248 00000100:00100000:3.0:1788528352.479386:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719637248 00000100:00100000:3.0:1788528352.479502:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 297 00000100:00100000:3.0:1788528352.479510:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:2403:x1875407719637248:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528352.479546:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:2403:x1875407719637248:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 37us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528352.479573:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 297 00000001:02000400:0.0:1788528352.539148:0:10931:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing yml_node 00010000:00010000:2.0:1788528353.416777:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528353.471751:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735433600:0@lo:400:kworker.0 00000100:00100000:1.0:1788528353.471818:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528353.471990:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735433856:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788528353.472035:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528353.472064:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788528353.472071:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735433984:0@lo:400:kworker.0 00000100:00100000:2.0:1788528353.472096:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528353.472129:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735433856 00000100:00100000:2.0:1788528353.472135:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735433856 00000100:00100000:2.0:1788528353.472212:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788528353.472221:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735433856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788528353.472248:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528353.472290:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735433856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528353.472297:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788528353.472316:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735433984 00000100:00100000:2.0:1788528353.472319:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735433984 00000100:00100000:2.0:1788528353.472343:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788528353.472349:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735433984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528353.472391:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735433984:12345-0@lo:400:kworker.0 Request processed in 42us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528353.472397:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1788528353.472411:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788528353.472443:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735433984:0@lo:400:kworker.0 00010000:00080000:2.0:1788528353.472455:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6f4a680 x1875407735433856/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528353.472470:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735433856:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788528353.472848:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735434112:0@lo:400:kworker.0 00000100:00100000:1.0:1788528353.472883:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528353.472909:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788528353.472916:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735433728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788528353.472938:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528353.473043:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735434112 00000100:00100000:2.0:1788528353.473049:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735434112 00000100:00100000:2.0:1788528353.473087:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788528353.473097:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735434112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528353.473099:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735433600 00000100:00100000:1.0:1788528353.473115:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735433600 00000100:00100000:2.0:1788528353.473142:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735434112:12345-0@lo:400:kworker.0 Request processed in 47us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528353.473149:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788528353.473153:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788528353.473163:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735433600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528353.473195:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735433600:12345-0@lo:400:kworker.0 Request processed in 35us (1377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528353.473202:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788528353.473252:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735434112:0@lo:400:kworker.0 00000100:00100000:1.0:1788528353.473262:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735433600:0@lo:400:kworker.0 00000100:00100000:1.0:1788528353.473272:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788528353.473279:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3d7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735434240:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788528353.473409:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528353.473485:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735434240 00000100:00100000:2.0:1788528353.473496:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735434240 00000100:00100000:2.0:1788528353.473526:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788528353.473532:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735434240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788528353.473572:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788528353.473612:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735434240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528353.473619:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788528353.473648:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3d7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735434240:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788528353.475846:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735433728 00000100:00100000:3.0:1788528353.475859:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735433728 00000100:00100000:3.0:1788528353.475916:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788528353.475925:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735433728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788528353.476175:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788528353.476244:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735433728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 320us (3304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528353.476250:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788528353.476278:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788528353.476574:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3c61880 x1875407735433728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528353.476594:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735433728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788528353.478203:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735434624:0@lo:400:kworker.0 00000100:00100000:0.0:1788528353.478203:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735434496:0@lo:400:kworker.0 00000100:00100000:2.0:1788528353.478274:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528353.478305:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1875407735435136:0@lo:400:kworker.0 00000100:00100000:2.0:1788528353.478326:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528353.478349:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788528353.478355:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735434752:0@lo:400:kworker.0 00000100:00100000:2.0:1788528353.478377:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528353.478393:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1875407735435264:0@lo:400:kworker.0 00000100:00100000:2.0:1788528353.478418:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528353.478448:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735434624 00000100:00100000:2.0:1788528353.478456:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735434624 00000100:00100000:2.0:1788528353.478499:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735435136 00000100:00100000:2.0:1788528353.478503:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735435136 00000100:00100000:2.0:1788528353.478517:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735434752 00000100:00100000:2.0:1788528353.478519:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735434752 00000100:00100000:2.0:1788528353.478529:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735435264 00000100:00100000:2.0:1788528353.478531:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735435264 00000100:00100000:2.0:1788528353.478593:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788528353.478601:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735434624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528353.478653:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735434624:12345-0@lo:400:kworker.0 Request processed in 53us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528353.478660:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788528353.478680:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788528353.478687:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875407735435136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528353.478715:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875407735435136:12345-0@lo:400:kworker.0 Request processed in 30us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528353.478721:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788528353.478746:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788528353.478754:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735434752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528353.478789:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735434752:12345-0@lo:400:kworker.0 Request processed in 37us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528353.478795:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788528353.478811:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788528353.478819:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875407735435264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528353.478850:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875407735435264:12345-0@lo:400:kworker.0 Request processed in 34us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528353.478855:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788528353.480454:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528353.480503:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735435008:0@lo:400:kworker.0 00000100:00100000:0.0:1788528353.480545:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528353.480594:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788528353.480603:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735434368:0@lo:400:kworker.0 00000100:00100000:0.0:1788528353.480631:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528353.480651:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735434880:0@lo:400:kworker.0 00000100:00100000:0.0:1788528353.480673:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528353.480710:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735435008 00000100:00100000:0.0:1788528353.480718:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735435008 00000100:00100000:0.0:1788528353.480774:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735434880 00000100:00100000:0.0:1788528353.480777:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735434880 00000100:00100000:0.0:1788528353.480802:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788528353.480810:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fabb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735435008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528353.480869:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fabb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735435008:12345-0@lo:400:kworker.0 Request processed in 60us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528353.480877:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788528353.481040:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788528353.481048:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735434880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528353.481066:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735434368 00000100:00100000:2.0:1788528353.481072:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735434368 00000100:00100000:0.0:1788528353.481081:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735434880:12345-0@lo:400:kworker.0 Request processed in 33us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528353.481090:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788528353.481106:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788528353.481115:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735434368:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788528353.481143:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3e55880 x1875407735434880/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528353.481158:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735434880:0@lo:400:kworker.0 00000100:00100000:2.0:1788528353.481159:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735434368:12345-0@lo:400:kworker.0 Request processed in 44us (525us total) trans 0 rc 0/0 00010000:00080000:0.0:1788528353.481176:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3e56300 x1875407735435008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528353.481185:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735435008:0@lo:400:kworker.0 00000100:00100000:2.0:1788528353.481195:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788528353.481208:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735434368:0@lo:400:kworker.0 00010000:00080000:2.0:1788528353.481239:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3e54e00 x1875407735434752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528353.481250:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735434752:0@lo:400:kworker.0 00010000:00080000:2.0:1788528353.481263:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3e57b80 x1875407735435264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528353.481270:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1875407735435264:0@lo:400:kworker.0 00000100:00100000:2.0:1788528353.481281:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735434624:0@lo:400:kworker.0 00000100:00100000:2.0:1788528353.481291:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1875407735435136:0@lo:400:kworker.0 00000100:00080000:3.0:1788528353.481835:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788528353.481841:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788528353.481844:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788528353.483163:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735434496 00000100:00100000:0.0:1788528353.483176:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735434496 00000100:00100000:2.0:1788528353.484045:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788528353.484061:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735434496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528353.484158:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735434496:12345-0@lo:400:kworker.0 Request processed in 101us (3708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528353.484165:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788528353.484496:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735434496:0@lo:400:kworker.0 00010000:00010000:3.0:1788528354.430710:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528354.495057:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735435392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788528354.495188:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528354.495832:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735435520:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788528354.495881:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528354.495964:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735435392 00000100:00100000:2.0:1788528354.495977:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735435392 00000100:00100000:2.0:1788528354.496124:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735435520 00000100:00100000:2.0:1788528354.496128:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735435520 00000100:00100000:2.0:1788528354.496148:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788528354.496157:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735435392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788528354.496187:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528354.497067:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735435392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 907us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528354.497092:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788528354.497117:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788528354.497124:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735435520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788528354.497143:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528354.497190:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735435520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528354.497196:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1788528354.497547:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6fd5f80 x1875407735435520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528354.497594:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735435520:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1788528354.499199:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f8e20a80 x1875407735435392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528354.499231:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735435392:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788528355.455415:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528355.519794:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788528355.519826:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735435648:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788528355.519926:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528355.521168:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735435648 00000100:00100000:3.0:1788528355.521182:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735435648 00000100:00100000:3.0:1788528355.521249:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788528355.521260:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735435648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788528355.521312:0:9268:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788528355.521407:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735435648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 149us (1480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528355.521415:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788528355.521578:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735435648:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788528356.479420:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788528356.920787:0:11114:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.4 00010000:00010000:2.0:1788528357.504421:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788528357.569365:0:8416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 80304108-f3b9-46ea-888c-b2a7ec20e3e2 00000020:00000080:3.0:1788528357.569377:0:8416:0:(genops.c:885:class_export_put()) final put ffff8a90fe6bb000/80304108-f3b9-46ea-888c-b2a7ec20e3e2 00000020:00000080:1.0:1788528357.569513:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90fe6bb000/80304108-f3b9-46ea-888c-b2a7ec20e3e2 for lustre-OST0000 00000020:00000080:1.0:1788528357.569597:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90fe6ba800 for lustre-OST0000 00000001:00100000:3.0:1788528357.569755:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 80304108-f3b9-46ea-888c-b2a7ec20e3e2 00000020:00000080:3.0:1788528357.569759:0:9506:0:(genops.c:885:class_export_put()) final put ffff8a8fc3d1f800/80304108-f3b9-46ea-888c-b2a7ec20e3e2 00000020:00000080:0.0:1788528357.569874:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3d1f800/80304108-f3b9-46ea-888c-b2a7ec20e3e2 for lustre-OST0001 00000020:00000080:0.0:1788528357.569913:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc3d18000 for lustre-OST0001 00000100:00100000:2.0:1788528357.576868:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528357.576913:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528357.576949:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528357.576994:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719638144 00000100:00100000:2.0:1788528357.577008:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719638144 00000100:00100000:2.0:1788528357.577089:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719638016 00000100:00100000:2.0:1788528357.577093:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719638016 00000100:00100000:2.0:1788528357.577122:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 88 00000100:00100000:2.0:1788528357.577134:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2406:x1875407719638144:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528357.577233:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2406:x1875407719638144:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 101us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528357.577241:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 88 00000100:00100000:2.0:1788528357.577261:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 89 00000100:00100000:2.0:1788528357.577279:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2406:x1875407719638016:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528357.577308:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2406:x1875407719638016:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 31us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528357.577314:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 89 00000100:00080000:2.0:1788528357.577338:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788528357.577343:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788528357.578049:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719637888 00000100:00100000:0.0:1788528357.578057:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719637888 00000100:00100000:0.0:1788528357.578105:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 299 00000100:00100000:0.0:1788528357.578115:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:2406:x1875407719637888:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528357.578163:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:2406:x1875407719637888:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 51us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528357.578171:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 299 00010000:00010000:2.0:1788528358.528137:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528358.590757:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3d7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735435776:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788528358.590822:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735435904:0@lo:400:kworker.0 00000100:00100000:0.0:1788528358.590884:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735436032:0@lo:400:kworker.0 00000100:00100000:3.0:1788528358.590911:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528358.593940:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528358.594046:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1875407735436544:0@lo:400:kworker.0 00000100:00100000:0.0:1788528358.594115:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528358.594146:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735436928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788528358.594174:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528358.594194:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735437568:0@lo:400:kworker.0 00000100:00100000:0.0:1788528358.594817:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528358.594866:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788528358.594876:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735437440:0@lo:400:kworker.0 00000100:00100000:0.0:1788528358.594902:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528358.595305:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735436032 00000100:00100000:0.0:1788528358.595316:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735436032 00000100:00100000:0.0:1788528358.595372:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735436544 00000100:00100000:0.0:1788528358.595376:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735436544 00000100:00100000:1.0:1788528358.595495:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528358.595534:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875407735436288:0@lo:400:kworker.0 00000100:00100000:1.0:1788528358.595584:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528358.595598:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735436800:0@lo:400:kworker.0 00000100:00100000:1.0:1788528358.595621:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528358.595643:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1875407735437312:0@lo:400:kworker.0 00000100:00100000:1.0:1788528358.595665:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528358.595743:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788528358.595757:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6feca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735436032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528358.595786:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735436416:0@lo:400:kworker.0 00000100:00100000:1.0:1788528358.595971:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788528358.595979:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735436160:0@lo:400:kworker.0 00000100:00100000:0.0:1788528358.598723:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6feca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735436032:12345-0@lo:400:kworker.0 Request processed in 2955us (4778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528358.598740:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788528358.598784:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735436288 00000100:00100000:0.0:1788528358.598794:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735436288 00000100:00100000:0.0:1788528358.598832:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735437312 00000100:00100000:0.0:1788528358.598835:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735437312 00000100:00100000:0.0:1788528358.598859:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788528358.598869:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875407735436544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528358.599836:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875407735436544:12345-0@lo:400:kworker.0 Request processed in 962us (5714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528358.599848:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788528358.599874:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788528358.599883:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875407735436288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528358.599931:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875407735436288:12345-0@lo:400:kworker.0 Request processed in 49us (4345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528358.599937:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788528358.599949:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788528358.599957:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875407735437312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528358.599988:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875407735437312:12345-0@lo:400:kworker.0 Request processed in 33us (4322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528358.599994:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788528358.600031:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735436928 00000100:00100000:0.0:1788528358.600038:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735436928 00000100:00100000:0.0:1788528358.600081:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788528358.600089:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735436928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788528358.600128:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528358.600167:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735436928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (5991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528358.600174:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788528358.600198:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735437568 00000100:00100000:3.0:1788528358.600404:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528358.600450:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735437056:0@lo:400:kworker.0 00000100:00100000:3.0:1788528358.600487:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528358.600534:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735435904 00000100:00100000:3.0:1788528358.600539:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735435904 00000100:00100000:3.0:1788528358.600591:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1788528358.600598:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:3639:x1875407735435904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528358.600635:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:3639:x1875407735435904:12345-0@lo:400:kworker.0 Request processed in 38us (9726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528358.600642:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1788528358.600676:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735435776 00000100:00100000:3.0:1788528358.600680:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735435776 00000100:00100000:3.0:1788528358.600724:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735436416 00000100:00100000:3.0:1788528358.600727:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735436416 00000100:00100000:3.0:1788528358.600753:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788528358.600759:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735435776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788528358.600789:0:9268:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788528358.601199:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735435776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 439us (5704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528358.601367:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788528358.601389:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788528358.601396:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735436416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528358.601434:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735436416:12345-0@lo:400:kworker.0 Request processed in 40us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528358.601440:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788528358.601467:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735437440 00000100:00100000:3.0:1788528358.601473:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735437440 00000100:00100000:3.0:1788528358.601500:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735436800 00000100:00100000:3.0:1788528358.601502:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735436800 00000100:00100000:3.0:1788528358.601514:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735437056 00000100:00100000:3.0:1788528358.601517:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735437056 00000100:00100000:3.0:1788528358.601531:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788528358.601537:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735437440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528358.601596:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735437440:12345-0@lo:400:kworker.0 Request processed in 59us (6693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528358.601604:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788528358.601617:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788528358.601623:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735436800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528358.601646:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735437568 00000100:00100000:3.0:1788528358.601654:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735436800:12345-0@lo:400:kworker.0 Request processed in 31us (6031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528358.601660:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788528358.601687:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788528358.601707:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735437056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528358.601745:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735437056:12345-0@lo:400:kworker.0 Request processed in 50us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528358.601751:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788528358.601759:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788528358.601769:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735437568:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788528358.601791:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788528358.601797:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788528358.601802:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788528358.601805:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788528358.601883:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f58c1c00 x1875407735437440/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528358.601913:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735437440:0@lo:400:kworker.0 00000100:00100000:0.0:1788528358.601931:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735436032:0@lo:400:kworker.0 00000100:00100000:0.0:1788528358.601954:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1875407735436544:0@lo:400:kworker.0 00010000:00080000:0.0:1788528358.601970:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3c60000 x1875407735436928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528358.601989:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735436928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788528358.602004:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735437568:12345-0@lo:400:kworker.0 Request processed in 236us (7189us total) trans 0 rc 0/0 00010000:00080000:0.0:1788528358.602010:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f58c1500 x1875407735437568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528358.602017:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788528358.602042:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735437568:0@lo:400:kworker.0 00000100:00100000:0.0:1788528358.602160:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735435904:0@lo:400:kworker.0 00000100:00100000:0.0:1788528358.602177:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735436416:0@lo:400:kworker.0 00010000:00080000:0.0:1788528358.602190:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc30aca80 x1875407735437056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528358.602199:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735437056:0@lo:400:kworker.0 00000100:00100000:1.0:1788528358.602325:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528358.602369:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735436672:0@lo:400:kworker.0 00000100:00100000:1.0:1788528358.602408:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528358.602436:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735436672 00000100:00100000:1.0:1788528358.602441:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735436672 00000100:00100000:1.0:1788528358.602488:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788528358.602496:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875407735436672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528358.602538:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875407735436672:12345-0@lo:400:kworker.0 Request processed in 43us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528358.602545:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1788528358.602582:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788528358.602601:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6fd6300 x1875407735436672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528358.602611:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735436672:0@lo:400:kworker.0 00000100:00100000:1.0:1788528358.602618:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735437184:0@lo:400:kworker.0 00000100:00100000:1.0:1788528358.602641:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528358.602663:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735437184 00000100:00100000:1.0:1788528358.602666:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735437184 00000100:00100000:1.0:1788528358.602705:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788528358.602712:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735437184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528358.602742:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735437184:12345-0@lo:400:kworker.0 Request processed in 32us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528358.602748:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:1.0:1788528358.602764:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788528358.602804:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735437184:0@lo:400:kworker.0 00000100:00100000:1.0:1788528358.602811:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735437696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788528358.602850:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528358.602974:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875407735436288:0@lo:400:kworker.0 00010000:00080000:0.0:1788528358.602989:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6fd5f80 x1875407735436800/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528358.602999:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735436800:0@lo:400:kworker.0 00010000:00080000:0.0:1788528358.603014:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f5a0dc00 x1875407735437312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528358.603019:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735437696 00000100:00100000:1.0:1788528358.603025:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735437696 00000100:00100000:0.0:1788528358.603029:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1875407735437312:0@lo:400:kworker.0 00000100:00100000:0.0:1788528358.603056:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3d7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735435776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788528358.603064:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788528358.603074:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735437696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788528358.603091:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528358.603135:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735437696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528358.603141:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788528358.603167:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f58c0700 x1875407735437696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528358.603183:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735437696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788528358.604103:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735436160 00000100:00100000:3.0:1788528358.604113:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735436160 00000100:00100000:3.0:1788528358.604155:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788528358.604164:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735436160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528358.604314:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735436160:12345-0@lo:400:kworker.0 Request processed in 152us (1989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528358.604322:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788528358.604474:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735436160:0@lo:400:kworker.0 00000001:02000400:0.0:1788528359.286871:0:11212:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.4 00010000:00010000:3.0:1788528359.550760:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528359.614961:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735437824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788528359.615034:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528359.615311:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735437824 00000100:00100000:0.0:1788528359.615320:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735437824 00000100:00100000:1.0:1788528359.615504:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788528359.615515:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735437824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788528359.615545:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528359.615630:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735437824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528359.615637:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788528359.616006:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6fece00 x1875407735437824/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528359.616024:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735437824:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788528359.616631:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735437952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788528359.616675:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528359.616916:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735437952 00000100:00100000:2.0:1788528359.616922:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735437952 00000100:00100000:2.0:1788528359.617400:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788528359.617411:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735437952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788528359.617430:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528359.617480:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735437952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528359.617487:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1788528359.617598:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f8e20000 x1875407735437952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528359.617614:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735437952:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788528360.576423:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528360.638939:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788528360.638972:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735438080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788528360.639069:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528360.639544:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735438080 00000100:00100000:2.0:1788528360.639598:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735438080 00000100:00100000:2.0:1788528360.639671:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788528360.639696:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735438080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788528360.639741:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788528360.639801:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735438080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528360.639809:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788528360.642420:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735438080:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788528361.598692:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788528361.844767:0:11309:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.4 00010000:00010000:1.0:1788528362.629987:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528362.692971:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528362.693081:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528362.693169:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528362.693221:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719638272 00000100:00100000:3.0:1788528362.693234:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719638272 00000100:00100000:3.0:1788528362.693304:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 301 00000100:00100000:3.0:1788528362.693316:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:2403:x1875407719638272:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528362.693408:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:2403:x1875407719638272:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 94us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528362.693424:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 301 00000100:00100000:1.0:1788528362.695904:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719638400 00000100:00100000:0.0:1788528362.695904:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719638528 00000100:00100000:1.0:1788528362.695925:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719638400 00000100:00100000:0.0:1788528362.695925:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719638528 00000100:00100000:1.0:1788528362.696094:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 96 00000100:00100000:1.0:1788528362.696109:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2403:x1875407719638400:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528362.696209:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 97 00000100:00100000:1.0:1788528362.696219:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2403:x1875407719638400:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 112us (3260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528362.696223:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719638528:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528362.696234:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 96 00000100:00100000:0.0:1788528362.696265:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719638528:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 47us (3095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528362.696273:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 97 00000100:00080000:2.0:1788528362.701680:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788528362.701720:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1788528363.186399:0:11357:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 4 09:26:02 EDT 2026 00010000:00010000:2.0:1788528363.650010:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528363.711646:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3d7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735438208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788528363.711772:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528363.711882:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788528363.711890:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3d7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735438336:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788528363.711921:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528363.712010:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735438336 00000100:00100000:3.0:1788528363.712020:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735438336 00000100:00100000:1.0:1788528363.712020:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735438208 00000100:00100000:1.0:1788528363.712027:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735438208 00000100:00100000:3.0:1788528363.712094:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788528363.712094:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788528363.712109:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735438336:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788528363.712111:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735438208:12345-0@lo:13:osp-pre-1-1.0 00000004:00000024:3.0:1788528363.712153:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00002000:00000024:1.0:1788528363.712154:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788528363.712219:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735438336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528363.712220:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735438208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528363.712235:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788528363.712236:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788528363.712265:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788528363.712282:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735438464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788528363.712313:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528363.712390:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3d7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735438336:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1788528363.712408:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3d7fb80 x1875407735438208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528363.712413:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735438464 00000100:00100000:1.0:1788528363.712420:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735438464 00000100:00100000:3.0:1788528363.712429:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3d7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735438208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788528363.712456:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788528363.712465:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735438464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788528363.712477:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528363.712532:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735438464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528363.712539:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1788528363.712577:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788528363.712736:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875407735438848:0@lo:400:kworker.0 00000100:00100000:3.0:1788528363.712768:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528363.712827:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735438848 00000100:00100000:1.0:1788528363.712832:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735438848 00000100:00100000:1.0:1788528363.712878:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788528363.712886:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875407735438848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528363.712932:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875407735438848:12345-0@lo:400:kworker.0 Request processed in 48us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528363.712939:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788528363.713176:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875407735438848:0@lo:400:kworker.0 00000100:00100000:3.0:1788528363.713195:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735439360:0@lo:400:kworker.0 00000100:00100000:3.0:1788528363.713226:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528363.713254:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788528363.713260:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735438720:0@lo:400:kworker.0 00000100:00100000:3.0:1788528363.713281:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528363.713296:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735439232:0@lo:400:kworker.0 00000100:00100000:3.0:1788528363.713316:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528363.713347:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1875407735439744:0@lo:400:kworker.0 00000100:00100000:3.0:1788528363.713369:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528363.713413:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735438720 00000100:00100000:3.0:1788528363.713417:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735438720 00000100:00100000:3.0:1788528363.713442:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735439232 00000100:00100000:3.0:1788528363.713445:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735439232 00000100:00100000:3.0:1788528363.713463:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735439744 00000100:00100000:3.0:1788528363.713465:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735439744 00000100:00100000:3.0:1788528363.713478:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788528363.713485:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735438720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528363.713523:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735438720:12345-0@lo:400:kworker.0 Request processed in 38us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528363.716074:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788528363.716130:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788528363.716151:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875407735439232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528363.716260:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875407735439232:12345-0@lo:400:kworker.0 Request processed in 121us (2942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528363.716267:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788528363.716279:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788528363.716305:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875407735439744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528363.716338:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875407735439744:12345-0@lo:400:kworker.0 Request processed in 35us (2968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528363.716343:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788528363.716380:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735438592:0@lo:400:kworker.0 00000100:00100000:0.0:1788528363.716415:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735438976:0@lo:400:kworker.0 00000100:00100000:1.0:1788528363.716425:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735439360 00000100:00100000:3.0:1788528363.716438:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528363.716439:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735439360 00000100:00100000:0.0:1788528363.716468:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528363.716494:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1875407735439104:0@lo:400:kworker.0 00000100:00100000:0.0:1788528363.716503:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735439488:0@lo:400:kworker.0 00000100:00100000:1.0:1788528363.716505:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788528363.716519:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735439360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528363.717225:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528363.717240:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528363.717260:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1875407735439616:0@lo:400:kworker.0 00010000:00080000:0.0:1788528363.717295:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3c62d80 x1875407735438464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528363.717325:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735438464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788528363.717361:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528363.717396:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735438720:0@lo:400:kworker.0 00000100:00100000:3.0:1788528363.717400:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735438592 00000100:00100000:3.0:1788528363.717407:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735438592 00010000:00080000:0.0:1788528363.717413:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3c60380 x1875407735439232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528363.717425:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735439232:0@lo:400:kworker.0 00010000:00080000:0.0:1788528363.717441:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90fa8adc00 x1875407735439744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528363.717450:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788528363.717457:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1875407735439744:0@lo:400:kworker.0 00000100:00100000:3.0:1788528363.717464:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+27:3640:x1875407735438592:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788528363.717476:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3c63100 x1875407735439360/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528363.717504:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735439360:0@lo:400:kworker.0 00000100:00100000:3.0:1788528363.717512:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+27:3640:x1875407735438592:12345-0@lo:400:kworker.0 Request processed in 52us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528363.717522:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788528363.717728:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735439104 00000100:00100000:0.0:1788528363.717734:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735439104 00000100:00100000:0.0:1788528363.717766:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735439616 00000100:00100000:0.0:1788528363.717769:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735439616 00000100:00100000:3.0:1788528363.717801:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735438976 00000100:00100000:0.0:1788528363.717883:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788528363.717894:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875407735439104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528363.718009:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875407735439104:12345-0@lo:400:kworker.0 Request processed in 118us (1482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528363.718016:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788528363.718031:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788528363.718038:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875407735439616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528363.718062:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735438976 00000100:00100000:0.0:1788528363.718069:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875407735439616:12345-0@lo:400:kworker.0 Request processed in 31us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528363.718076:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788528363.718102:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788528363.718111:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735438976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528363.718156:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735438976:12345-0@lo:400:kworker.0 Request processed in 47us (1689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528363.718164:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788528363.718186:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735439488 00000100:00100000:0.0:1788528363.718191:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735439488 00000100:00100000:3.0:1788528363.718212:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735438592:0@lo:400:kworker.0 00000100:00100000:0.0:1788528363.718226:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788528363.718235:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735439488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528363.718241:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1875407735439104:0@lo:400:kworker.0 00000100:00100000:3.0:1788528363.718255:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1875407735439616:0@lo:400:kworker.0 00000100:00100000:0.0:1788528363.718274:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735439488:12345-0@lo:400:kworker.0 Request processed in 40us (1731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528363.718281:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1788528363.718303:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788528363.718309:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788528363.718311:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788528363.718350:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735438976:0@lo:400:kworker.0 00010000:00080000:0.0:1788528363.718374:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3c61880 x1875407735439488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528363.718385:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735439488:0@lo:400:kworker.0 00000100:00100000:1.0:1788528363.725512:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735439360:12345-0@lo:400:kworker.0 Request processed in 75us (3362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528363.725531:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:3.0:1788528364.671086:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528364.737988:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735439872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788528364.738057:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528364.738206:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735439872 00000100:00100000:2.0:1788528364.738214:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735439872 00000100:00100000:2.0:1788528364.738258:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788528364.738267:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735439872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788528364.738293:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528364.738340:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735439872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528364.738348:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788528364.738356:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735440000:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788528364.738402:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3eb3100 x1875407735439872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528364.738422:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735439872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788528364.738799:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528364.739401:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735440000 00000100:00100000:3.0:1788528364.739408:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735440000 00000100:00100000:3.0:1788528364.739451:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788528364.739459:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735440000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788528364.739476:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788528364.739530:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735440000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528364.739537:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1788528364.739863:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc30aca80 x1875407735440000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528364.739880:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735440000:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788528365.696938:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528365.759761:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735440128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788528365.759838:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528365.759932:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735440128 00000100:00100000:3.0:1788528365.759940:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735440128 00000100:00100000:3.0:1788528365.759986:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788528365.759994:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735440128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788528365.760025:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788528365.760072:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735440128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528365.760079:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788528365.760121:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735440128:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788528366.724145:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528367.745264:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528367.813011:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528367.813064:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528367.813106:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528367.813147:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719638784 00000100:00100000:0.0:1788528367.813160:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719638784 00000100:00100000:0.0:1788528367.813232:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719638912 00000100:00100000:0.0:1788528367.813236:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719638912 00000100:00100000:0.0:1788528367.813279:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 104 00000100:00100000:0.0:1788528367.813292:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2406:x1875407719638784:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528367.813389:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2406:x1875407719638784:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 99us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528367.813397:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 104 00000100:00100000:0.0:1788528367.813418:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 105 00000100:00100000:0.0:1788528367.813424:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2406:x1875407719638912:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528367.813451:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2406:x1875407719638912:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528367.813471:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 105 00000100:00080000:0.0:1788528367.813489:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788528367.813493:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788528367.813713:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719638656 00000100:00100000:3.0:1788528367.813718:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719638656 00000100:00100000:3.0:1788528367.813811:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 303 00000100:00100000:3.0:1788528367.813819:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c8116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:2406:x1875407719638656:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528367.813854:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c8116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:2406:x1875407719638656:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 37us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528367.813869:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 303 00010000:00010000:2.0:1788528368.766779:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528368.832855:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735440384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788528368.832929:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528368.833024:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735440384 00000100:00100000:2.0:1788528368.833031:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735440384 00000100:00100000:2.0:1788528368.833089:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788528368.833103:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735440384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788528368.833135:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528368.833261:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735440384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 162us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528368.833271:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788528368.833457:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735440256:0@lo:400:kworker.0 00000100:00100000:0.0:1788528368.833499:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528368.833535:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735440768:0@lo:400:kworker.0 00000100:00100000:2.0:1788528368.834029:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735440256 00000100:00100000:2.0:1788528368.834035:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735440256 00000100:00100000:2.0:1788528368.834082:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788528368.834089:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c8116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735440256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528368.836310:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735440896:0@lo:400:kworker.0 00000100:00100000:2.0:1788528368.837026:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c8116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735440256:12345-0@lo:400:kworker.0 Request processed in 2933us (3523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528368.837038:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788528368.837218:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528368.837269:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735441280:0@lo:400:kworker.0 00000100:00100000:0.0:1788528368.837306:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528368.837328:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1875407735441792:0@lo:400:kworker.0 00000100:00100000:0.0:1788528368.837350:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528368.837388:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735440256:0@lo:400:kworker.0 00000100:00080000:0.0:1788528368.837415:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788528368.837435:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735440768 00000100:00100000:0.0:1788528368.837440:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735440768 00000100:00100000:0.0:1788528368.837484:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735441280 00000100:00100000:0.0:1788528368.837486:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735441280 00000100:00100000:0.0:1788528368.837505:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735441792 00000100:00100000:0.0:1788528368.837507:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735441792 00000100:00100000:0.0:1788528368.837524:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788528368.837531:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735440768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528368.837603:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735440768:12345-0@lo:400:kworker.0 Request processed in 72us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528368.837609:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788528368.837635:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788528368.837642:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735441280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528368.837699:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735441280:12345-0@lo:400:kworker.0 Request processed in 59us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528368.837705:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788528368.837717:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788528368.837722:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875407735441792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528368.837746:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875407735441792:12345-0@lo:400:kworker.0 Request processed in 24us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528368.837752:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1788528368.837770:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788528368.837790:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735440768:0@lo:400:kworker.0 00000100:00100000:0.0:1788528368.837799:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735441280:0@lo:400:kworker.0 00000100:00100000:0.0:1788528368.837808:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1875407735441792:0@lo:400:kworker.0 00000100:00100000:3.0:1788528368.840677:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528368.840810:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735441408:0@lo:400:kworker.0 00000100:00100000:3.0:1788528368.840846:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528368.840863:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1875407735441920:0@lo:400:kworker.0 00000100:00100000:3.0:1788528368.840883:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788528368.840918:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90fa8aed80 x1875407735440384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528368.840955:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735440384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788528368.841006:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735440512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788528368.841032:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528368.841364:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735441408 00000100:00100000:0.0:1788528368.841373:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735441408 00000100:00100000:0.0:1788528368.841425:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735441920 00000100:00100000:0.0:1788528368.841429:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735441920 00000100:00100000:0.0:1788528368.841453:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788528368.841461:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875407735441408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528368.841519:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875407735441408:12345-0@lo:400:kworker.0 Request processed in 58us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528368.841526:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788528368.841542:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788528368.841548:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875407735441920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528368.841598:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875407735441920:12345-0@lo:400:kworker.0 Request processed in 50us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528368.841620:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:0.0:1788528368.841766:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788528368.841795:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f58c0700 x1875407735441408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528368.841806:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735441408:0@lo:400:kworker.0 00010000:00080000:0.0:1788528368.841818:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6f0b800 x1875407735441920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528368.841827:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1875407735441920:0@lo:400:kworker.0 00000100:00100000:1.0:1788528368.844701:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735440640:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788528368.846700:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735440896 00000100:00100000:2.0:1788528368.846715:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735440896 00000100:00100000:2.0:1788528368.846783:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735440512 00000100:00100000:2.0:1788528368.846787:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735440512 00000100:00100000:2.0:1788528368.846806:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788528368.847379:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1875407735440896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528368.847518:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788528368.847530:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1875407735440512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788528368.847576:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788528368.848703:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528368.848724:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1875407735440896:12345-0@lo:400:kworker.0 Request processed in 1349us (8050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528368.848735:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1875407735440512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1206us (7700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528368.848736:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788528368.848748:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788528368.848833:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735440896:0@lo:400:kworker.0 00000100:00100000:3.0:1788528368.849083:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735440512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788528368.849094:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735441024:0@lo:400:kworker.0 00000100:00100000:3.0:1788528368.849129:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528368.849155:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735441536:0@lo:400:kworker.0 00000100:00100000:3.0:1788528368.849180:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528368.849199:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735442048:0@lo:400:kworker.0 00000100:00100000:3.0:1788528368.849218:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528368.849268:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735441536 00000100:00100000:3.0:1788528368.849283:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735441536 00000100:00100000:3.0:1788528368.849332:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735442048 00000100:00100000:3.0:1788528368.849336:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735442048 00000100:00100000:3.0:1788528368.849363:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788528368.849370:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735441536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528368.849417:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735441536:12345-0@lo:400:kworker.0 Request processed in 47us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528368.849425:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788528368.849447:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788528368.849454:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735442048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528368.849487:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735442048:12345-0@lo:400:kworker.0 Request processed in 35us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528368.849494:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788528368.849529:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735441024 00000100:00100000:3.0:1788528368.849533:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735441024 00000100:00100000:3.0:1788528368.849595:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788528368.849604:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735441024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528368.849651:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735441024:12345-0@lo:400:kworker.0 Request processed in 49us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528368.849657:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1788528368.849677:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788528368.849681:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788528368.849699:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735441024:0@lo:400:kworker.0 00010000:00080000:3.0:1788528368.849710:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f58c1500 x1875407735441536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528368.849720:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735441536:0@lo:400:kworker.0 00010000:00080000:3.0:1788528368.849740:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3c7e680 x1875407735442048/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528368.849747:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735442048:0@lo:400:kworker.0 00000100:00100000:3.0:1788528368.849812:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735440640 00000100:00100000:3.0:1788528368.849816:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735440640 00000100:00100000:3.0:1788528368.849846:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788528368.850174:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735441152:0@lo:400:kworker.0 00000100:00100000:3.0:1788528368.850200:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735440640:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788528368.850212:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788528368.850219:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528368.850249:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735441664:0@lo:400:kworker.0 00000100:00100000:3.0:1788528368.850264:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735440640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 411us (1564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528368.850271:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788528368.850293:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788528368.850324:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3eb3100 x1875407735440640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528368.850338:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735441152 00000100:00100000:1.0:1788528368.850341:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735440640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788528368.850344:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735441152 00000100:00100000:0.0:1788528368.850381:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788528368.850388:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735441152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528368.850424:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735441152:12345-0@lo:400:kworker.0 Request processed in 37us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528368.850430:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788528368.850477:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735441664 00000100:00100000:3.0:1788528368.850481:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735441664 00000100:00100000:3.0:1788528368.850582:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788528368.850590:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735441664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528368.850636:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735441664:12345-0@lo:400:kworker.0 Request processed in 47us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528368.850642:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1788528368.850703:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788528368.851721:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735441152:0@lo:400:kworker.0 00010000:00080000:1.0:1788528368.851739:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f58c1c00 x1875407735441664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528368.851749:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735441664:0@lo:400:kworker.0 00010000:00010000:3.0:1788528369.794154:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528369.854824:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735442176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788528369.854893:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528369.855126:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735442176 00000100:00100000:0.0:1788528369.855148:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735442176 00000100:00100000:0.0:1788528369.855215:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788528369.855224:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735442176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788528369.855254:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528369.855311:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735442176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528369.855319:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1788528369.855457:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3c7e680 x1875407735442176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528369.855476:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735442176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788528369.856164:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788528369.856189:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735442304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788528369.856234:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528369.856386:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735442304 00000100:00100000:3.0:1788528369.856393:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735442304 00000100:00100000:3.0:1788528369.856439:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788528369.856447:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735442304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788528369.856474:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788528369.856520:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735442304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528369.856527:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1788528369.856583:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90fa8ad500 x1875407735442304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528369.856600:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735442304:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788528370.815203:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528370.878937:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735442432:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788528370.879016:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528370.879099:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735442432 00000100:00100000:3.0:1788528370.879109:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735442432 00000100:00100000:3.0:1788528370.879169:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788528370.879179:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735442432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788528370.879212:0:9268:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788528370.879274:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735442432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528370.879280:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788528370.879420:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735442432:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788528371.838706:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528372.863957:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528372.933502:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528372.933731:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719639168 00000100:00100000:1.0:1788528372.933741:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719639168 00000100:00100000:1.0:1788528372.933809:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 112 00000100:00100000:1.0:1788528372.933819:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2405:x1875407719639168:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528372.933889:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2405:x1875407719639168:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 72us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528372.933912:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 112 00000100:00080000:3.0:1788528372.934139:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788528372.934321:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528372.934496:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719639040 00000100:00100000:3.0:1788528372.934502:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719639040 00000100:00100000:3.0:1788528372.934538:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 305 00000100:00100000:3.0:1788528372.934545:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c8116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:2405:x1875407719639040:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528372.934695:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c8116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:2405:x1875407719639040:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 149us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528372.934702:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 305 00000100:00100000:0.0:1788528372.937028:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528372.937163:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719639296 00000100:00100000:0.0:1788528372.937172:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719639296 00000100:00100000:0.0:1788528372.937226:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 113 00000100:00100000:0.0:1788528372.937234:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2405:x1875407719639296:12345-192.168.203.38@tcp:400:kworker.0 00000100:00080000:3.0:1788528372.943343:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788528372.944302:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2405:x1875407719639296:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 7059us (7274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528372.944317:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 113 00010000:00010000:1.0:1788528373.888161:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528373.950852:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735442560:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788528373.950990:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528373.953239:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735442560 00000100:00100000:1.0:1788528373.953253:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735442560 00000100:00100000:1.0:1788528373.953328:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788528373.953341:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735442560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788528373.953390:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788528373.953490:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735442560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 151us (2499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528373.953498:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788528373.953537:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735442688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788528373.953627:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528373.953687:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735442688 00000100:00100000:1.0:1788528373.953692:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735442688 00000100:00100000:1.0:1788528373.953735:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788528373.953743:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735442688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788528373.953765:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528373.953802:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735442688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528373.953809:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1788528373.953827:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788528373.953864:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90faa0b800 x1875407735442688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528373.953884:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735442688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788528373.953923:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735442560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528373.954067:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735442816:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788528373.954101:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528373.955200:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735442816 00000100:00100000:1.0:1788528373.955208:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735442816 00000100:00100000:1.0:1788528373.955278:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788528373.955288:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735442816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788528373.955313:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528373.955738:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735442816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 450us (1634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528373.955747:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1788528373.955799:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3eb1880 x1875407735442816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528373.955822:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735442816:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788528373.956441:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788528373.958427:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735443328:0@lo:400:kworker.0 00000100:00100000:1.0:1788528373.958524:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528373.958817:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735442944:0@lo:400:kworker.0 00000100:00100000:0.0:1788528373.958874:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528373.958927:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735443456:0@lo:400:kworker.0 00000100:00100000:0.0:1788528373.959243:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528373.959273:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735443968:0@lo:400:kworker.0 00000100:00100000:3.0:1788528373.959287:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735442944 00000100:00100000:3.0:1788528373.959298:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735442944 00000100:00100000:0.0:1788528373.959303:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528373.959348:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735443456 00000100:00100000:0.0:1788528373.959352:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735443456 00000100:00100000:3.0:1788528373.959363:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788528373.959377:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:3638:x1875407735442944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528373.959411:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735443968 00000100:00100000:0.0:1788528373.959416:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735443968 00000100:00100000:0.0:1788528373.959444:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788528373.959453:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735443456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528373.959457:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:3638:x1875407735442944:12345-0@lo:400:kworker.0 Request processed in 82us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528373.959467:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788528373.959500:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735443456:12345-0@lo:400:kworker.0 Request processed in 48us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528373.959508:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788528373.959526:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788528373.959533:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735443968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528373.959598:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735443968:12345-0@lo:400:kworker.0 Request processed in 55us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528373.959605:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1788528373.959634:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788528373.959668:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735442944:0@lo:400:kworker.0 00000100:00100000:0.0:1788528373.959684:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735443456:0@lo:400:kworker.0 00000100:00100000:0.0:1788528373.959695:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735443968:0@lo:400:kworker.0 00000100:00100000:1.0:1788528373.959880:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735443840:0@lo:400:kworker.0 00000100:00100000:1.0:1788528373.959913:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528373.960681:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735443840 00000100:00100000:0.0:1788528373.960690:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735443840 00000100:00100000:0.0:1788528373.960747:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788528373.960758:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735443840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528373.960819:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735443840:12345-0@lo:400:kworker.0 Request processed in 65us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528373.960827:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1788528373.960853:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788528373.960932:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3eb2d80 x1875407735443840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528373.960960:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735443840:0@lo:400:kworker.0 00000100:00100000:1.0:1788528373.961003:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735443200:0@lo:400:kworker.0 00000100:00100000:1.0:1788528373.961038:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528373.961067:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735443712:0@lo:400:kworker.0 00000100:00100000:1.0:1788528373.961090:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528373.961109:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788528373.961116:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735443072:0@lo:400:kworker.0 00000100:00100000:1.0:1788528373.961150:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528373.961165:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1875407735443584:0@lo:400:kworker.0 00000100:00100000:1.0:1788528373.961185:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528373.961199:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735444096:0@lo:400:kworker.0 00000100:00100000:1.0:1788528373.961219:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528373.961247:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735443712 00000100:00100000:1.0:1788528373.961252:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735443712 00000100:00100000:1.0:1788528373.961288:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788528373.961296:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735443712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528373.961336:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735443712:12345-0@lo:400:kworker.0 Request processed in 41us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528373.961343:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788528373.961362:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735443200 00000100:00100000:1.0:1788528373.961366:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735443200 00000100:00100000:1.0:1788528373.961385:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735443072 00000100:00100000:1.0:1788528373.961388:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735443072 00000100:00100000:1.0:1788528373.961402:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735443584 00000100:00100000:1.0:1788528373.961405:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735443584 00000100:00100000:1.0:1788528373.961418:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735444096 00000100:00100000:1.0:1788528373.961420:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735444096 00000100:00100000:1.0:1788528373.961433:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788528373.961440:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735443200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528373.961475:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735443200:12345-0@lo:400:kworker.0 Request processed in 35us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528373.961482:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788528373.961495:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788528373.961501:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735443072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528373.961540:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735443072:12345-0@lo:400:kworker.0 Request processed in 40us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528373.961546:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788528373.962694:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788528373.962709:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875407735443584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528373.962787:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875407735443584:12345-0@lo:400:kworker.0 Request processed in 82us (1600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528373.962795:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788528373.962810:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788528373.962818:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735444096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528373.962850:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735444096:12345-0@lo:400:kworker.0 Request processed in 34us (1630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528373.962856:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788528373.962914:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735443072:0@lo:400:kworker.0 00010000:00080000:1.0:1788528373.962932:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3eb1f80 x1875407735443584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788528373.963073:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788528373.963082:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788528373.964084:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735443328 00000100:00100000:2.0:1788528373.964101:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735443328 00000100:00100000:3.0:1788528373.964201:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788528373.964211:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735443328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528373.964315:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735443328:12345-0@lo:400:kworker.0 Request processed in 105us (5791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528373.964322:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788528373.964709:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1875407735443584:0@lo:400:kworker.0 00010000:00080000:1.0:1788528373.964742:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3eb2680 x1875407735444096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528373.964752:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735444096:0@lo:400:kworker.0 00000100:00100000:1.0:1788528373.964767:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735443200:0@lo:400:kworker.0 00010000:00080000:1.0:1788528373.964781:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3eb2a00 x1875407735443712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528373.964807:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735443712:0@lo:400:kworker.0 00000100:00100000:1.0:1788528373.965045:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735443328:0@lo:400:kworker.0 00010000:00010000:2.0:1788528374.916589:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528374.975941:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735444224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788528374.976015:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528374.976130:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735444224 00000100:00100000:1.0:1788528374.976140:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735444224 00000100:00100000:1.0:1788528374.976198:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788528374.976208:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735444224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788528374.976236:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528374.976285:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735444224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528374.976293:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788528374.976425:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788528374.976438:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735444352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788528374.976469:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788528374.976527:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90faa09f80 x1875407735444224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528374.976547:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735444224:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788528374.976725:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735444352 00000100:00100000:2.0:1788528374.976731:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735444352 00000100:00100000:2.0:1788528374.976769:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788528374.976776:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735444352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788528374.976788:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528374.976821:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735444352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528374.976827:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1788528374.976873:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3eb3800 x1875407735444352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528374.976886:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735444352:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788528375.942601:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528375.998995:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788528376.005272:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735444480:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788528376.005350:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528376.005744:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735444480 00000100:00100000:3.0:1788528376.005754:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735444480 00000100:00100000:3.0:1788528376.005809:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788528376.005820:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735444480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788528376.005854:0:9268:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788528376.005915:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735444480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528376.005922:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788528376.006013:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735444480:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788528376.967888:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788528377.167958:0:11986:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 09:26:16 (1788528376) === 00000100:00100000:1.0:1788528377.756516:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528377.756729:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719639424 00000100:00100000:3.0:1788528377.756739:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719639424 00000100:00100000:3.0:1788528377.756823:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 307 00000100:00100000:3.0:1788528377.756833:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:8727:x1875407719639424:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788528377.756850:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528377.756880:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc3428a00/0x892c60dda91c7ad9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfbb8 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528377.756908:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc3428a00/0x892c60dda91c7ad9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbb8 expref: 11 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528377.756921:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc3428a00/0x892c60dda91c7ad9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbb8 expref: 11 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528377.756931:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3428a00, rc 0) 00000100:00100000:3.0:1788528377.756988:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+11:8727:x1875407719639424:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 157us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528377.756995:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 307 00000100:00100000:1.0:1788528377.766964:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528377.767258:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719639552 00000100:00100000:3.0:1788528377.767268:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719639552 00000100:00100000:3.0:1788528377.767388:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 308 00000100:00100000:3.0:1788528377.767400:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+11:8727:x1875407719639552:12345-192.168.203.38@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788528377.767524:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+11:8727:x1875407719639552:12345-192.168.203.38@tcp:501:mount.lustre.0 Request processed in 126us (569us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788528377.767532:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 308 00000100:00100000:1.0:1788528377.776245:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528377.776615:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719639680 00000100:00100000:3.0:1788528377.776630:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719639680 00000100:00100000:3.0:1788528377.776708:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 309 00000100:00100000:3.0:1788528377.776730:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+11:8727:x1875407719639680:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788528377.776751:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528377.776774:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc3429600/0x892c60dda91c7ae0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfbbf expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528377.776833:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc3429600/0x892c60dda91c7ae0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbbf expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528377.776846:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc3429600/0x892c60dda91c7ae0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbbf expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528377.776856:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3429600, rc 0) 00000100:00100000:3.0:1788528377.777153:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+12:8727:x1875407719639680:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 433us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528377.777161:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 309 00000100:00100000:1.0:1788528377.786007:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528377.786390:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719639808 00000100:00100000:3.0:1788528377.786404:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719639808 00000100:00100000:3.0:1788528377.786520:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 310 00000100:00100000:3.0:1788528377.786533:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+12:8727:x1875407719639808:12345-192.168.203.38@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788528377.786781:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+12:8727:x1875407719639808:12345-192.168.203.38@tcp:501:mount.lustre.0 Request processed in 250us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528377.786790:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 310 00000100:00100000:1.0:1788528377.790195:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528377.790334:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719639936 00000100:00100000:3.0:1788528377.790349:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719639936 00000100:00100000:3.0:1788528377.790603:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 311 00000100:00100000:3.0:1788528377.790617:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+12:8727:x1875407719639936:12345-192.168.203.38@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788528377.791192:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+12:8727:x1875407719639936:12345-192.168.203.38@tcp:503:mount.lustre.0 Request processed in 576us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528377.791203:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 311 00000100:00100000:1.0:1788528377.794344:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528377.794587:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719640064 00000100:00100000:3.0:1788528377.794614:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719640064 00000100:00100000:3.0:1788528377.794682:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 312 00000100:00100000:3.0:1788528377.794694:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+12:8731:x1875407719640064:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788528377.794877:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+12:8731:x1875407719640064:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 184us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528377.794886:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 312 00000100:00100000:3.0:1788528377.820961:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528377.821102:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719640192 00000100:00100000:2.0:1788528377.821114:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719640192 00000100:00100000:2.0:1788528377.821184:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 313 00000100:00100000:2.0:1788528377.821197:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+12:8731:x1875407719640192:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788528377.821422:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+12:8731:x1875407719640192:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 226us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528377.823117:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 313 00000100:00100000:1.0:1788528377.826777:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528377.827298:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719640320 00000100:00100000:0.0:1788528377.827312:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719640320 00000100:00100000:0.0:1788528377.827393:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 314 00000100:00100000:0.0:1788528377.827405:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+12:8731:x1875407719640320:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788528377.827674:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+12:8731:x1875407719640320:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 269us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528377.827682:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 314 00000100:00100000:1.0:1788528377.831749:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528377.831850:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719640448 00000100:00100000:3.0:1788528377.831863:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719640448 00000100:00100000:3.0:1788528377.831929:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 315 00000100:00100000:3.0:1788528377.831940:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+12:8727:x1875407719640448:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788528377.831961:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528377.831983:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc3428800/0x892c60dda91c7ae7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfbf0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528377.832021:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc3428800/0x892c60dda91c7ae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbf0 expref: 13 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528377.832037:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc3428800/0x892c60dda91c7ae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbf0 expref: 13 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528377.832047:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3428800, rc 0) 00000100:00100000:3.0:1788528377.832121:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+13:8727:x1875407719640448:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 182us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528377.832129:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 315 00000100:00100000:3.0:1788528377.835831:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528377.837326:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719640576 00000100:00100000:2.0:1788528377.837344:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719640576 00000100:00100000:2.0:1788528377.837577:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 316 00000100:00100000:2.0:1788528377.837591:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+13:8727:x1875407719640576:12345-192.168.203.38@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788528377.837627:0:6500:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788528377.837660:0:6500:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788528377.837666:0:6500:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788528377.837669:0:6500:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788528377.837672:0:6500:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788528377.837674:0:6500:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1788528377.842649:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+13:8727:x1875407719640576:12345-192.168.203.38@tcp:256:mount.lustre.0 Request processed in 5045us (6815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528377.842668:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 316 00000100:00100000:1.0:1788528377.846250:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528377.846829:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719640704 00000100:00100000:0.0:1788528377.846843:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719640704 00000100:00100000:0.0:1788528377.846951:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 317 00000100:00100000:0.0:1788528377.846964:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+13:8727:x1875407719640704:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788528377.846986:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528377.847012:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc26e3600/0x892c60dda91c7aee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfbf7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528377.847065:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc26e3600/0x892c60dda91c7aee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbf7 expref: 14 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528377.847078:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc26e3600/0x892c60dda91c7aee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbf7 expref: 14 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528377.847089:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e3600, rc 0) 00000100:00100000:0.0:1788528377.847199:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:8727:x1875407719640704:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 238us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528377.847207:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 317 00000100:00100000:3.0:1788528377.849788:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528377.849962:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719640832 00000100:00100000:2.0:1788528377.849975:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719640832 00000100:00100000:2.0:1788528377.850038:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 318 00000100:00100000:2.0:1788528377.850048:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:8727:x1875407719640832:12345-192.168.203.38@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788528377.850246:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:8727:x1875407719640832:12345-192.168.203.38@tcp:501:mount.lustre.0 Request processed in 198us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528377.850262:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 318 00000100:00100000:1.0:1788528377.852849:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528377.853013:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719640960 00000100:00100000:0.0:1788528377.853024:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719640960 00000100:00100000:0.0:1788528377.853094:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 319 00000100:00100000:0.0:1788528377.853105:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:8727:x1875407719640960:12345-192.168.203.38@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788528377.853332:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:8727:x1875407719640960:12345-192.168.203.38@tcp:503:mount.lustre.0 Request processed in 227us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528377.853341:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 319 00000100:00100000:1.0:1788528377.856795:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528377.856998:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719641088 00000100:00100000:3.0:1788528377.857013:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719641088 00000100:00100000:3.0:1788528377.857128:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 320 00000100:00100000:3.0:1788528377.857139:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:8737:x1875407719641088:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788528377.857346:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:8737:x1875407719641088:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 208us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528377.857363:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 320 00000100:00100000:3.0:1788528377.860505:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528377.862671:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719641216 00000100:00100000:2.0:1788528377.862831:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719641216 00000100:00100000:2.0:1788528377.862978:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 321 00000100:00100000:2.0:1788528377.862990:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:8737:x1875407719641216:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788528377.863211:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:8737:x1875407719641216:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 222us (2719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528377.863221:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 321 00000100:00100000:3.0:1788528377.867126:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528377.867153:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528377.867170:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528377.867186:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528377.867410:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719641984 00000100:00100000:0.0:1788528377.867424:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719641984 00000100:00080000:1.0:1788528377.867469:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788528377.867655:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719642112 00000100:00100000:0.0:1788528377.867660:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719642112 00000100:00100000:0.0:1788528377.867694:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719641344 00000100:00100000:0.0:1788528377.867699:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719641344 00000100:00100000:0.0:1788528377.867710:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719641600 00000100:00100000:0.0:1788528377.867713:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719641600 00000100:00100000:0.0:1788528377.867727:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 120 00000100:00100000:0.0:1788528377.867739:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2405:x1875407719641984:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528377.867867:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2405:x1875407719641984:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 129us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528377.867875:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 120 00000100:00100000:0.0:1788528377.867895:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 121 00000100:00100000:0.0:1788528377.867904:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2405:x1875407719642112:12345-192.168.203.38@tcp:400:kworker.0 00000100:00080000:1.0:1788528377.867910:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788528377.867935:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2405:x1875407719642112:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 33us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528377.867941:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 121 00000100:00100000:0.0:1788528377.867954:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:0.0:1788528377.867958:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2402:x1875407719641344:12345-192.168.203.38@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788528377.867987:0:6510:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from 287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689@192.168.203.38@tcp t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:0.0:1788528377.868029:0:6510:0:(genops.c:1385:class_connect()) connect: client 287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689, cookie 0x892c60dda91c7af5 00000004:00100000:0.0:1788528377.868060:0:6510:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788528377.868205:0:6510:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d29800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788528377.868238:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:2402:x1875407719641344:12345-192.168.203.38@tcp:38:mount.lustre.0 Request processed in 278us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528377.868246:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:0.0:1788528377.868260:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:0.0:1788528377.868264:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2402:x1875407719641600:12345-192.168.203.38@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788528377.868279:0:6510:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from 287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689@192.168.203.38@tcp t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:0.0:1788528377.868306:0:6510:0:(genops.c:1385:class_connect()) connect: client 287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689, cookie 0x892c60dda91c7afc 00000004:00100000:0.0:1788528377.868321:0:6510:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788528377.868386:0:6510:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d2e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788528377.868424:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:2402:x1875407719641600:12345-192.168.203.38@tcp:38:mount.lustre.0 Request processed in 157us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528377.868431:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:3.0:1788528377.874642:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528377.875003:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719641856 00000100:00100000:0.0:1788528377.875017:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719641856 00000100:00100000:0.0:1788528377.875119:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:0.0:1788528377.875131:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:8727:x1875407719641856:12345-192.168.203.38@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788528377.875181:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788528377.875286:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:8727:x1875407719641856:12345-192.168.203.38@tcp:41:mount.lustre.0 Request processed in 157us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528377.875295:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00080000:1.0:1788528377.875385:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788528377.883357:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528377.883653:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528377.883836:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719641728 00000100:00100000:0.0:1788528377.883850:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719641728 00000100:00100000:0.0:1788528377.883935:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719641472 00000100:00100000:0.0:1788528377.883939:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719641472 00000100:00100000:0.0:1788528377.883963:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:0.0:1788528377.883974:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:0:x1875407719641728:12345-192.168.203.38@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788528377.884024:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:0.0:1788528377.884132:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:0:x1875407719641728:12345-192.168.203.38@tcp:41:mount.lustre.0 Request processed in 159us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528377.884141:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:0.0:1788528377.884161:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:0.0:1788528377.884169:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:0:x1875407719641472:12345-192.168.203.38@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788528377.884182:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788528377.884210:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:0:x1875407719641472:12345-192.168.203.38@tcp:41:mount.lustre.0 Request processed in 42us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528377.884237:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00080000:2.0:1788528377.884599:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788528377.885416:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528377.885594:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719642240 00000100:00100000:1.0:1788528377.885607:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719642240 00000100:00100000:1.0:1788528377.885669:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:1.0:1788528377.885678:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:8727:x1875407719642240:12345-192.168.203.38@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788528377.885766:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:8727:x1875407719642240:12345-192.168.203.38@tcp:40:mount.lustre.0 Request processed in 90us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528377.885774:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:1.0:1788528377.888544:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528377.889889:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528377.890051:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528377.890215:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719642624 00000100:00100000:2.0:1788528377.890228:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719642624 00000100:00100000:2.0:1788528377.890308:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:2.0:1788528377.890319:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:8727:x1875407719642624:12345-192.168.203.38@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788528377.890622:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:8727:x1875407719642624:12345-192.168.203.38@tcp:900:mount.lustre.0 Request processed in 304us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528377.890631:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:3.0:1788528377.891592:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719642368 00000100:00100000:3.0:1788528377.891603:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719642368 00000100:00100000:3.0:1788528377.891635:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719642496 00000100:00100000:3.0:1788528377.891638:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719642496 00000100:00100000:3.0:1788528377.891667:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:3.0:1788528377.891674:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2402:x1875407719642368:12345-192.168.203.38@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788528377.891793:0:8421:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from 287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689@192.168.203.38@tcp t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:3.0:1788528377.891831:0:8421:0:(genops.c:1385:class_connect()) connect: client 287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689, cookie 0x892c60dda91c7b03 00002000:00100000:3.0:1788528377.891848:0:8421:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689/ffff8a8fc3d0d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788528377.891871:0:8421:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788528377.891985:0:8421:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788528377.892022:0:8421:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d0e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788528377.892149:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:2402:x1875407719642368:12345-192.168.203.38@tcp:8:mount.lustre.0 Request processed in 473us (3622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528377.892157:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:3.0:1788528377.892176:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:3.0:1788528377.892180:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2402:x1875407719642496:12345-192.168.203.38@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788528377.892198:0:8421:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from 287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689@192.168.203.38@tcp t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:3.0:1788528377.892216:0:8421:0:(genops.c:1385:class_connect()) connect: client 287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689, cookie 0x892c60dda91c7b0a 00002000:00100000:3.0:1788528377.892223:0:8421:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689/ffff8a8fc3d0d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788528377.892237:0:8421:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788528377.892275:0:8421:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788528377.892291:0:8421:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d0b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788528377.892315:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:2402:x1875407719642496:12345-192.168.203.38@tcp:8:mount.lustre.0 Request processed in 133us (2433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528377.892321:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:1.0:1788528377.894493:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528377.894645:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719642752 00000100:00100000:0.0:1788528377.894657:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719642752 00000100:00100000:0.0:1788528377.894845:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:0.0:1788528377.894857:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:8727:x1875407719642752:12345-192.168.203.38@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788528377.894960:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788528377.895047:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:8727:x1875407719642752:12345-192.168.203.38@tcp:33:mount.lustre.0 Request processed in 192us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528377.895054:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1 00010000:00010000:1.0:1788528377.983072:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528379.006747:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528379.071702:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735444608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788528379.071757:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735444736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788528379.071852:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528379.072046:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528379.074250:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735445248:0@lo:400:kworker.0 00000100:00100000:0.0:1788528379.074339:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528379.074398:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735445760:0@lo:400:kworker.0 00000100:00100000:0.0:1788528379.074429:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528379.074450:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735446272:0@lo:400:kworker.0 00000100:00100000:0.0:1788528379.074473:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528379.074501:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788528379.074507:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735445120:0@lo:400:kworker.0 00000100:00100000:0.0:1788528379.074533:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528379.074591:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1875407735445632:0@lo:400:kworker.0 00000100:00100000:0.0:1788528379.074611:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528379.074626:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735446144:0@lo:400:kworker.0 00000100:00100000:0.0:1788528379.074642:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528379.074680:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735444864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788528379.074707:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528379.074727:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735445376:0@lo:400:kworker.0 00000100:00100000:0.0:1788528379.074750:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528379.074768:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735445888:0@lo:400:kworker.0 00000100:00100000:0.0:1788528379.074800:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528379.074822:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788528379.074827:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735444992:0@lo:400:kworker.0 00000100:00100000:0.0:1788528379.074857:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528379.074876:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735445504:0@lo:400:kworker.0 00000100:00100000:0.0:1788528379.074900:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528379.074911:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1875407735446016:0@lo:400:kworker.0 00000100:00100000:0.0:1788528379.074930:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528379.074960:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735444736 00000100:00100000:0.0:1788528379.074968:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735444736 00000100:00100000:0.0:1788528379.075019:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735445376 00000100:00100000:0.0:1788528379.075022:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735445376 00000100:00100000:0.0:1788528379.075039:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788528379.075048:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735444736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788528379.075090:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788528379.075141:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735444736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (3289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528379.075148:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788528379.075165:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788528379.075171:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735445376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528379.075205:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735445376:12345-0@lo:400:kworker.0 Request processed in 33us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528379.075217:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788528379.075239:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735444608 00000100:00100000:0.0:1788528379.075242:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735444608 00000100:00100000:0.0:1788528379.075277:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735444864 00000100:00100000:0.0:1788528379.075281:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735444864 00000100:00100000:0.0:1788528379.075295:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788528379.075301:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735444608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788528379.075318:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528379.075352:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735444608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (3306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528379.075359:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788528379.075370:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788528379.075375:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735444864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788528379.075398:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528379.075424:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735444864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528379.075431:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788528379.075451:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735445760 00000100:00100000:0.0:1788528379.075454:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735445760 00000100:00100000:0.0:1788528379.075479:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735446272 00000100:00100000:0.0:1788528379.075482:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735446272 00000100:00100000:0.0:1788528379.075491:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735445888 00000100:00100000:0.0:1788528379.075494:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735445888 00000100:00100000:0.0:1788528379.075507:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788528379.075512:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735445760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528379.075544:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735445760:12345-0@lo:400:kworker.0 Request processed in 32us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528379.075595:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788528379.075607:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788528379.075613:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735446272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528379.075643:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735446272:12345-0@lo:400:kworker.0 Request processed in 30us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528379.075649:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788528379.075659:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788528379.075665:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735445888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528379.075690:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735445888:12345-0@lo:400:kworker.0 Request processed in 26us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528379.075696:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788528379.075713:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735445248 00000100:00100000:0.0:1788528379.075718:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735445248 00000100:00100000:0.0:1788528379.075738:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735445120 00000100:00100000:0.0:1788528379.075740:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735445120 00000100:00100000:0.0:1788528379.075750:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735445632 00000100:00100000:0.0:1788528379.075753:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735445632 00000100:00100000:0.0:1788528379.075763:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735446144 00000100:00100000:0.0:1788528379.075766:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735446144 00000100:00100000:0.0:1788528379.075778:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735445504 00000100:00100000:0.0:1788528379.075780:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735445504 00000100:00100000:0.0:1788528379.075789:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735446016 00000100:00100000:0.0:1788528379.075792:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735446016 00000100:00100000:0.0:1788528379.075805:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788528379.075811:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735445248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528379.075842:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735445248:12345-0@lo:400:kworker.0 Request processed in 31us (1505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528379.075849:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788528379.075870:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788528379.075876:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735445120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528379.075906:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735445120:12345-0@lo:400:kworker.0 Request processed in 31us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528379.075912:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788528379.075922:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788528379.075928:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875407735445632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528379.075954:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875407735445632:12345-0@lo:400:kworker.0 Request processed in 27us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528379.075960:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788528379.075970:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788528379.075975:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735446144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528379.076001:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735446144:12345-0@lo:400:kworker.0 Request processed in 27us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528379.076006:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788528379.076015:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788528379.076020:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735445504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528379.076045:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735445504:12345-0@lo:400:kworker.0 Request processed in 25us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528379.076050:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788528379.076060:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788528379.076065:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875407735446016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528379.076090:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875407735446016:12345-0@lo:400:kworker.0 Request processed in 25us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528379.076095:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788528379.076169:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735445504:0@lo:400:kworker.0 00000100:00100000:0.0:1788528379.076182:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1875407735446016:0@lo:400:kworker.0 00010000:00080000:0.0:1788528379.076197:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc30aca80 x1875407735444864/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528379.076214:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735444864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788528379.076227:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735445376:0@lo:400:kworker.0 00010000:00080000:0.0:1788528379.076236:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc36f1500 x1875407735445888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528379.076243:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735445888:0@lo:400:kworker.0 00000100:00080000:0.0:1788528379.076281:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788528379.076287:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788528379.076289:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788528379.076292:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788528379.076339:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735445120:0@lo:400:kworker.0 00010000:00080000:0.0:1788528379.076351:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc36f2a00 x1875407735445632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528379.076360:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1875407735445632:0@lo:400:kworker.0 00010000:00080000:0.0:1788528379.076370:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc36f3800 x1875407735446144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528379.076377:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735446144:0@lo:400:kworker.0 00000100:00100000:0.0:1788528379.076388:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735445248:0@lo:400:kworker.0 00010000:00080000:0.0:1788528379.076398:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc36f2d80 x1875407735445760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528379.076414:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735445760:0@lo:400:kworker.0 00010000:00080000:0.0:1788528379.076425:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc36f0700 x1875407735446272/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528379.076432:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735446272:0@lo:400:kworker.0 00000100:00100000:0.0:1788528379.076450:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735444736:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1788528379.076823:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa4fb80 x1875407735444608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528379.076839:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735444608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788528379.077053:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735444992 00000100:00100000:3.0:1788528379.077061:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735444992 00000100:00100000:3.0:1788528379.077111:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788528379.077120:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735444992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528379.077205:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735444992:12345-0@lo:400:kworker.0 Request processed in 86us (2347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528379.077212:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788528379.077368:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735444992:0@lo:400:kworker.0 00010000:00010000:3.0:1788528380.031685:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528380.095096:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735446400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788528380.095201:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528380.095343:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735446400 00000100:00100000:1.0:1788528380.095354:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735446400 00000100:00100000:1.0:1788528380.095418:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788528380.095429:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735446400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788528380.095468:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528380.095529:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735446400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528380.095537:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1788528380.095632:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa4dc00 x1875407735446400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528380.095666:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735446400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788528380.096143:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735446528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788528380.096186:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528380.096397:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735446528 00000100:00100000:2.0:1788528380.096404:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735446528 00000100:00100000:2.0:1788528380.096446:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788528380.096455:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735446528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788528380.096480:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528380.096975:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735446528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 520us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528380.096984:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1788528380.098184:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3eb3480 x1875407735446528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528380.098215:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735446528:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788528381.055025:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528381.119725:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788528381.119755:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735446656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788528381.119854:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528381.120509:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735446656 00000100:00100000:3.0:1788528381.120523:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735446656 00000100:00100000:3.0:1788528381.120707:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788528381.120720:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc36f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735446656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788528381.120768:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788528381.124179:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc36f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735446656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3445us (4310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528381.124195:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788528381.130978:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735446656:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788528382.084026:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528383.107860:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528383.175787:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528383.175833:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528383.175857:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528383.175880:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528383.175901:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528383.175920:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528383.175946:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528383.175981:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719643136 00000100:00100000:3.0:1788528383.175992:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719643136 00000100:00100000:3.0:1788528383.176061:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719643392 00000100:00100000:3.0:1788528383.176064:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719643392 00000100:00100000:3.0:1788528383.176153:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719643008 00000100:00100000:0.0:1788528383.176351:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719642880 00000100:00100000:0.0:1788528383.176356:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719642880 00000100:00100000:0.0:1788528383.176393:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 323 00000100:00100000:0.0:1788528383.176403:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2403:x1875407719642880:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528383.176487:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2403:x1875407719642880:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 85us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528383.176494:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 323 00000100:00100000:3.0:1788528383.176714:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719643008 00000100:00100000:3.0:1788528383.176741:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719643264 00000100:00100000:3.0:1788528383.176744:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719643264 00000100:00100000:3.0:1788528383.176866:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 128 00000100:00100000:3.0:1788528383.176874:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc36f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719643136:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528383.177741:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc36f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719643136:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 861us (1901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528383.177773:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 128 00000100:00100000:3.0:1788528383.177809:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 129 00000100:00100000:3.0:1788528383.177879:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc36f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:2403:x1875407719643392:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528383.177996:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc36f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:2403:x1875407719643392:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 178us (2135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528383.178003:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 129 00000100:00100000:3.0:1788528383.178018:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 130 00000100:00100000:3.0:1788528383.178026:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc36f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2403:x1875407719643008:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528383.178052:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc36f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2403:x1875407719643008:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (2150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528383.178058:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 130 00000100:00100000:3.0:1788528383.178070:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 131 00000100:00100000:3.0:1788528383.178077:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc36f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:2403:x1875407719643264:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528383.178100:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc36f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:2403:x1875407719643264:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 25us (2180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528383.178106:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 131 00000100:00100000:3.0:1788528383.178266:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719643648 00000100:00100000:3.0:1788528383.178275:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719643648 00000100:00100000:3.0:1788528383.178322:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719643520 00000100:00100000:3.0:1788528383.178326:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719643520 00000100:00100000:3.0:1788528383.178346:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:3.0:1788528383.178353:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc36f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:2403:x1875407719643648:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528383.178380:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc36f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:2403:x1875407719643648:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (2500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528383.178393:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:3.0:1788528383.178406:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:3.0:1788528383.178413:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc36f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:2403:x1875407719643520:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528383.178438:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc36f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:2403:x1875407719643520:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 25us (2491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528383.178444:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00080000:3.0:1788528383.178472:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788528383.178477:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788528383.178480:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788528383.178483:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:2.0:1788528383.251636:0:12179:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-client.virtnet: executing check_config_client /mnt/lustre 00000001:00100000:2.0:1788528383.685541:0:8416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689 00000001:00100000:2.0:1788528383.687138:0:6487:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689 00000001:00100000:1.0:1788528383.688753:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689 00000001:00100000:0.0:1788528383.691123:0:7440:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689 00010000:00010000:1.0:1788528384.133151:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528384.191047:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735446784:0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.191129:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528384.191176:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735447296:0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.191203:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528384.191223:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735447808:0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.191263:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528384.191283:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735448320:0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.191303:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528384.191327:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788528384.191333:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735447168:0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.191371:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528384.191391:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735447680:0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.191412:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528384.191429:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735448192:0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.191449:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528384.191479:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735446912:0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.191502:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528384.191531:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735447424:0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.191551:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528384.191592:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1875407735447936:0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.191613:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528384.191631:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788528384.191636:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735447040:0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.191657:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528384.191675:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735447552:0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.191705:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528384.191716:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1875407735448064:0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.191734:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528384.191761:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735446784 00000100:00100000:0.0:1788528384.191769:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735446784 00000100:00100000:0.0:1788528384.191809:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788528384.191818:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:3640:x1875407735446784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.191865:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:3640:x1875407735446784:12345-0@lo:400:kworker.0 Request processed in 48us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528384.191872:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788528384.191902:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735447296 00000100:00100000:0.0:1788528384.191906:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735447296 00000100:00100000:0.0:1788528384.191930:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735447040 00000100:00100000:0.0:1788528384.191933:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735447040 00000100:00100000:0.0:1788528384.191947:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788528384.191952:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735447296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.191985:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735447296:12345-0@lo:400:kworker.0 Request processed in 33us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528384.191991:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788528384.192003:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788528384.192008:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735447040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.192039:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735447040:12345-0@lo:400:kworker.0 Request processed in 31us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528384.192045:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788528384.192060:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735447808 00000100:00100000:0.0:1788528384.192064:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735447808 00000100:00100000:0.0:1788528384.192090:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735448320 00000100:00100000:0.0:1788528384.192099:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735448320 00000100:00100000:0.0:1788528384.192114:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735447680 00000100:00100000:0.0:1788528384.192116:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735447680 00000100:00100000:0.0:1788528384.192129:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735448192 00000100:00100000:0.0:1788528384.192132:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735448192 00000100:00100000:0.0:1788528384.192144:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788528384.192149:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735447808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.192180:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735447808:12345-0@lo:400:kworker.0 Request processed in 31us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528384.192186:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788528384.192197:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788528384.192203:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735448320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.192229:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735448320:12345-0@lo:400:kworker.0 Request processed in 26us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528384.192234:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788528384.192243:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788528384.192249:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735447680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.192273:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735447680:12345-0@lo:400:kworker.0 Request processed in 24us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528384.192278:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788528384.192290:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788528384.192295:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735448192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.192318:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735448192:12345-0@lo:400:kworker.0 Request processed in 24us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528384.192324:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788528384.192346:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735447168 00000100:00100000:0.0:1788528384.192349:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735447168 00000100:00100000:0.0:1788528384.192376:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735446912 00000100:00100000:0.0:1788528384.192378:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735446912 00000100:00100000:0.0:1788528384.192388:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735447424 00000100:00100000:0.0:1788528384.192390:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735447424 00000100:00100000:0.0:1788528384.192401:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735447936 00000100:00100000:0.0:1788528384.192403:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735447936 00000100:00100000:0.0:1788528384.192412:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735447552 00000100:00100000:0.0:1788528384.192415:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735447552 00000100:00100000:0.0:1788528384.192423:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735448064 00000100:00100000:0.0:1788528384.192425:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735448064 00000100:00100000:0.0:1788528384.192439:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788528384.192444:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735447168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.192488:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735447168:12345-0@lo:400:kworker.0 Request processed in 43us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528384.192495:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788528384.192506:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788528384.192512:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735446912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.192550:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735446912:12345-0@lo:400:kworker.0 Request processed in 38us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528384.193143:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735448704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788528384.193147:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735448576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788528384.193203:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528384.193380:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735448704 00000100:00100000:2.0:1788528384.193386:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735448704 00000100:00100000:2.0:1788528384.193427:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788528384.193435:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc36f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735448704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788528384.193460:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528384.193509:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc36f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735448704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528384.193526:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788528384.193550:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788528384.193585:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc36f0a80 x1875407735448704/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528384.193600:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788528384.193609:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735448448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528384.193636:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528384.193661:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735448576 00000100:00100000:2.0:1788528384.193665:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735448576 00000100:00100000:3.0:1788528384.193685:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735448704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788528384.193691:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788528384.193699:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735448576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788528384.193946:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528384.193984:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735448576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 286us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528384.193991:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1788528384.194020:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3eb0700 x1875407735448576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528384.194033:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735448576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788528384.194053:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735448448 00000100:00100000:2.0:1788528384.194057:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735448448 00000100:00100000:2.0:1788528384.194081:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788528384.194088:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735448448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788528384.194110:0:9268:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788528384.194274:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735448448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528384.195168:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735448448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528384.195179:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788528384.196543:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788528384.196599:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788528384.196615:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735447424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.196693:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735447424:12345-0@lo:400:kworker.0 Request processed in 86us (5141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528384.196699:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788528384.196714:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788528384.196721:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875407735447936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.196750:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875407735447936:12345-0@lo:400:kworker.0 Request processed in 31us (5137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528384.196766:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788528384.196780:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788528384.196787:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735447552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.196820:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735447552:12345-0@lo:400:kworker.0 Request processed in 34us (5114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528384.196825:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788528384.196836:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788528384.196843:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875407735448064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.196875:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875407735448064:12345-0@lo:400:kworker.0 Request processed in 28us (5134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528384.196880:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:0.0:1788528384.197126:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788528384.197132:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788528384.197136:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788528384.197138:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788528384.197174:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735447040:0@lo:400:kworker.0 00010000:00080000:0.0:1788528384.197190:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3e55180 x1875407735447552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528384.197200:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735447552:0@lo:400:kworker.0 00010000:00080000:0.0:1788528384.197211:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3e56300 x1875407735448064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528384.197220:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1875407735448064:0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.197231:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735446912:0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.197241:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735447424:0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.197265:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1875407735447936:0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.197312:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735447168:0@lo:400:kworker.0 00010000:00080000:0.0:1788528384.197326:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3e57b80 x1875407735447680/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528384.197334:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735447680:0@lo:400:kworker.0 00010000:00080000:0.0:1788528384.197344:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3e55880 x1875407735448192/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528384.197351:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735448192:0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.197361:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735446784:0@lo:400:kworker.0 00000100:00100000:0.0:1788528384.197373:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735447296:0@lo:400:kworker.0 00010000:00080000:0.0:1788528384.197384:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3e54e00 x1875407735447808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528384.197444:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735447808:0@lo:400:kworker.0 00010000:00080000:0.0:1788528384.197458:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3e55f80 x1875407735448320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528384.197466:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735448320:0@lo:400:kworker.0 00010000:00010000:3.0:1788528385.152838:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528385.215008:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788528385.215030:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735448832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788528385.215100:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528385.215245:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735448832 00000100:00100000:2.0:1788528385.215254:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735448832 00000100:00100000:2.0:1788528385.215352:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788528385.215361:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc36f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735448832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788528385.215390:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528385.215438:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc36f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735448832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528385.215445:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788528385.216212:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735448960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788528385.216252:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528385.216312:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735448960 00000100:00100000:2.0:1788528385.216318:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735448960 00000100:00100000:2.0:1788528385.216346:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788528385.216360:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735448960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788528385.216375:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528385.216438:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735448960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528385.216445:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1788528385.216506:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3eb2a00 x1875407735448960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528385.216536:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735448960:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1788528385.216682:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3eb0700 x1875407735448832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528385.216697:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735448832:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788528386.175906:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528386.250295:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788528386.250335:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735449088:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788528386.250429:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528386.251438:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735449088 00000100:00100000:3.0:1788528386.251452:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735449088 00000100:00100000:3.0:1788528386.251536:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788528386.251548:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc36f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735449088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788528386.251614:0:9268:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788528386.251699:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc36f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735449088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 153us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528386.251708:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788528386.251772:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735449088:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788528387.199421:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528388.222750:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528388.305300:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528388.305353:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528388.305381:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528388.305404:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528388.305435:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528388.305454:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719644032 00000100:00100000:3.0:1788528388.305468:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528388.305474:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719644032 00000100:00100000:3.0:1788528388.305509:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528388.305582:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719644288 00000100:00100000:3.0:1788528388.305592:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719644288 00000100:00100000:0.0:1788528388.305603:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719643904 00000100:00100000:0.0:1788528388.305610:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719643904 00000100:00100000:0.0:1788528388.305633:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719644160 00000100:00100000:0.0:1788528388.305637:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719644160 00000100:00100000:3.0:1788528388.305667:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 138 00000100:00100000:3.0:1788528388.305680:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc36f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2404:x1875407719644032:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528388.305741:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719643776 00000100:00100000:1.0:1788528388.305749:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719643776 00000100:00100000:3.0:1788528388.305763:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc36f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2404:x1875407719644032:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 84us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528388.305802:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 325 00000100:00100000:1.0:1788528388.305813:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2404:x1875407719643776:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528388.305880:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2404:x1875407719643776:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 69us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528388.305888:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 325 00000100:00100000:0.0:1788528388.306062:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 139 00000100:00100000:0.0:1788528388.306072:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc36f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2404:x1875407719643904:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528388.306105:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc36f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2404:x1875407719643904:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 36us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528388.306113:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 139 00000100:00100000:0.0:1788528388.306210:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 140 00000100:00100000:0.0:1788528388.306218:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc36f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2404:x1875407719644288:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528388.306245:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc36f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2404:x1875407719644288:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528388.306252:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 140 00000100:00100000:0.0:1788528388.306269:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 141 00000100:00100000:0.0:1788528388.306276:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc36f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2404:x1875407719644160:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528388.306285:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 138 00000100:00100000:0.0:1788528388.306316:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc36f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2404:x1875407719644160:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 38us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528388.306326:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 141 00000100:00100000:0.0:1788528388.306545:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719644544 00000100:00100000:0.0:1788528388.306550:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719644544 00000100:00100000:1.0:1788528388.306655:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719644416 00000100:00100000:1.0:1788528388.306659:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719644416 00000100:00100000:1.0:1788528388.306717:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:1.0:1788528388.306725:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc36f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2404:x1875407719644416:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528388.306759:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc36f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2404:x1875407719644416:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 35us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528388.306779:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00080000:1.0:1788528388.306799:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788528388.306804:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788528388.306807:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788528388.307858:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 55 00000100:00100000:0.0:1788528388.307870:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc36f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2404:x1875407719644544:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528388.307932:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc36f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2404:x1875407719644544:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 65us (2528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528388.307939:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 55 00000100:00080000:1.0:1788528388.309038:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788528389.247850:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528389.310801:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735449344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788528389.310933:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528389.310976:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735449216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788528389.311034:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528389.311193:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735449344 00000100:00100000:0.0:1788528389.311202:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735449344 00000100:00100000:0.0:1788528389.311272:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788528389.311283:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc36f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735449344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788528389.311327:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788528389.311376:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc36f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735449344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528389.311383:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788528389.311407:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735449472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788528389.311433:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528389.311478:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735449216 00000100:00100000:0.0:1788528389.311493:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735449216 00000100:00100000:2.0:1788528389.311508:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735449472 00000100:00100000:2.0:1788528389.311514:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735449472 00000100:00100000:0.0:1788528389.311532:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788528389.311541:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735449216:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788528389.311585:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00002000:00000024:0.0:1788528389.311586:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528389.311598:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735449472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788528389.311614:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528389.311625:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735449216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528389.311633:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788528389.311674:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735449472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528389.311693:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1788528389.311758:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788528389.312175:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735449344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788528389.312201:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735449728:0@lo:400:kworker.0 00000100:00100000:3.0:1788528389.312233:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528389.312262:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735449728 00000100:00100000:3.0:1788528389.312266:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735449728 00000100:00100000:3.0:1788528389.312295:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788528389.312301:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc36f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735449728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528389.312334:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc36f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735449728:12345-0@lo:400:kworker.0 Request processed in 33us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528389.312340:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788528389.312672:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735449600:0@lo:400:kworker.0 00000100:00100000:0.0:1788528389.312711:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788528389.312783:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3eb0a80 x1875407735449216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528389.312801:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735449216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788528389.312823:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735449856:0@lo:400:kworker.0 00000100:00100000:0.0:1788528389.312847:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528389.312880:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735450368:0@lo:400:kworker.0 00000100:00100000:0.0:1788528389.312911:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788528389.313102:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6f49180 x1875407735449472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528389.313119:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735449472:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788528389.313138:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735449856 00000100:00100000:1.0:1788528389.313145:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735449856 00000100:00100000:2.0:1788528389.313152:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735449984:0@lo:400:kworker.0 00000100:00100000:1.0:1788528389.313192:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788528389.313202:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735449856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528389.313247:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735449856:12345-0@lo:400:kworker.0 Request processed in 48us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528389.313255:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788528389.313276:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735450368 00000100:00100000:1.0:1788528389.313279:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735450368 00000100:00100000:1.0:1788528389.313312:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788528389.313318:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735450368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528389.313347:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735450368:12345-0@lo:400:kworker.0 Request processed in 29us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528389.313353:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1788528389.313374:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788528389.313393:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735449856:0@lo:400:kworker.0 00010000:00080000:1.0:1788528389.313404:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa4ea00 x1875407735450368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528389.313413:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735450368:0@lo:400:kworker.0 00000100:00100000:0.0:1788528389.313578:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735449728:0@lo:400:kworker.0 00000100:00100000:0.0:1788528389.313586:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735450240:0@lo:400:kworker.0 00000100:00100000:2.0:1788528389.313608:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528389.313619:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528389.313647:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735450496:0@lo:400:kworker.0 00000100:00100000:0.0:1788528389.313649:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735450752:0@lo:400:kworker.0 00000100:00100000:3.0:1788528389.313746:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735449600 00000100:00100000:1.0:1788528389.313781:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735450112:0@lo:400:kworker.0 00000100:00100000:3.0:1788528389.313872:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735449600 00000100:00100000:3.0:1788528389.313919:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788528389.313927:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:3638:x1875407735449600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528389.314826:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528389.314861:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528389.314917:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735449984 00000100:00100000:2.0:1788528389.314925:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735449984 00000100:00100000:0.0:1788528389.314934:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735450240 00000100:00100000:0.0:1788528389.314941:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735450240 00000100:00100000:2.0:1788528389.314986:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788528389.315011:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90de365450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735449984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528389.315064:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735450752 00000100:00100000:0.0:1788528389.315069:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735450752 00000100:00100000:2.0:1788528389.315091:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90de365450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735449984:12345-0@lo:400:kworker.0 Request processed in 77us (1473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528389.315099:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788528389.315102:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788528389.315111:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735450240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528389.315161:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735450240:12345-0@lo:400:kworker.0 Request processed in 52us (1542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528389.315168:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788528389.315189:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788528389.315197:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735450752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528389.315225:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735450752:12345-0@lo:400:kworker.0 Request processed in 30us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528389.315231:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00010000:00080000:0.0:1788528389.315268:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa4df80 x1875407735450240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528389.315282:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735450240:0@lo:400:kworker.0 00010000:00080000:0.0:1788528389.315295:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa4e680 x1875407735450752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528389.315303:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735450752:0@lo:400:kworker.0 00000100:00080000:0.0:1788528389.315340:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788528389.315373:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735450496 00000100:00100000:0.0:1788528389.315377:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735450496 00000100:00100000:0.0:1788528389.315425:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788528389.315431:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735450496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528389.315464:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735450496:12345-0@lo:400:kworker.0 Request processed in 33us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528389.315471:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1788528389.315498:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788528389.315755:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735449984:0@lo:400:kworker.0 00010000:00080000:0.0:1788528389.315969:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa4ed80 x1875407735450496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528389.316106:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735450496:0@lo:400:kworker.0 00000100:00100000:1.0:1788528389.320249:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528389.320320:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735450624:0@lo:400:kworker.0 00000100:00100000:1.0:1788528389.320373:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528389.322329:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735450112 00000100:00100000:0.0:1788528389.322346:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735450112 00000100:00100000:0.0:1788528389.322447:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735450624 00000100:00100000:0.0:1788528389.322452:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735450624 00000100:00100000:0.0:1788528389.322499:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788528389.322512:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735450112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528389.322662:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735450112:12345-0@lo:400:kworker.0 Request processed in 154us (2425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528389.322669:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788528389.322689:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788528389.322696:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735450624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528389.322727:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735450624:12345-0@lo:400:kworker.0 Request processed in 31us (2353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528389.322754:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:1.0:1788528389.322896:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788528389.322948:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735450112:0@lo:400:kworker.0 00000100:00100000:1.0:1788528389.322962:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735450624:0@lo:400:kworker.0 00000100:00100000:3.0:1788528389.325295:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:3638:x1875407735449600:12345-0@lo:400:kworker.0 Request processed in 11357us (12571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528389.325312:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788528389.330033:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735449600:0@lo:400:kworker.0 00010000:00010000:3.0:1788528390.270787:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528390.335785:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735450880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788528390.335859:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528390.335964:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735450880 00000100:00100000:2.0:1788528390.335974:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735450880 00000100:00100000:2.0:1788528390.336029:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788528390.336038:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735450880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788528390.336066:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528390.336115:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735450880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528390.336123:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:2.0:1788528390.336158:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3eb1180 x1875407735450880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528390.336175:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735450880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788528390.345841:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735451008:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788528390.345910:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528390.346012:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735451008 00000100:00100000:3.0:1788528390.346019:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735451008 00000100:00100000:3.0:1788528390.346071:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788528390.346080:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735451008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788528390.346101:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788528390.346145:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735451008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528390.346165:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:1.0:1788528390.346334:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3eb1180 x1875407735451008/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528390.346434:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735451008:0@lo:13:osp-pre-0-1.0 00000020:00000004:2.0:1788528390.419530:0:12495:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788528390.419913:0:12495:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788528391.294889:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528391.372901:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735451136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788528391.372975:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528391.373060:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735451136 00000100:00100000:2.0:1788528391.373067:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735451136 00000100:00100000:2.0:1788528391.373111:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788528391.373119:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735451136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788528391.373153:0:9268:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788528391.373201:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735451136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528391.373216:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788528391.373265:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735451136:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788528392.320835:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788528392.439429:0:12592:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788528392.440279:0:12592:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788528393.344023:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528393.432046:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528393.432104:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528393.432177:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528393.432210:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719644928 00000100:00100000:0.0:1788528393.432219:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719644928 00000100:00100000:0.0:1788528393.432269:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719645184 00000100:00100000:0.0:1788528393.432272:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719645184 00000100:00100000:0.0:1788528393.432297:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 148 00000100:00100000:0.0:1788528393.432307:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719644928:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528393.432380:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719644928:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 74us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528393.432388:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 148 00000100:00100000:0.0:1788528393.432404:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 149 00000100:00100000:0.0:1788528393.432410:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719645184:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528393.432434:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719645184:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 24us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528393.432440:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 149 00000100:00080000:0.0:1788528393.432466:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788528393.432844:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719644672 00000100:00100000:2.0:1788528393.432849:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719644672 00000100:00100000:2.0:1788528393.432889:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 327 00000100:00100000:2.0:1788528393.432896:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2403:x1875407719644672:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528393.432928:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2403:x1875407719644672:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 33us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528393.432934:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 327 00000100:00100000:0.0:1788528393.436090:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528393.436211:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528393.436243:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528393.436277:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528393.436314:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719644800 00000100:00100000:2.0:1788528393.436328:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719644800 00000100:00100000:2.0:1788528393.436383:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719645056 00000100:00100000:2.0:1788528393.436386:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719645056 00000100:00100000:2.0:1788528393.436410:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 150 00000100:00100000:2.0:1788528393.436420:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2403:x1875407719644800:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528393.436499:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2403:x1875407719644800:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 80us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528393.436507:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 150 00000100:00100000:2.0:1788528393.436522:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 151 00000100:00100000:2.0:1788528393.436529:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719645056:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528393.436549:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719645056:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 21us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528393.436586:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 151 00000100:00080000:2.0:1788528393.436608:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788528393.441177:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719645440 00000100:00100000:1.0:1788528393.441190:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719645440 00000100:00100000:1.0:1788528393.441292:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719645312 00000100:00100000:1.0:1788528393.441305:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719645312 00000100:00100000:2.0:1788528393.441494:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:2.0:1788528393.441506:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719645440:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528393.441612:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719645440:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 109us (5530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528393.441620:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00080000:0.0:1788528393.441721:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788528393.441725:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788528393.445208:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:1.0:1788528393.445224:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719645312:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528393.445298:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719645312:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 78us (9020us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528393.445321:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 59 00010000:00010000:1.0:1788528394.375184:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528394.430808:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788528394.430831:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735451264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528394.430955:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528394.431018:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735451264 00000100:00100000:2.0:1788528394.431025:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735451264 00000100:00100000:2.0:1788528394.431072:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788528394.431082:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735451264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788528394.431116:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788528394.431162:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735451264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528394.431169:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788528394.431214:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735451264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528394.431341:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735451392:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788528394.431372:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528394.431457:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735451392 00000100:00100000:3.0:1788528394.431461:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735451392 00000100:00100000:3.0:1788528394.431508:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788528394.431516:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f70bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735451392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788528394.431536:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788528394.431599:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f70bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735451392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528394.431605:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1788528394.432163:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788528394.432174:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788528394.432185:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735451520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788528394.432219:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788528394.432269:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc36f3480 x1875407735451392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528394.432286:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735451392:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788528394.432364:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735451520 00000100:00100000:3.0:1788528394.432369:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735451520 00000100:00100000:3.0:1788528394.432414:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788528394.432422:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735451520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788528394.432436:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788528394.432482:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735451520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528394.432489:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1788528394.434398:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788528394.434455:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc36f1180 x1875407735451520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528394.434478:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735451520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788528394.435396:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735451776:0@lo:400:kworker.0 00000100:00100000:3.0:1788528394.435462:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528394.435490:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735452288:0@lo:400:kworker.0 00000100:00100000:3.0:1788528394.435511:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528394.435526:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735452800:0@lo:400:kworker.0 00000100:00100000:3.0:1788528394.435544:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528394.435587:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788528394.435593:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735451904:0@lo:400:kworker.0 00000100:00100000:3.0:1788528394.435626:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528394.435643:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735452416:0@lo:400:kworker.0 00000100:00100000:3.0:1788528394.435667:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528394.435697:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735451776 00000100:00100000:3.0:1788528394.435703:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735451776 00000100:00100000:3.0:1788528394.435736:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735452288 00000100:00100000:3.0:1788528394.435739:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735452288 00000100:00100000:3.0:1788528394.435759:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735452800 00000100:00100000:3.0:1788528394.435763:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735452800 00000100:00100000:3.0:1788528394.435774:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735451904 00000100:00100000:3.0:1788528394.435777:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735451904 00000100:00100000:3.0:1788528394.435791:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788528394.435797:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735451776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528394.435844:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735451776:12345-0@lo:400:kworker.0 Request processed in 47us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528394.435852:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788528394.435869:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788528394.435876:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735452288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528394.435903:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735452288:12345-0@lo:400:kworker.0 Request processed in 28us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528394.435909:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788528394.435921:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788528394.435927:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735452800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528394.435953:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735452800:12345-0@lo:400:kworker.0 Request processed in 28us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528394.435959:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788528394.435970:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788528394.435983:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735451904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528394.436011:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735451904:12345-0@lo:400:kworker.0 Request processed in 29us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528394.436016:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788528394.436042:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735452416 00000100:00100000:3.0:1788528394.436045:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735452416 00000100:00100000:3.0:1788528394.436070:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788528394.436076:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735452416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528394.436104:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735452416:12345-0@lo:400:kworker.0 Request processed in 28us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528394.436109:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788528394.436130:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735452032:0@lo:400:kworker.0 00000100:00100000:3.0:1788528394.436156:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528394.436175:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735452544:0@lo:400:kworker.0 00000100:00100000:3.0:1788528394.436196:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528394.436214:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788528394.436220:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735451648:0@lo:400:kworker.0 00000100:00100000:3.0:1788528394.436249:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528394.436272:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735452160:0@lo:400:kworker.0 00000100:00100000:3.0:1788528394.436293:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528394.436308:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1875407735452672:0@lo:400:kworker.0 00000100:00100000:3.0:1788528394.436326:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528394.436349:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735452032 00000100:00100000:3.0:1788528394.436353:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735452032 00000100:00100000:3.0:1788528394.436380:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788528394.436386:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735452032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528394.436428:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735452032:12345-0@lo:400:kworker.0 Request processed in 42us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528394.436435:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788528394.436467:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735452544 00000100:00100000:3.0:1788528394.436470:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735452544 00000100:00100000:3.0:1788528394.436498:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788528394.436504:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735452544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528394.436532:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735452544:12345-0@lo:400:kworker.0 Request processed in 28us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528394.436538:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788528394.436581:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735451648 00000100:00100000:3.0:1788528394.436584:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735451648 00000100:00100000:3.0:1788528394.436610:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1788528394.436617:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735451648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528394.436647:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735451648:12345-0@lo:400:kworker.0 Request processed in 31us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528394.436652:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1788528394.436681:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735452160 00000100:00100000:3.0:1788528394.436684:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735452160 00000100:00100000:3.0:1788528394.436704:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735452672 00000100:00100000:3.0:1788528394.436707:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735452672 00000100:00100000:3.0:1788528394.436723:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788528394.436729:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735452160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528394.436756:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735452160:12345-0@lo:400:kworker.0 Request processed in 27us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528394.436762:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788528394.436773:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788528394.436786:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875407735452672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528394.436814:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875407735452672:12345-0@lo:400:kworker.0 Request processed in 30us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528394.436820:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:3.0:1788528394.436841:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788528394.436845:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788528394.436847:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788528394.436874:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735451648:0@lo:400:kworker.0 00000100:00100000:3.0:1788528394.436886:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735452160:0@lo:400:kworker.0 00000100:00100000:3.0:1788528394.436893:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1875407735452672:0@lo:400:kworker.0 00000100:00100000:3.0:1788528394.436901:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735452032:0@lo:400:kworker.0 00010000:00080000:3.0:1788528394.436912:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3c7c700 x1875407735452544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528394.436922:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735452544:0@lo:400:kworker.0 00000100:00100000:3.0:1788528394.436957:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735451904:0@lo:400:kworker.0 00010000:00080000:3.0:1788528394.436967:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3c7dc00 x1875407735452416/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528394.436975:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735452416:0@lo:400:kworker.0 00000100:00100000:3.0:1788528394.436985:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735451776:0@lo:400:kworker.0 00010000:00080000:3.0:1788528394.436993:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3c7c380 x1875407735452288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528394.437000:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735452288:0@lo:400:kworker.0 00010000:00080000:3.0:1788528394.437019:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6f0aa00 x1875407735452800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528394.437026:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735452800:0@lo:400:kworker.0 00000020:00000004:0.0:1788528394.493173:0:12689:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788528394.493391:0:12689:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788528395.397162:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528395.454984:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735452928:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788528395.455061:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528395.455194:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735452928 00000100:00100000:1.0:1788528395.455203:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735452928 00000100:00100000:1.0:1788528395.455253:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788528395.455264:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735452928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788528395.455301:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528395.455390:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735452928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528395.455397:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:0.0:1788528395.455546:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa4d500 x1875407735452928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528395.455589:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735452928:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788528395.457209:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788528395.457228:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735453056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788528395.457282:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528395.457348:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735453056 00000100:00100000:1.0:1788528395.457354:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735453056 00000100:00100000:1.0:1788528395.457400:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788528395.457408:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735453056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788528395.457427:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528395.457477:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735453056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528395.457485:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1788528395.457520:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa4ce00 x1875407735453056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528395.457536:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735453056:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788528396.415606:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528396.479109:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788528396.479132:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735453184:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788528396.479200:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528396.479295:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735453184 00000100:00100000:2.0:1788528396.479304:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735453184 00000100:00100000:2.0:1788528396.479361:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788528396.479381:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735453184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788528396.479414:0:9268:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788528396.479540:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735453184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 160us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528396.479547:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788528396.479614:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735453184:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1788528396.498676:0:12787:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788528396.498924:0:12787:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788528397.438871:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788528398.437295:0:12884:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788528398.443917:0:12884:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788528398.463747:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528398.533493:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528398.533536:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528398.533586:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528398.533606:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528398.533624:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528398.533643:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528398.533664:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528398.533688:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719645824 00000100:00100000:2.0:1788528398.533697:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719645824 00000100:00100000:2.0:1788528398.533746:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719646080 00000100:00100000:2.0:1788528398.533750:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719646080 00000100:00100000:2.0:1788528398.533765:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719645696 00000100:00100000:2.0:1788528398.533768:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719645696 00000100:00100000:2.0:1788528398.533778:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719645952 00000100:00100000:2.0:1788528398.533791:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719645952 00000100:00100000:2.0:1788528398.533811:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 158 00000100:00100000:2.0:1788528398.533820:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2404:x1875407719645824:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528398.533887:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2404:x1875407719645824:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 69us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528398.533894:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 158 00000100:00100000:2.0:1788528398.533910:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 159 00000100:00100000:2.0:1788528398.533916:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2404:x1875407719646080:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528398.533940:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2404:x1875407719646080:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 24us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528398.533947:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 159 00000100:00100000:2.0:1788528398.533959:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 160 00000100:00100000:2.0:1788528398.533965:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2404:x1875407719645696:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528398.533987:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2404:x1875407719645696:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 22us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528398.533993:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 160 00000100:00100000:2.0:1788528398.534003:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 161 00000100:00100000:2.0:1788528398.534009:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2404:x1875407719645952:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528398.534030:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2404:x1875407719645952:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 21us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528398.534037:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 161 00000100:00100000:2.0:1788528398.534063:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719646208 00000100:00100000:2.0:1788528398.534067:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719646208 00000100:00100000:2.0:1788528398.534093:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719646336 00000100:00100000:2.0:1788528398.534102:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719646336 00000100:00100000:2.0:1788528398.534128:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:2.0:1788528398.534134:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2402:x1875407719646208:12345-192.168.203.38@tcp:9:kworker.0 00000020:00000080:2.0:1788528398.534153:0:8421:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c7b03 00000100:00080000:2.0:1788528398.534162:0:8421:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d0e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788528398.534203:0:8421:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788528398.534314:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+2:2402:x1875407719646208:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 179us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528398.534321:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:2.0:1788528398.534333:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:2.0:1788528398.534339:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2402:x1875407719646336:12345-192.168.203.38@tcp:9:kworker.0 00000020:00000080:2.0:1788528398.534351:0:8421:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c7b0a 00000100:00080000:2.0:1788528398.534357:0:8421:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d0b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788528398.534380:0:8421:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788528398.534584:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719645568 00000100:00100000:3.0:1788528398.534590:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719645568 00000100:00100000:3.0:1788528398.534621:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 329 00000100:00100000:3.0:1788528398.534628:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2404:x1875407719645568:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528398.534658:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2404:x1875407719645568:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 31us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528398.534665:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 329 00000100:00100000:2.0:1788528398.535076:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+2:2402:x1875407719646336:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 735us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528398.535084:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00080000:2.0:1788528398.535106:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788528398.535110:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788528398.535113:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788528398.535115:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788528398.535268:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528398.535274:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528399.487289:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528399.551699:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735453312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788528399.551770:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528399.551825:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788528399.551831:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735453440:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528399.551866:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528399.551908:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735453312 00000100:00100000:2.0:1788528399.551915:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735453312 00000100:00100000:1.0:1788528399.551997:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735453568:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788528399.552030:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788528399.552654:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788528399.552670:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735453440 00000100:00100000:3.0:1788528399.552675:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735453440 00000100:00100000:3.0:1788528399.552711:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788528399.552719:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735453440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788528399.552751:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788528399.552804:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735453440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528399.552810:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788528399.552858:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735453440:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528399.560352:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735453568 00000100:00100000:2.0:1788528399.560368:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735453568 00000100:00100000:2.0:1788528399.560447:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788528399.560457:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735453312:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788528399.560481:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788528399.560489:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735453568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788528399.560508:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00002000:00000024:2.0:1788528399.560625:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528399.567931:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735453312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7465us (16150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528399.567946:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788528399.568024:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735453952:0@lo:400:kworker.0 00000100:00100000:1.0:1788528399.568076:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528399.568108:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735454464:0@lo:400:kworker.0 00000100:00100000:1.0:1788528399.568141:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528399.568171:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788528399.568178:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735453824:0@lo:400:kworker.0 00000100:00100000:1.0:1788528399.568202:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528399.568225:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1875407735454336:0@lo:400:kworker.0 00000100:00100000:1.0:1788528399.568260:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528399.568280:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735454848:0@lo:400:kworker.0 00000100:00100000:1.0:1788528399.568304:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528399.568340:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735453952 00000100:00100000:1.0:1788528399.568348:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735453952 00000100:00100000:1.0:1788528399.568386:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735453824 00000100:00100000:1.0:1788528399.568389:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735453824 00000100:00100000:1.0:1788528399.568405:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735454336 00000100:00100000:1.0:1788528399.568408:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735454336 00000100:00100000:1.0:1788528399.568441:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735454848 00000100:00100000:1.0:1788528399.568444:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735454848 00000100:00100000:3.0:1788528399.568461:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735453568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7970us (16427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528399.568466:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788528399.568477:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735453952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528399.568484:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1788528399.568508:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788528399.568514:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788528399.568576:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735453952:12345-0@lo:400:kworker.0 Request processed in 102us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528399.568584:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788528399.568598:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788528399.568603:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735453824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528399.568631:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735453824:12345-0@lo:400:kworker.0 Request processed in 27us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528399.568636:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788528399.568647:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788528399.568653:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875407735454336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528399.568679:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875407735454336:12345-0@lo:400:kworker.0 Request processed in 27us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528399.568685:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788528399.568695:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788528399.568701:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735454848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528399.568725:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735454848:12345-0@lo:400:kworker.0 Request processed in 25us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528399.568731:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788528399.568748:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735454464 00000100:00100000:1.0:1788528399.568751:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735454464 00000100:00100000:1.0:1788528399.568786:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788528399.568793:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735454464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528399.568822:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735454464:12345-0@lo:400:kworker.0 Request processed in 30us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528399.568828:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788528399.568868:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735454080:0@lo:400:kworker.0 00000100:00100000:1.0:1788528399.568899:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528399.568921:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735454592:0@lo:400:kworker.0 00000100:00100000:1.0:1788528399.568944:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788528399.568978:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa4ce00 x1875407735453568/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528399.569000:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735453568:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788528399.569017:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788528399.569022:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735453696:0@lo:400:kworker.0 00000100:00100000:1.0:1788528399.569051:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528399.569073:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735454208:0@lo:400:kworker.0 00000100:00100000:1.0:1788528399.569097:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528399.569114:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1875407735454720:0@lo:400:kworker.0 00000100:00100000:2.0:1788528399.569137:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735453824:0@lo:400:kworker.0 00000100:00100000:3.0:1788528399.569648:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735453696 00000100:00100000:3.0:1788528399.569654:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735453696 00000100:00100000:3.0:1788528399.569693:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1788528399.569700:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735453696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528399.571616:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528399.571689:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735454592 00000100:00100000:1.0:1788528399.571698:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735454592 00010000:00080000:2.0:1788528399.571734:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa4ed80 x1875407735454336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528399.571749:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788528399.571754:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1875407735454336:0@lo:400:kworker.0 00000100:00100000:1.0:1788528399.571764:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735454592:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788528399.571776:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa4c000 x1875407735454848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528399.571786:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735454848:0@lo:400:kworker.0 00000100:00100000:2.0:1788528399.571801:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735453952:0@lo:400:kworker.0 00010000:00080000:2.0:1788528399.571822:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa4d180 x1875407735454464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528399.571823:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735454592:12345-0@lo:400:kworker.0 Request processed in 61us (2874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528399.571840:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788528399.571843:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735454464:0@lo:400:kworker.0 00010000:00080000:0.0:1788528399.571944:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3eb3800 x1875407735453312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528399.572034:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735453312:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788528399.572673:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788528399.573145:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735454080 00000100:00100000:0.0:1788528399.573154:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735454080 00000100:00100000:0.0:1788528399.573205:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788528399.573216:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735454080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528399.573509:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735454080:12345-0@lo:400:kworker.0 Request processed in 295us (4607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528399.573517:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788528399.575773:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735454208 00000100:00100000:0.0:1788528399.575787:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735454208 00000100:00080000:2.0:1788528399.575897:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788528399.577681:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735454720 00000100:00100000:0.0:1788528399.577703:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735454720 00000100:00100000:0.0:1788528399.577745:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788528399.577754:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735454208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528399.577831:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735454208:12345-0@lo:400:kworker.0 Request processed in 79us (8733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528399.577838:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788528399.577853:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788528399.577859:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875407735454720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528399.577882:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875407735454720:12345-0@lo:400:kworker.0 Request processed in 24us (6272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528399.577887:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:0.0:1788528399.577904:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788528399.578749:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735454208:0@lo:400:kworker.0 00000100:00100000:1.0:1788528399.578774:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1875407735454720:0@lo:400:kworker.0 00000100:00100000:1.0:1788528399.578794:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735454080:0@lo:400:kworker.0 00010000:00080000:1.0:1788528399.578829:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa4e680 x1875407735454592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528399.578842:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735454592:0@lo:400:kworker.0 00000100:00100000:3.0:1788528399.591083:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735453696:12345-0@lo:400:kworker.0 Request processed in 21373us (22021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528399.591096:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788528399.591106:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735453696:0@lo:400:kworker.0 00010000:00010000:1.0:1788528400.523757:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528400.575718:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788528400.575739:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735454976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788528400.575805:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528400.575872:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735454976 00000100:00100000:1.0:1788528400.575880:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735454976 00000100:00100000:1.0:1788528400.575925:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788528400.576525:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735454976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788528400.576569:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528400.576615:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735454976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528400.576621:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:0.0:1788528400.576702:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90fab2c380 x1875407735454976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528400.576718:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735454976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788528400.580437:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788528400.580463:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735455104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788528400.580531:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528400.582052:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735455104 00000100:00100000:2.0:1788528400.582064:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735455104 00000100:00100000:2.0:1788528400.582130:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788528400.582139:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735455104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788528400.582161:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528400.582229:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735455104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (1698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528400.582236:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:3.0:1788528400.582472:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3eb0700 x1875407735455104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528400.582494:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735455104:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788528401.539200:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528401.599155:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735455232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788528401.599229:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528401.599465:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735455232 00000100:00100000:2.0:1788528401.599473:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735455232 00000100:00100000:2.0:1788528401.599524:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788528401.599533:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735455232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788528401.599587:0:9268:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788528401.599640:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735455232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528401.599647:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788528401.599754:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735455232:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788528402.558995:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788528402.618455:0:13029:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788528403.582773:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528403.658010:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528403.658046:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528403.658080:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528403.658103:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528403.658123:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528403.658146:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719646464 00000100:00100000:3.0:1788528403.658155:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719646464 00000100:00100000:3.0:1788528403.658206:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 331 00000100:00100000:1.0:1788528403.658388:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719646592 00000100:00100000:1.0:1788528403.658393:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719646592 00000100:00100000:1.0:1788528403.658428:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719646848 00000100:00100000:1.0:1788528403.658431:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719646848 00000100:00100000:1.0:1788528403.658444:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719646720 00000100:00100000:1.0:1788528403.658446:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719646720 00000100:00100000:1.0:1788528403.658456:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719646976 00000100:00100000:1.0:1788528403.658459:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719646976 00000100:00100000:1.0:1788528403.658472:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 168 00000100:00100000:1.0:1788528403.658480:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2406:x1875407719646592:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528403.658600:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2406:x1875407719646592:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 120us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528403.658608:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 168 00000100:00100000:1.0:1788528403.658627:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 169 00000100:00100000:1.0:1788528403.658634:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2406:x1875407719646848:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528403.658660:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2406:x1875407719646848:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 27us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528403.658666:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 169 00000100:00100000:1.0:1788528403.658677:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 170 00000100:00100000:1.0:1788528403.658683:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2405:x1875407719646720:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528403.658707:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2405:x1875407719646720:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 23us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528403.658713:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 170 00000100:00100000:1.0:1788528403.658725:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 171 00000100:00100000:1.0:1788528403.658731:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2405:x1875407719646976:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528403.658753:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2405:x1875407719646976:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 23us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528403.658760:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 171 00000100:00100000:3.0:1788528403.659232:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2405:x1875407719646464:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528403.659296:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2405:x1875407719646464:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 1081us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528403.659304:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 331 00000100:00080000:0.0:1788528403.659645:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788528403.659651:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788528404.610286:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528404.670975:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788528404.670995:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735455360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788528404.671055:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528404.671112:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735455360 00000100:00100000:2.0:1788528404.671118:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735455360 00000100:00100000:2.0:1788528404.671163:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788528404.671171:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735455360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788528404.671197:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528404.671232:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735455360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528404.671401:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1788528404.671423:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788528404.671453:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3eb3480 x1875407735455360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528404.671471:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735455360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788528404.672045:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788528404.672058:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735455488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788528404.672098:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528404.672198:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735455488 00000100:00100000:2.0:1788528404.672203:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735455488 00000100:00100000:2.0:1788528404.672287:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788528404.672295:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735455488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788528404.672321:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788528404.672363:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735455488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528404.672369:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788528404.672878:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735455616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788528404.672910:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528404.672938:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735456128:0@lo:400:kworker.0 00000100:00100000:1.0:1788528404.672958:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528404.673938:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735456640:0@lo:400:kworker.0 00000100:00100000:1.0:1788528404.673973:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528404.673998:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788528404.674004:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735455744:0@lo:400:kworker.0 00000100:00100000:1.0:1788528404.674030:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528404.674050:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735456256:0@lo:400:kworker.0 00000100:00100000:1.0:1788528404.674073:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528404.674090:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1875407735456768:0@lo:400:kworker.0 00000100:00100000:1.0:1788528404.674110:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528404.674139:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735455616 00000100:00100000:1.0:1788528404.674146:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735455616 00000100:00100000:1.0:1788528404.674194:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788528404.674202:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735455616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788528404.674223:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528404.674278:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735455616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528404.674284:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788528404.674315:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735456640 00000100:00100000:1.0:1788528404.674319:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735456640 00000100:00100000:1.0:1788528404.674345:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788528404.674351:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735456640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528404.674535:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735456640:12345-0@lo:400:kworker.0 Request processed in 183us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528404.674542:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788528404.674576:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735456256 00000100:00100000:1.0:1788528404.674580:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735456256 00000100:00100000:1.0:1788528404.674601:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735456768 00000100:00100000:1.0:1788528404.674610:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735456768 00000100:00100000:1.0:1788528404.674631:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788528404.674636:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735456256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528404.674663:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735456256:12345-0@lo:400:kworker.0 Request processed in 27us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528404.674669:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788528404.674678:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788528404.674684:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875407735456768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528404.674704:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875407735456768:12345-0@lo:400:kworker.0 Request processed in 20us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528404.674709:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:1.0:1788528404.674731:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788528404.674734:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788528404.674736:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788528404.674749:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735456000:0@lo:400:kworker.0 00000100:00100000:1.0:1788528404.674770:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528404.674784:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735456512:0@lo:400:kworker.0 00000100:00100000:1.0:1788528404.674800:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528404.674814:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735457024:0@lo:400:kworker.0 00000100:00100000:1.0:1788528404.674830:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528404.674844:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788528404.674849:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735455872:0@lo:400:kworker.0 00000100:00100000:1.0:1788528404.674867:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528404.674878:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1875407735456384:0@lo:400:kworker.0 00000100:00100000:1.0:1788528404.674894:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528404.674904:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735456896:0@lo:400:kworker.0 00000100:00100000:1.0:1788528404.674926:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528404.674943:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735456512 00000100:00100000:1.0:1788528404.674946:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735456512 00000100:00100000:1.0:1788528404.674966:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735457024 00000100:00100000:1.0:1788528404.674968:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735457024 00000100:00100000:1.0:1788528404.674979:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788528404.674985:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735456512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528404.675013:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735456512:12345-0@lo:400:kworker.0 Request processed in 28us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528404.675019:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788528404.675027:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788528404.675032:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735457024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528404.675052:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735457024:12345-0@lo:400:kworker.0 Request processed in 20us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528404.675057:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788528404.675068:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735456000 00000100:00100000:1.0:1788528404.675071:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735456000 00000100:00100000:1.0:1788528404.675083:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735455872 00000100:00100000:1.0:1788528404.675086:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735455872 00000100:00100000:1.0:1788528404.675095:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735456384 00000100:00100000:1.0:1788528404.675097:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735456384 00000100:00100000:1.0:1788528404.675108:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735456896 00000100:00100000:1.0:1788528404.675110:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735456896 00000100:00100000:1.0:1788528404.675120:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788528404.675125:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735456000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528404.675149:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735456000:12345-0@lo:400:kworker.0 Request processed in 24us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528404.675154:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788528404.675170:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788528404.675176:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735455872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528404.675207:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735455872:12345-0@lo:400:kworker.0 Request processed in 32us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528404.675212:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788528404.675221:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788528404.675226:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875407735456384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528404.675265:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875407735456384:12345-0@lo:400:kworker.0 Request processed in 39us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528404.675270:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788528404.675280:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788528404.675286:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735456896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528404.675309:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735456896:12345-0@lo:400:kworker.0 Request processed in 24us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528404.675314:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:1.0:1788528404.675331:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788528404.675334:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788528404.675383:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735456256:0@lo:400:kworker.0 00000100:00100000:1.0:1788528404.675395:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1875407735456768:0@lo:400:kworker.0 00010000:00080000:1.0:1788528404.675407:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa4e680 x1875407735455616/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528404.675422:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735455616:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788528404.675431:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa4d500 x1875407735456640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528404.675450:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735456640:0@lo:400:kworker.0 00000100:00100000:1.0:1788528404.675482:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735455872:0@lo:400:kworker.0 00010000:00080000:1.0:1788528404.675490:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa4c000 x1875407735456384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528404.675497:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1875407735456384:0@lo:400:kworker.0 00010000:00080000:1.0:1788528404.675504:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc327f800 x1875407735456896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528404.675511:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735456896:0@lo:400:kworker.0 00000100:00100000:1.0:1788528404.675518:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735456000:0@lo:400:kworker.0 00010000:00080000:1.0:1788528404.675526:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa4ed80 x1875407735456512/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528404.675534:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735456512:0@lo:400:kworker.0 00010000:00080000:1.0:1788528404.675542:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc327fb80 x1875407735457024/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528404.675548:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735457024:0@lo:400:kworker.0 00000100:00100000:1.0:1788528404.675817:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735455744 00000100:00100000:1.0:1788528404.675822:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735455744 00000100:00100000:1.0:1788528404.675847:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788528404.675852:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735455744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528404.675885:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735455744:12345-0@lo:400:kworker.0 Request processed in 33us (1854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528404.675899:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788528404.676036:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735455744:0@lo:400:kworker.0 00000001:00100000:1.0:1788528404.676819:0:8416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689 00000020:00000080:1.0:1788528404.676824:0:8416:0:(genops.c:885:class_export_put()) final put ffff8a8fc3d0d000/287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689 00000020:00000080:1.0:1788528404.676844:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3d0d000/287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689 for lustre-OST0000 00000020:00000080:1.0:1788528404.676883:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc3d0e000 for lustre-OST0000 00000100:00100000:0.0:1788528404.677732:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735456128 00000100:00100000:0.0:1788528404.677741:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735456128 00000100:00100000:2.0:1788528404.677925:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735455488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788528404.679186:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788528404.679197:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735456128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528404.679530:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735456128:12345-0@lo:400:kworker.0 Request processed in 334us (6569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528404.679537:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788528404.679654:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735456128:0@lo:400:kworker.0 00000001:00100000:1.0:1788528404.685433:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689 00000020:00000080:1.0:1788528404.685444:0:9506:0:(genops.c:885:class_export_put()) final put ffff8a8fc3d0d800/287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689 00000020:00000080:3.0:1788528404.686155:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3d0d800/287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689 for lustre-OST0001 00000020:00000080:3.0:1788528404.686203:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc3d0b800 for lustre-OST0001 00010000:00010000:1.0:1788528405.630822:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528405.695715:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735457152:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788528405.695788:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528405.697133:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735457152 00000100:00100000:2.0:1788528405.697145:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735457152 00000100:00100000:2.0:1788528405.697199:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788528405.697208:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735457152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788528405.697360:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528405.697431:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735457152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 223us (1642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528405.697438:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:0.0:1788528405.697489:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3e54700 x1875407735457152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528405.697508:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735457152:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788528405.699975:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735457280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788528405.700040:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528405.700131:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735457280 00000100:00100000:0.0:1788528405.700138:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735457280 00000100:00100000:0.0:1788528405.700182:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788528405.700191:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735457280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788528405.700209:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528405.700249:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735457280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528405.700255:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:0.0:1788528405.700288:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6fedc00 x1875407735457280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528405.700308:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735457280:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1788528406.399996:0:13176:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee2766230 20000000:00000080:3.0:1788528406.400023:0:13176:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a8fc37d0c00 uarg=0000000000000000 20000000:01000000:3.0:1788528406.400078:0:13176:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788528406.400086:0:13176:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788528406.400092:0:13176:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788528406.400995:0:13177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788528406.401154:0:13176:0:(mgs_llog.c:1456:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788528406.412999:0:13176:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788528406.413138:0:13176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7b11 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528406.413158:0:13176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7a9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbb1 expref: 13 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528406.413181:0:13176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9101850000/0x892c60dda91c7aa8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7aa1 expref: 26 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528406.413188:0:13176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90f6e16800/0x892c60dda91c7ab6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7aaf expref: 26 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528406.413194:0:13176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90f6e17200/0x892c60dda91c7ac4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7abd expref: 26 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528406.413200:0:13176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90f6e16200/0x892c60dda91c7ad2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7acb expref: 26 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528406.413208:0:13176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a8fc26e3600/0x892c60dda91c7aee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbf7 expref: 13 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528406.413215:0:13176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7b11 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528406.413257:0:13176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a8fc26e3600/0x892c60dda91c7aee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbf7 expref: 13 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528406.413272:0:13176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a8fc26e3600/0x892c60dda91c7aee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbf7 expref: 13 pid: 6502 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528406.413286:0:13176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875407735457408:192.168.203.38@tcp:104: 00010000:00010000:0.0:1788528406.413449:0:13176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90f6e16200/0x892c60dda91c7ad2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c7acb expref: 26 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528406.413458:0:13176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a90f6e16200/0x892c60dda91c7ad2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c7acb expref: 26 pid: 6501 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528406.413475:0:13176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c61c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875407735457536:0@lo:104: 00000100:00100000:0.0:1788528406.413523:0:13176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528406.413590:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735457536 00000100:00100000:2.0:1788528406.413606:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735457536 00000100:00100000:2.0:1788528406.413689:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788528406.413701:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+3:13176:x1875407735457536:12345-0@lo:104: 00010000:00010000:2.0:1788528406.413737:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c7acb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7ad2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528406.414086:0:13176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90f6e17200/0x892c60dda91c7ac4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c7abd expref: 26 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528406.414096:0:13176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a90f6e17200/0x892c60dda91c7ac4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c7abd expref: 26 pid: 6502 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528406.414106:0:13176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c61500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875407735457664:0@lo:104: 00010000:00010000:2.0:1788528406.415290:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788528406.415307:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd052447-840d-4bcc-891b-140c465c7625+3:13176:x1875407735457536:12345-0@lo:104: Request processed in 1605us (1780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528406.415318:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:1.0:1788528406.415583:0:8438:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528406.415594:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c7acb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7ad2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528406.415604:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17c00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528406.415609:0:8438:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c7acb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c7ad2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528406.415620:0:8438:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c7acb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c7ad2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528406.415627:0:8438:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c7acb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c7ad2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528406.415633:0:8438:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788528406.415688:0:8438:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c7acb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7ad2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528406.415695:0:8438:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528406.415726:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c7acb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7ad2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528406.415733:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17c00/0x892c60dda91c7acb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7ad2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528406.415747:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528406.415749:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528406.415750:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528406.415766:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735457792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528406.415811:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528406.415967:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735457792 00000100:00100000:2.0:1788528406.415977:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735457792 00010000:00010000:2.0:1788528406.416075:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90f6e16200/0x892c60dda91c7ad2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7acb expref: 27 pid: 6501 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528406.416115:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788528406.416124:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+27:3639:x1875407735457792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788528406.416140:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528406.416147:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90f6e16200/0x892c60dda91c7ad2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7acb expref: 27 pid: 6501 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.416158:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90f6e16200/0x892c60dda91c7ad2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c7acb expref: 27 pid: 6501 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.416181:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528406.416228:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+27:3639:x1875407735457792:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528406.416235:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788528406.416628:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735457792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788528406.418618:0:13176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788528406.418679:0:13176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90f6e16800/0x892c60dda91c7ab6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c7aaf expref: 26 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528406.418695:0:13176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a90f6e16800/0x892c60dda91c7ab6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c7aaf expref: 26 pid: 6502 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528406.418709:0:13176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c63480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875407735457920:0@lo:104: 00000100:00100000:0.0:1788528406.418736:0:13176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788528406.418753:0:13176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9101850000/0x892c60dda91c7aa8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c7aa1 expref: 26 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528406.418761:0:13176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9101850000/0x892c60dda91c7aa8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c7aa1 expref: 26 pid: 6500 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528406.418769:0:13176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c62a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875407735458048:0@lo:104: 00000100:00100000:0.0:1788528406.418784:0:13176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788528406.418804:0:13176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7a9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbb1 expref: 13 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528406.418828:0:13176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7a9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbb1 expref: 13 pid: 6500 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528406.418838:0:13176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c60000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875407735458176:192.168.203.38@tcp:104: 00000100:00100000:0.0:1788528406.418872:0:13176:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3eef180 going to sleep for 11 seconds 00010000:00010000:0.0:1788528406.418892:0:13176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90f6e16200/0x892c60dda91c7ad2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c7acb expref: 26 pid: 6501 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528406.418905:0:13176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c61c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875407735457536:0@lo:104: 00000100:00100000:2.0:1788528406.419139:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735457664 00000100:00100000:2.0:1788528406.419145:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735457664 00000100:00100000:2.0:1788528406.419180:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735457920 00000100:00100000:2.0:1788528406.419183:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735457920 00000100:00100000:2.0:1788528406.419204:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735458048 00000100:00100000:2.0:1788528406.419206:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735458048 00000100:00100000:2.0:1788528406.419219:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788528406.419227:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+5:13176:x1875407735457664:12345-0@lo:104: 00010000:00010000:2.0:1788528406.419241:0:6491:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c7abd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7ac4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.419308:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788528406.419315:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+5:13176:x1875407735457664:12345-0@lo:104: Request processed in 88us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528406.419322:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788528406.419338:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788528406.419344:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+4:13176:x1875407735457920:12345-0@lo:104: 00010000:00010000:2.0:1788528406.419352:0:6491:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a9101851800/0x892c60dda91c7aaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7ab6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.419396:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788528406.419401:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+4:13176:x1875407735457920:12345-0@lo:104: Request processed in 58us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528406.419407:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788528406.419418:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788528406.419424:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+3:13176:x1875407735458048:12345-0@lo:104: 00010000:00010000:2.0:1788528406.419432:0:6491:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16600/0x892c60dda91c7aa1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7aa8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.419464:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788528406.419469:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd052447-840d-4bcc-891b-140c465c7625+3:13176:x1875407735458048:12345-0@lo:104: Request processed in 46us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528406.419484:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:2.0:1788528406.419503:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788528406.419508:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c7abd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7ac4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.419515:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17800 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:2.0:1788528406.419519:0:8440:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c7abd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c7ac4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.419528:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c7abd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c7ac4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788528406.419535:0:8440:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c7abd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c7ac4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528406.419575:0:8440:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788528406.419604:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c7abd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7ac4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.419611:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788528406.419624:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c7abd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7ac4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.419630:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17800/0x892c60dda91c7abd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7ac4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.419639:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788528406.419642:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a9101851800/0x892c60dda91c7aaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7ab6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.419656:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101851800 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:2.0:1788528406.419660:0:8440:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a9101851800/0x892c60dda91c7aaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c7ab6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.419665:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a9101851800/0x892c60dda91c7aaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c7ab6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788528406.419670:0:8440:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a9101851800/0x892c60dda91c7aaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c7ab6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528406.419675:0:8440:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788528406.419688:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a9101851800/0x892c60dda91c7aaf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7ab6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.419693:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788528406.419708:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a9101851800/0x892c60dda91c7aaf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7ab6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.419714:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a9101851800/0x892c60dda91c7aaf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7ab6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.419723:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788528406.419727:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16600/0x892c60dda91c7aa1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7aa8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.419732:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16600 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:2.0:1788528406.419735:0:8440:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16600/0x892c60dda91c7aa1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c7aa8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.419752:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16600/0x892c60dda91c7aa1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c7aa8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788528406.419759:0:8440:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16600/0x892c60dda91c7aa1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c7aa8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528406.419764:0:8440:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788528406.419778:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16600/0x892c60dda91c7aa1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7aa8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.419784:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788528406.419790:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16600/0x892c60dda91c7aa1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7aa8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.419796:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16600/0x892c60dda91c7aa1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7aa8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.419808:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528406.419810:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528406.419812:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528406.419823:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735458432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788528406.419852:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528406.419874:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788528406.419879:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735458560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788528406.419899:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788528406.420049:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528406.420056:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528406.420065:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735458432 00000100:00100000:1.0:1788528406.420070:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735458432 00010000:00010000:1.0:1788528406.420092:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90f6e16800/0x892c60dda91c7ab6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7aaf expref: 26 pid: 6502 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528406.420120:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735458560 00000100:00100000:1.0:1788528406.420123:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735458560 00010000:00010000:1.0:1788528406.420134:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9101850000/0x892c60dda91c7aa8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7aa1 expref: 27 pid: 6500 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528406.420152:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788528406.420158:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735458432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788528406.420179:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528406.420185:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90f6e16800/0x892c60dda91c7ab6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7aaf expref: 27 pid: 6502 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528406.420195:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90f6e16800/0x892c60dda91c7ab6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c7aaf expref: 27 pid: 6502 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528406.420211:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528406.420244:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735458432:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528406.420252:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788528406.420267:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788528406.420273:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90efa85050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd052447-840d-4bcc-891b-140c465c7625+26:3637:x1875407735458560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788528406.420279:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528406.420283:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9101850000/0x892c60dda91c7aa8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7aa1 expref: 26 pid: 6500 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528406.420290:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9101850000/0x892c60dda91c7aa8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c7aa1 expref: 26 pid: 6500 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528406.420300:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528406.420320:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90efa85050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd052447-840d-4bcc-891b-140c465c7625+26:3637:x1875407735458560:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528406.420326:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788528406.420384:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735458304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528406.420408:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528406.420437:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735458304 00000100:00100000:1.0:1788528406.420441:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735458304 00010000:00010000:1.0:1788528406.420461:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90f6e17200/0x892c60dda91c7ac4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7abd expref: 26 pid: 6502 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528406.420481:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788528406.420487:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+26:3640:x1875407735458304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788528406.420493:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528406.420496:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90f6e17200/0x892c60dda91c7ac4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7abd expref: 26 pid: 6502 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528406.420505:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90f6e17200/0x892c60dda91c7ac4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c7abd expref: 26 pid: 6502 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528406.420513:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528406.420539:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd052447-840d-4bcc-891b-140c465c7625+26:3640:x1875407735458304:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528406.420544:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788528406.420594:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735458304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528406.420617:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735458560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528406.420625:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735458432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528406.421059:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528406.421887:0:13176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875407735457408:192.168.203.38@tcp:104: 00010000:00010000:0.0:1788528406.421904:0:13176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90f6e17200/0x892c60dda91c7ac4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c7abd expref: 25 pid: 6502 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528406.421918:0:13176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c61500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875407735457664:0@lo:104: 00010000:00010000:0.0:1788528406.421928:0:13176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90f6e16800/0x892c60dda91c7ab6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c7aaf expref: 24 pid: 6502 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528406.421943:0:13176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c63480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875407735457920:0@lo:104: 00000100:00100000:2.0:1788528406.422056:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719647104 00000100:00100000:2.0:1788528406.422062:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719647104 00010000:00010000:2.0:1788528406.422090:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a8fc26e3600/0x892c60dda91c7aee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbf7 expref: 14 pid: 6502 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528406.422175:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 50 00000100:00100000:2.0:1788528406.422184:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2403:x1875407719647104:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528406.422196:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528406.422201:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a8fc26e3600/0x892c60dda91c7aee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbf7 expref: 14 pid: 6502 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.422211:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a8fc26e3600/0x892c60dda91c7aee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbf7 expref: 14 pid: 6502 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.422227:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc26e3600/0x892c60dda91c7aee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbf7 expref: 14 pid: 6502 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.422237:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528406.422282:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+13:2403:x1875407719647104:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 100us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528406.422289:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 50 00010000:00010000:0.0:1788528406.422331:0:13176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101850000/0x892c60dda91c7aa8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c7aa1 expref: 23 pid: 6500 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528406.422341:0:13176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c62a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875407735458048:0@lo:104: 00000100:00100000:1.0:1788528406.426848:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528406.426933:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719647232 00000100:00100000:2.0:1788528406.426950:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719647232 00010000:00010000:2.0:1788528406.426988:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7a9a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbb1 expref: 13 pid: 6500 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528406.427029:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:2.0:1788528406.427038:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6feea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+13:2404:x1875407719647232:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528406.427053:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528406.427059:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7a9a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbb1 expref: 13 pid: 6500 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.427089:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7a9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbb1 expref: 13 pid: 6500 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.427110:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7b11 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.427120:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7b11 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.427134:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7b11 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.427140:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7b11 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.427148:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7b11 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.427155:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7b11 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.427162:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e3200 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528406.427166:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7b11 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.427174:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7b11 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.427183:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7b11 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528406.427202:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528406.427263:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6feea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+13:2404:x1875407719647232:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 224us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528406.427270:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 51 00010000:00010000:0.0:1788528406.427480:0:13176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7a9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbb1 expref: 12 pid: 6500 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528406.427494:0:13176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c60000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875407735458176:192.168.203.38@tcp:104: 00010000:00010000:0.0:1788528406.427538:0:13176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7b11 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528406.427851:0:13176:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7b11 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528406.427858:0:13176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7b11 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528406.427865:0:13176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c7b11 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528406.656753:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528406.724315:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735458688:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788528406.724393:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528406.724513:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735458688 00000100:00100000:0.0:1788528406.724523:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735458688 00000100:00100000:0.0:1788528406.724611:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788528406.724621:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735458688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788528406.724654:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:0.0:1788528406.725446:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735458688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 823us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528406.725456:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788528406.725549:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735458688:0@lo:41:osp-pre-1-0.0 10000000:01000000:1.0:1788528407.680597:0:6506:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:1.0:1788528407.680615:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a8fc1fe4800 from 7 10000000:01000000:1.0:1788528407.680619:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788528407.680661:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7b18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528407.680672:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7b18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528407.680683:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7b18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528407.680708:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735458816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788528407.680771:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528407.680821:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3ca83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528407.680891:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735458816 00000100:00100000:2.0:1788528407.680899:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735458816 00000100:00100000:2.0:1788528407.680952:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788528407.680961:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+23:6506:x1875407735458816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528407.680975:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528407.680988:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9101850600/0x892c60dda91c7b1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7b18 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528407.681011:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101850600/0x892c60dda91c7b1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7b18 expref: 24 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528407.681022:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9101850600/0x892c60dda91c7b1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7b18 expref: 24 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528407.681030:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101850600, rc 0) 00000100:00100000:2.0:1788528407.681081:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735458816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528407.681088:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1788528407.681164:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735458816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788528407.681180:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7b18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7b1f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528407.681189:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7b18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7b1f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788528407.681313:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 7 00000040:00080000:0.0:1788528407.681625:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788528407.681802:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788528407.681827:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 112 off8528 00000040:00080000:0.0:1788528407.681842:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 224 off8752 00000040:00080000:0.0:1788528407.681855:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8976 00000040:00080000:0.0:1788528407.681869:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 112 off9088 00000040:00080000:0.0:1788528407.681886:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 224 off9312 00000040:00080000:0.0:1788528407.681892:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 6 count 7 00000100:00100000:0.0:1788528407.681946:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c60000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735458944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788528407.681983:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528407.682009:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3eef6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528407.682081:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735458944 00000100:00100000:2.0:1788528407.682086:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735458944 00000100:00100000:2.0:1788528407.682124:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788528407.682132:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d9d54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735458944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528407.682231:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d9d54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735458944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528407.682245:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788528407.682502:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c60000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735458944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788528407.682531:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c60000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735459072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788528407.682593:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528407.682614:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3eef6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528407.682663:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735459072 00000100:00100000:2.0:1788528407.682668:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735459072 00000100:00100000:2.0:1788528407.682697:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1788528407.682703:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735459072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788528407.682785:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735459072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528407.682791:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1788528407.682891:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c60000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735459072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788528407.683218:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788528407.683273:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c60000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735459200:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788528407.683311:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528407.683342:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3eef6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528407.683458:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735459200 00000100:00100000:2.0:1788528407.683464:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735459200 00000100:00100000:2.0:1788528407.683501:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788528407.683508:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735459200:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788528407.683619:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735459200:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 111us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528407.683625:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788528407.683956:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c60000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735459200:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788528407.684270:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788528407.684301:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 112 off8528 00000040:00080000:1.0:1788528407.684316:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 224 off8752 00000040:00080000:1.0:1788528407.684332:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8976 00000040:00080000:1.0:1788528407.684348:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 112 off9088 00000100:00100000:1.0:1788528407.684391:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735459328:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788528407.684435:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528407.684472:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3ca8600 going to sleep for 11 seconds 00000100:00100000:2.0:1788528407.684530:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735459328 00000100:00100000:2.0:1788528407.684536:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735459328 00000100:00100000:2.0:1788528407.684615:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788528407.684623:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735459328:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788528407.684703:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735459328:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 81us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528407.684711:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1788528407.684805:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735459328:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788528407.684846:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 224 off9312 00000040:00080000:1.0:1788528407.684853:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000040:00080000:1.0:1788528407.686205:0:13201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 64768 count 7 00000100:00100000:1.0:1788528407.686656:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528407.686686:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719647360 00000100:00100000:1.0:1788528407.686694:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719647360 00000100:00100000:1.0:1788528407.686732:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 338 00000100:00100000:1.0:1788528407.686753:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+12:6172:x1875407719647360:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788528407.686768:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528407.686786:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90f6e17e00/0x892c60dda91c7b26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfc28 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528407.686814:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90f6e17e00/0x892c60dda91c7b26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc28 expref: 13 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528407.686826:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90f6e17e00/0x892c60dda91c7b26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc28 expref: 13 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528407.686836:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e17e00, rc 0) 00000100:00100000:1.0:1788528407.686883:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+13:6172:x1875407719647360:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 132us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528407.686891:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 338 00000020:01000000:2.0:1788528407.691461:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788528407.691485:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788528407.691497:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7b18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7b1f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528407.691529:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7b18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7b1f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528407.691545:0:6506:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:2.0:1788528407.691547:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a90fa76f800 from 7 10000000:01000000:2.0:1788528407.691550:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788528407.691610:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7b2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528407.691619:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7b2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528407.691630:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7b2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528407.691654:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735459456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788528407.691721:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528407.691760:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695180 going to sleep for 11 seconds 00000100:00100000:2.0:1788528407.691782:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735459456 00000100:00100000:2.0:1788528407.691790:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735459456 00000100:00100000:2.0:1788528407.691837:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1788528407.691846:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735459456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528407.691860:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528407.691872:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9101850800/0x892c60dda91c7b34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7b2d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528407.691894:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101850800/0x892c60dda91c7b34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7b2d expref: 25 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528407.691917:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9101850800/0x892c60dda91c7b34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7b2d expref: 25 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528407.691926:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101850800, rc 0) 00000100:00100000:2.0:1788528407.691964:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735459456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528407.691970:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1788528407.692017:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735459456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528407.692031:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7b2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7b34 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528407.692039:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7b2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7b34 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788528407.692413:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 7 count 7 00000040:00080000:2.0:1788528407.692750:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788528407.692899:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788528407.692920:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1788528407.692932:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1788528407.692946:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1788528407.692958:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1788528407.692973:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1788528407.692978:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 6 count 7 00000100:00100000:2.0:1788528407.693028:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735459584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528407.693068:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528407.693137:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695180 going to sleep for 11 seconds 00000100:00100000:1.0:1788528407.696530:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735459584 00000100:00100000:1.0:1788528407.696545:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735459584 00000100:00100000:1.0:1788528407.696621:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1788528407.696631:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735459584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788528407.696791:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735459584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (3723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528407.696799:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788528407.696984:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735459584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528407.697048:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735459712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788528407.697095:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528407.697133:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695180 going to sleep for 11 seconds 00000100:00100000:1.0:1788528407.697191:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735459712 00000100:00100000:1.0:1788528407.697195:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735459712 00000100:00100000:1.0:1788528407.697267:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788528407.697276:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735459712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788528407.697387:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735459712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528407.697401:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00010000:00010000:0.0:1788528407.697592:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528407.697658:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528407.706647:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719647488 00000100:00100000:2.0:1788528407.706663:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719647488 00000100:00100000:2.0:1788528407.706723:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 342 00000100:00100000:2.0:1788528407.706733:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+13:6172:x1875407719647488:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528407.706895:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+13:6172:x1875407719647488:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 163us (9238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528407.706904:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 342 00000100:00100000:2.0:1788528407.707864:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735459712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788528407.708285:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788528407.708387:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735459840:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788528407.708448:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528407.708489:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735459840 00000100:00100000:2.0:1788528407.708494:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735459840 00000100:00100000:2.0:1788528407.708524:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1788528407.708530:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735459840:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788528407.708632:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735459840:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 101us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528407.708639:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1788528407.708677:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695180 going to sleep for 11 seconds 00000100:00100000:2.0:1788528407.708691:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735459840:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788528407.708831:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788528407.708862:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1788528407.708875:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1788528407.708889:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1788528407.708902:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000100:00100000:2.0:1788528407.708924:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735459968:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788528407.708955:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528407.708976:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735459968 00000100:00100000:2.0:1788528407.708979:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735459968 00000100:00100000:2.0:1788528407.708997:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1788528407.709003:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735459968:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788528407.709058:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735459968:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 55us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528407.709065:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1788528407.709090:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc36e5000 going to sleep for 11 seconds 00000100:00100000:2.0:1788528407.709101:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735459968:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788528407.709134:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:2.0:1788528407.709843:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000040:00080000:2.0:1788528407.722000:0:13202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 64768 count 7 00000020:01000000:3.0:1788528407.722199:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788528407.722215:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788528407.722235:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7b2d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7b34 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528407.722248:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7b2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7b34 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528407.722266:0:6506:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:3.0:1788528407.722268:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a90f5add000 from 7 10000000:01000000:3.0:1788528407.722271:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788528407.722310:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c7b3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528407.722318:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c7b3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528407.722328:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c7b3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528407.722374:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735460096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788528407.722436:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528407.722635:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735460096 00000100:00100000:2.0:1788528407.722642:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735460096 00000100:00100000:2.0:1788528407.722679:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1788528407.722687:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735460096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528407.722699:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528407.722710:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9101850c00/0x892c60dda91c7b42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7b3b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528407.722732:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101850c00/0x892c60dda91c7b42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7b3b expref: 26 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528407.722753:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9101850c00/0x892c60dda91c7b42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7b3b expref: 26 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528407.722762:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101850c00, rc 0) 00000100:00100000:2.0:1788528407.722793:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735460096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528407.722799:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788528407.722931:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c5ade840 going to sleep for 11 seconds 00000100:00100000:3.0:1788528407.722952:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735460096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788528407.722965:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c7b3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7b42 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528407.722974:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c7b3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7b42 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788528407.723081:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 7 count 7 00000040:00080000:3.0:1788528407.723331:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788528407.723697:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].1, 224 off8416 00000040:00080000:3.0:1788528407.723721:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].2, 112 off8528 00000040:00080000:3.0:1788528407.723733:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].3, 224 off8752 00000040:00080000:3.0:1788528407.723744:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].4, 224 off8976 00000040:00080000:3.0:1788528407.723756:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].5, 112 off9088 00000040:00080000:3.0:1788528407.723770:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].6, 224 off9312 00000040:00080000:3.0:1788528407.723775:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 6 count 7 00000100:00100000:3.0:1788528407.723827:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735460224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528407.723860:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528407.723926:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c5ade840 going to sleep for 11 seconds 00000100:00100000:1.0:1788528407.724017:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528407.724116:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735460224 00000100:00100000:2.0:1788528407.724122:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735460224 00000100:00100000:2.0:1788528407.724165:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719647616 00000100:00100000:2.0:1788528407.724168:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719647616 00000100:00100000:2.0:1788528407.724182:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1788528407.724188:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735460224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528407.724297:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735460224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528407.724304:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1788528407.724327:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 347 00000100:00100000:2.0:1788528407.724333:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+13:6172:x1875407719647616:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788528407.724431:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+13:6172:x1875407719647616:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 Request processed in 96us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528407.724437:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 347 00000100:00100000:3.0:1788528407.726597:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735460224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528407.726652:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735460352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788528407.726713:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528407.726749:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c5ade840 going to sleep for 11 seconds 00000100:00100000:1.0:1788528407.726875:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735460352 00000100:00100000:1.0:1788528407.726881:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735460352 00000100:00100000:1.0:1788528407.726921:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788528407.726929:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735460352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788528407.727036:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735460352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528407.727044:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1788528407.727484:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735460352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788528407.727903:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788528407.727969:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735460480:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788528407.728014:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528407.728042:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c5ade840 going to sleep for 11 seconds 00000100:00100000:2.0:1788528407.728193:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735460480 00000100:00100000:2.0:1788528407.728199:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735460480 00000100:00100000:2.0:1788528407.728249:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1788528407.728257:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735460480:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788528407.728373:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735460480:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 99us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528407.728380:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1788528407.728527:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735460480:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788528407.728738:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].1, 224 off8416 00000040:00080000:3.0:1788528407.728764:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].2, 112 off8528 00000040:00080000:3.0:1788528407.728777:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].3, 224 off8752 00000040:00080000:3.0:1788528407.728789:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].4, 224 off8976 00000040:00080000:3.0:1788528407.728801:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].5, 112 off9088 00000100:00100000:3.0:1788528407.728822:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735460608:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788528407.728856:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528407.728878:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c5ade840 going to sleep for 11 seconds 00000100:00100000:2.0:1788528407.729006:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735460608 00000100:00100000:2.0:1788528407.729010:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735460608 00000100:00100000:2.0:1788528407.729043:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788528407.729050:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735460608:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788528407.729127:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735460608:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 77us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528407.729134:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788528407.729203:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735460608:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788528407.729255:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].6, 224 off9312 00000040:00080000:1.0:1788528407.729265:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000040:00080000:1.0:1788528407.730407:0:13204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 64768 count 7 00000020:01000000:2.0:1788528407.730691:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788528407.730703:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788528407.730713:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c7b3b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7b42 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528407.730724:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c7b3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7b42 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528407.730734:0:6506:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:2.0:1788528407.730737:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a90c7f88000 from 7 10000000:01000000:2.0:1788528407.730740:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788528407.730772:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7b49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528407.730780:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7b49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528407.730789:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7b49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528407.730824:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735460736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788528407.730871:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528407.730898:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d933c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528407.730942:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735460736 00000100:00100000:1.0:1788528407.730949:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735460736 00000100:00100000:1.0:1788528407.730990:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788528407.730998:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735460736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788528407.731008:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528407.731019:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90f6e17800/0x892c60dda91c7b50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7b49 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528407.731039:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90f6e17800/0x892c60dda91c7b50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7b49 expref: 27 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528407.731063:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90f6e17800/0x892c60dda91c7b50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7b49 expref: 27 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528407.731080:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e17800, rc 0) 00000100:00100000:1.0:1788528407.731111:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+27:6506:x1875407735460736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528407.731116:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788528407.731184:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735460736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528407.731198:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7b49 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7b50 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528407.731207:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7b49 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7b50 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528407.731247:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735460864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528407.731272:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528407.731291:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d933c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528407.731304:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735460864 00000100:00100000:2.0:1788528407.731307:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735460864 00000100:00100000:2.0:1788528407.731327:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788528407.731333:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:6506:x1875407735460864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528407.731436:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:6506:x1875407735460864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528407.731443:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788528407.731464:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735460864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528407.731648:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735460992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788528407.731687:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528407.731695:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d933c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528407.731716:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735460992 00000100:00100000:2.0:1788528407.731720:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735460992 00000100:00100000:2.0:1788528407.731736:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788528407.731741:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:6506:x1875407735460992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788528407.731811:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:6506:x1875407735460992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528407.731817:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788528407.731847:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735460992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788528407.733269:0:13205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788528407.733598:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788528407.733609:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788528407.733620:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7b49 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7b50 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528407.733631:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7b49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7b50 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528407.738521:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528407.748441:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719647744 00000100:00100000:2.0:1788528407.748454:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719647744 00000100:00100000:2.0:1788528407.748521:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 354 00000100:00100000:2.0:1788528407.748531:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+13:6172:x1875407719647744:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528407.748546:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528407.748580:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9101851800/0x892c60dda91c7b57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfc2f expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528407.748606:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101851800/0x892c60dda91c7b57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc2f expref: 14 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528407.748617:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9101851800/0x892c60dda91c7b57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc2f expref: 14 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528407.748627:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101851800, rc 0) 00000100:00100000:2.0:1788528407.748678:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:6172:x1875407719647744:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 148us (10166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528407.748685:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 354 00000100:00100000:0.0:1788528407.753270:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528407.755261:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719647872 00000100:00100000:3.0:1788528407.755275:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719647872 00000100:00100000:3.0:1788528407.755337:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 355 00000100:00100000:3.0:1788528407.755347:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:6172:x1875407719647872:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528407.756627:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:6172:x1875407719647872:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 1275us (3361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528407.756645:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 355 00000100:00100000:1.0:1788528407.759214:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528407.759537:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719648000 00000100:00100000:3.0:1788528407.759546:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719648000 00000100:00100000:3.0:1788528407.759624:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 356 00000100:00100000:3.0:1788528407.759633:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:6172:x1875407719648000:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788528407.759762:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:6172:x1875407719648000:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 Request processed in 129us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528407.759770:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 356 00010000:00010000:1.0:1788528408.705400:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528408.773877:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528408.773918:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528408.773953:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528408.773972:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528408.773997:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528408.774022:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719648256 00000100:00100000:1.0:1788528408.774030:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719648256 00000100:00100000:1.0:1788528408.774079:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719648512 00000100:00100000:1.0:1788528408.774082:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719648512 00000100:00100000:1.0:1788528408.774095:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719648384 00000100:00100000:1.0:1788528408.774097:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719648384 00000100:00100000:1.0:1788528408.774108:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719648640 00000100:00100000:1.0:1788528408.774109:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719648640 00000100:00100000:3.0:1788528408.775886:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 178 00000100:00100000:3.0:1788528408.775909:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2405:x1875407719648256:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528408.775998:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2405:x1875407719648256:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 99us (2139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528408.776006:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 178 00000100:00100000:3.0:1788528408.776031:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 179 00000100:00100000:3.0:1788528408.776038:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2405:x1875407719648512:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528408.776066:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2405:x1875407719648512:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (2147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528408.776072:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 179 00000100:00100000:3.0:1788528408.776086:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 180 00000100:00100000:3.0:1788528408.776093:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2405:x1875407719648384:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528408.776131:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2405:x1875407719648384:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 26us (2144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528408.776139:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 180 00000100:00100000:3.0:1788528408.776169:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 181 00000100:00100000:3.0:1788528408.776176:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2405:x1875407719648640:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528408.776203:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2405:x1875407719648640:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (2206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528408.776210:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 181 00000100:00100000:3.0:1788528408.776231:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719648128 00000100:00100000:3.0:1788528408.776237:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719648128 00000100:00100000:3.0:1788528408.776273:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 357 00000100:00100000:3.0:1788528408.776279:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2405:x1875407719648128:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528408.776303:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2405:x1875407719648128:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 23us (2349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528408.776309:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 357 00000100:00080000:1.0:1788528408.776955:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788528408.776960:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788528409.726728:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528409.791273:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735461120:0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.791353:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528409.791399:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735461632:0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.791427:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528409.791444:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735462144:0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.791467:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528409.791485:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735462656:0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.791505:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528409.791530:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788528409.791536:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735461504:0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.791591:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528409.791609:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735462016:0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.791645:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528409.791663:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735462528:0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.791683:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528409.791711:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735461248:0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.791734:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528409.791750:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735461760:0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.791769:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528409.791785:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1875407735462272:0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.791804:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528409.791821:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788528409.791827:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735461376:0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.791847:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528409.791863:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735461888:0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.791885:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528409.791896:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1875407735462400:0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.791915:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528409.791941:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735461120 00000100:00100000:3.0:1788528409.791947:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735461120 00000100:00100000:3.0:1788528409.791988:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788528409.791995:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+27:3640:x1875407735461120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.792035:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+27:3640:x1875407735461120:12345-0@lo:400:kworker.0 Request processed in 40us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528409.792042:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788528409.792069:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735462144 00000100:00100000:3.0:1788528409.792072:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735462144 00000100:00100000:3.0:1788528409.792102:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735462656 00000100:00100000:3.0:1788528409.792105:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735462656 00000100:00100000:3.0:1788528409.792114:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735462016 00000100:00100000:3.0:1788528409.792115:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735462016 00000100:00100000:3.0:1788528409.792124:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735462528 00000100:00100000:3.0:1788528409.792126:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735462528 00000100:00100000:3.0:1788528409.792136:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788528409.792141:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735462144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.792168:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735462144:12345-0@lo:400:kworker.0 Request processed in 26us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528409.792173:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788528409.792182:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788528409.792187:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735462656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.792206:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735462656:12345-0@lo:400:kworker.0 Request processed in 20us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528409.792212:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788528409.792220:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788528409.792224:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735462016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.792242:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735462016:12345-0@lo:400:kworker.0 Request processed in 18us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528409.792247:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788528409.792254:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788528409.792259:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735462528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.792276:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735462528:12345-0@lo:400:kworker.0 Request processed in 18us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528409.792281:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788528409.792298:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735461504 00000100:00100000:3.0:1788528409.792305:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735461504 00000100:00100000:3.0:1788528409.792320:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735461248 00000100:00100000:3.0:1788528409.792322:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735461248 00000100:00100000:3.0:1788528409.792330:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735461760 00000100:00100000:3.0:1788528409.792332:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735461760 00000100:00100000:3.0:1788528409.792353:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735462272 00000100:00100000:3.0:1788528409.792356:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735462272 00000100:00100000:3.0:1788528409.792365:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735461888 00000100:00100000:3.0:1788528409.792367:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735461888 00000100:00100000:3.0:1788528409.792376:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735462400 00000100:00100000:3.0:1788528409.792378:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735462400 00000100:00100000:3.0:1788528409.792388:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788528409.792393:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735461504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.792419:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735461504:12345-0@lo:400:kworker.0 Request processed in 26us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528409.792425:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788528409.792435:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788528409.792439:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735461248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.792461:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735461248:12345-0@lo:400:kworker.0 Request processed in 22us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528409.792466:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788528409.792474:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788528409.792479:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735461760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.792497:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735461760:12345-0@lo:400:kworker.0 Request processed in 18us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528409.792502:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788528409.792509:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788528409.792514:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875407735462272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.792542:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875407735462272:12345-0@lo:400:kworker.0 Request processed in 28us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528409.792548:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788528409.792576:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788528409.792581:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735461888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.792602:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735461888:12345-0@lo:400:kworker.0 Request processed in 21us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528409.792607:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788528409.792615:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788528409.792619:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875407735462400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.792636:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875407735462400:12345-0@lo:400:kworker.0 Request processed in 17us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528409.792642:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788528409.792667:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735461632 00000100:00100000:3.0:1788528409.792669:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735461632 00000100:00100000:3.0:1788528409.792686:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735461376 00000100:00100000:3.0:1788528409.792688:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735461376 00000100:00100000:3.0:1788528409.792697:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788528409.792702:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735461632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.792727:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735461632:12345-0@lo:400:kworker.0 Request processed in 26us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528409.792733:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788528409.792741:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788528409.792746:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735461376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.792764:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735461376:12345-0@lo:400:kworker.0 Request processed in 18us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528409.792777:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1788528409.792793:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788528409.792796:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788528409.792799:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788528409.792801:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788528409.792826:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735461376:0@lo:400:kworker.0 00010000:00080000:3.0:1788528409.792838:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc36f1180 x1875407735461888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528409.792848:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735461888:0@lo:400:kworker.0 00010000:00080000:3.0:1788528409.792856:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6da0380 x1875407735462400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528409.792863:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1875407735462400:0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.792872:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735461248:0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.792880:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735461760:0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.792888:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1875407735462272:0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.792921:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735461504:0@lo:400:kworker.0 00010000:00080000:3.0:1788528409.792931:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc36f3480 x1875407735462016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528409.792938:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735462016:0@lo:400:kworker.0 00010000:00080000:3.0:1788528409.792946:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6da3100 x1875407735462528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528409.792952:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735462528:0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.792969:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735461120:0@lo:400:kworker.0 00000100:00100000:3.0:1788528409.792978:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735461632:0@lo:400:kworker.0 00010000:00080000:3.0:1788528409.792987:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc36f0380 x1875407735462144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528409.792994:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735462144:0@lo:400:kworker.0 00010000:00080000:3.0:1788528409.793002:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6da3b80 x1875407735462656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528409.793023:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735462656:0@lo:400:kworker.0 00000100:00100000:2.0:1788528409.795235:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788528409.795252:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735462784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788528409.795306:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528409.795618:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735462912:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788528409.795643:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528409.795831:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735462784 00000100:00100000:0.0:1788528409.795838:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735462784 00000100:00100000:0.0:1788528409.795975:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735462912 00000100:00100000:0.0:1788528409.795978:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735462912 00000100:00100000:0.0:1788528409.796001:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788528409.796008:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735462784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788528409.796031:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528409.796070:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735462784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528409.796076:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788528409.796089:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788528409.796095:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735462912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788528409.796105:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528409.796128:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735462912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528409.796133:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788528409.796165:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735463040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788528409.796195:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528409.796223:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735463040 00000100:00100000:3.0:1788528409.796227:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735463040 00000100:00100000:3.0:1788528409.796255:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788528409.796261:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735463040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788528409.796283:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00010000:00080000:2.0:1788528409.796317:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f5a0c380 x1875407735462912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528409.796324:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735463040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528409.796329:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788528409.796335:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735462912:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788528409.796358:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3eb0700 x1875407735462784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528409.796370:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735462784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788528409.796436:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735463040:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1788528410.312184:0:13375:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788528410.750723:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528410.814834:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788528410.814870:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735463168:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788528410.814940:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528410.815229:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735463168 00000100:00100000:0.0:1788528410.815237:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735463168 00000100:00100000:0.0:1788528410.815293:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788528410.815303:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735463168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788528410.815339:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528410.815385:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735463168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528410.815392:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788528410.815537:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735463296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788528410.815586:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528410.815669:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735463296 00000100:00100000:1.0:1788528410.815674:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735463296 00000100:00100000:1.0:1788528410.815709:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788528410.815716:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735463296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788528410.815743:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528410.815781:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735463296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528410.815788:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:1.0:1788528410.815835:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa4dc00 x1875407735463296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528410.815853:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735463296:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788528410.816232:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3c60000 x1875407735463168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528410.816245:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735463168:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788528411.776197:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528411.839212:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788528411.844648:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735463424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788528411.844797:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528411.844990:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735463424 00000100:00100000:0.0:1788528411.844999:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735463424 00000100:00100000:0.0:1788528411.845052:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788528411.845069:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735463424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788528411.845104:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:0.0:1788528411.845151:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735463424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528411.845157:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788528411.845607:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735463424:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788528412.800101:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528413.824931:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528413.897779:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528413.897811:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528413.897845:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528413.897868:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528413.897939:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528413.898100:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719649024 00000100:00100000:2.0:1788528413.898110:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719649024 00000100:00100000:2.0:1788528413.898164:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719649280 00000100:00100000:2.0:1788528413.898168:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719649280 00000100:00100000:2.0:1788528413.898194:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719648896 00000100:00100000:2.0:1788528413.898196:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719648896 00000100:00100000:2.0:1788528413.898207:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719649152 00000100:00100000:2.0:1788528413.898218:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719649152 00000100:00100000:3.0:1788528413.898344:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719648768 00000100:00100000:3.0:1788528413.898349:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719648768 00000100:00100000:3.0:1788528413.898385:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 359 00000100:00100000:3.0:1788528413.898396:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2403:x1875407719648768:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528413.898466:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2403:x1875407719648768:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 71us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528413.898482:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 359 00000100:00080000:1.0:1788528413.898606:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788528413.898610:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788528413.898763:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 188 00000100:00100000:2.0:1788528413.898777:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719649024:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528413.898820:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719649024:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 48us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528413.901147:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 189 00000100:00100000:3.0:1788528413.901176:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719649280:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528413.901317:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 190 00000100:00100000:0.0:1788528413.901349:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2403:x1875407719648896:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528413.901638:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2403:x1875407719648896:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 304us (3769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528413.901648:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 190 00000100:00100000:0.0:1788528413.901687:0:8449:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788528413.901697:0:8449:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1788528413.901915:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 191 00000100:00100000:0.0:1788528413.901926:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719649152:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528413.901962:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719649152:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 39us (4022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528413.901969:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 191 00000100:00100000:3.0:1788528413.903393:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719649280:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 76us (3392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528413.903408:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 189 00000100:00100000:2.0:1788528413.905631:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 188 00010000:00010000:1.0:1788528414.846809:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528414.911719:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735463552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788528414.911796:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528414.911854:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735464064:0@lo:400:kworker.0 00000100:00100000:3.0:1788528414.911882:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528414.911908:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735464576:0@lo:400:kworker.0 00000100:00100000:3.0:1788528414.911932:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528414.911948:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735465088:0@lo:400:kworker.0 00000100:00100000:3.0:1788528414.911967:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528414.911997:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788528414.912003:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735463680:0@lo:400:kworker.0 00000100:00100000:3.0:1788528414.912028:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528414.912048:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735464192:0@lo:400:kworker.0 00000100:00100000:3.0:1788528414.912069:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528414.912085:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735464704:0@lo:400:kworker.0 00000100:00100000:3.0:1788528414.912103:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528414.912117:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735465216:0@lo:400:kworker.0 00000100:00100000:3.0:1788528414.912140:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528414.912177:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735463936:0@lo:400:kworker.0 00000100:00100000:3.0:1788528414.912200:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528414.912218:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735464448:0@lo:400:kworker.0 00000100:00100000:3.0:1788528414.912239:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528414.912255:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1875407735464960:0@lo:400:kworker.0 00000100:00100000:3.0:1788528414.912273:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528414.912289:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788528414.912294:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735463808:0@lo:400:kworker.0 00000100:00100000:3.0:1788528414.912326:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528414.912341:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735464320:0@lo:400:kworker.0 00000100:00100000:3.0:1788528414.912360:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528414.912376:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735464832:0@lo:400:kworker.0 00000100:00100000:3.0:1788528414.912394:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528414.912418:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735463552 00000100:00100000:3.0:1788528414.912572:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735463552 00000100:00100000:3.0:1788528414.912626:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788528414.912634:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735463552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788528414.912662:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788528414.912703:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735463552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528414.912709:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788528414.912731:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735464576 00000100:00100000:3.0:1788528414.912734:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735464576 00000100:00100000:3.0:1788528414.912751:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735465088 00000100:00100000:3.0:1788528414.912753:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735465088 00000100:00100000:3.0:1788528414.912825:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735464704 00000100:00100000:3.0:1788528414.912830:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735464704 00000100:00100000:3.0:1788528414.912853:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735465216 00000100:00100000:3.0:1788528414.912856:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735465216 00000100:00100000:3.0:1788528414.912865:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788528414.912870:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735464576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528414.912900:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735464576:12345-0@lo:400:kworker.0 Request processed in 30us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528414.912905:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788528414.912916:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788528414.912921:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735465088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528414.912941:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735465088:12345-0@lo:400:kworker.0 Request processed in 21us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528414.912946:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788528414.912955:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788528414.912960:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735464704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528414.912983:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735464704:12345-0@lo:400:kworker.0 Request processed in 23us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528414.912989:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788528414.912999:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788528414.913005:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735465216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528414.913034:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735465216:12345-0@lo:400:kworker.0 Request processed in 30us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528414.913040:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788528414.913062:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735463680 00000100:00100000:3.0:1788528414.913066:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735463680 00000100:00100000:0.0:1788528414.913077:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735464064 00000100:00100000:0.0:1788528414.913082:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735464064 00000100:00100000:3.0:1788528414.913087:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788528414.913092:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:3639:x1875407735463680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528414.913103:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735464448 00000100:00100000:0.0:1788528414.913105:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735464448 00000100:00100000:0.0:1788528414.913117:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735464960 00000100:00100000:0.0:1788528414.913119:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735464960 00000100:00100000:3.0:1788528414.913129:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:3639:x1875407735463680:12345-0@lo:400:kworker.0 Request processed in 36us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528414.913130:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735463808 00000100:00100000:0.0:1788528414.913132:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735463808 00000100:00100000:3.0:1788528414.913135:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788528414.913141:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735464320 00000100:00100000:0.0:1788528414.913149:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735464320 00000100:00100000:3.0:1788528414.913161:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735464192 00000100:00100000:0.0:1788528414.913163:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735464832 00000100:00100000:3.0:1788528414.913164:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735464192 00000100:00100000:0.0:1788528414.913164:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735464832 00000100:00100000:0.0:1788528414.913177:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788528414.913181:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735463936 00000100:00100000:0.0:1788528414.913182:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735464064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528414.913183:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735463936 00000100:00100000:3.0:1788528414.913193:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788528414.913198:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735464192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528414.913214:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735464064:12345-0@lo:400:kworker.0 Request processed in 32us (1332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528414.913220:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788528414.913222:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735464192:12345-0@lo:400:kworker.0 Request processed in 24us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528414.913228:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788528414.913231:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788528414.913236:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875407735464448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528414.913237:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788528414.913242:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735463936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528414.913266:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735463936:12345-0@lo:400:kworker.0 Request processed in 23us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528414.913266:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875407735464448:12345-0@lo:400:kworker.0 Request processed in 30us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528414.913272:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788528414.913273:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788528414.913283:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788528414.913288:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875407735464960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528414.913301:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788528414.913319:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735463808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528414.913326:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875407735464960:12345-0@lo:400:kworker.0 Request processed in 39us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528414.913332:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788528414.913343:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788528414.913344:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735463808:12345-0@lo:400:kworker.0 Request processed in 27us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528414.913348:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735464320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528414.913350:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788528414.913360:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788528414.913365:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735464832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528414.913389:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735464832:12345-0@lo:400:kworker.0 Request processed in 24us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528414.913401:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788528414.913584:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735465344:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788528414.913615:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528414.913644:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735464320:12345-0@lo:400:kworker.0 Request processed in 295us (1282us total) trans 0 rc 0/0 00000100:00080000:1.0:1788528414.913647:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788528414.913650:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:1.0:1788528414.913651:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788528414.913653:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788528414.913655:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788528414.913669:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735465344 00000100:00100000:0.0:1788528414.913672:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735465344 00000100:00100000:0.0:1788528414.913709:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788528414.913715:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735465344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788528414.913732:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528414.913764:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735465344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528414.913770:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:0.0:1788528414.913819:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa4d500 x1875407735465344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528414.913835:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735465344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788528414.913848:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788528414.913853:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735465472:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788528414.913877:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528414.913898:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735465472 00000100:00100000:0.0:1788528414.913901:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735465472 00000100:00100000:0.0:1788528414.913922:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788528414.913928:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735465472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788528414.913948:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788528414.913982:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735463680:0@lo:400:kworker.0 00000100:00100000:3.0:1788528414.913995:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735464192:0@lo:400:kworker.0 00000100:00100000:0.0:1788528414.913996:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735465472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528414.914001:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:3.0:1788528414.914006:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc36f1f80 x1875407735464704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528414.914015:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735464704:0@lo:400:kworker.0 00010000:00080000:3.0:1788528414.914024:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3c7c380 x1875407735465216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528414.914027:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735463808:0@lo:400:kworker.0 00000100:00100000:3.0:1788528414.914032:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735465216:0@lo:400:kworker.0 00000100:00100000:0.0:1788528414.914036:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735464320:0@lo:400:kworker.0 00010000:00080000:3.0:1788528414.914040:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f5a0dc00 x1875407735463552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528414.914044:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735464832:0@lo:400:kworker.0 00000100:00100000:3.0:1788528414.914050:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735463552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788528414.914053:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735463936:0@lo:400:kworker.0 00000100:00100000:3.0:1788528414.914058:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735464064:0@lo:400:kworker.0 00010000:00080000:0.0:1788528414.914061:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc36f3480 x1875407735464448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788528414.914067:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc36f0a80 x1875407735464576/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528414.914075:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735464576:0@lo:400:kworker.0 00000100:00100000:0.0:1788528414.914076:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735464448:0@lo:400:kworker.0 00010000:00080000:3.0:1788528414.914083:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3c7c700 x1875407735465088/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788528414.914087:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3c7df80 x1875407735464960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528414.914090:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735465088:0@lo:400:kworker.0 00000100:00100000:0.0:1788528414.914095:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1875407735464960:0@lo:400:kworker.0 00000100:00100000:1.0:1788528414.914171:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735465472:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1788528415.341019:0:13524:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 09:26:54 (1788528414) === 00000100:00100000:3.0:1788528415.568318:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528415.568361:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528415.568407:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719649408 00000100:00100000:3.0:1788528415.568419:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719649408 00000100:00100000:3.0:1788528415.568595:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:3.0:1788528415.568608:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2405:x1875407719649408:12345-192.168.203.38@tcp:41:mkdir.0 00000004:00000024:3.0:1788528415.568652:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788528415.568754:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2405:x1875407719649408:12345-192.168.203.38@tcp:41:mkdir.0 Request processed in 149us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528415.568761:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00080000:3.0:1788528415.568790:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788528415.571515:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719649536 00000100:00100000:0.0:1788528415.571538:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719649536 00000100:00100000:0.0:1788528415.572012:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:0.0:1788528415.572026:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:10497:x1875407719649536:12345-192.168.203.38@tcp:700:mkdir.0 00000100:00100000:0.0:1788528415.572143:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:10497:x1875407719649536:12345-192.168.203.38@tcp:700:mkdir.0 Request processed in 120us (3780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528415.572152:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:2.0:1788528415.583955:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528415.586258:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719649792 00000100:00100000:1.0:1788528415.586277:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719649792 00000100:00100000:1.0:1788528415.586370:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:1.0:1788528415.586382:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:10497:x1875407719649792:12345-192.168.203.38@tcp:36:mkdir.0 00010000:00010000:1.0:1788528415.586466:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528415.586614:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c79cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb9c expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.586636:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c3ab0100) 00010000:00010000:1.0:1788528415.586649:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788528415.586767:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c7b5e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.586783:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c7b5e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.586793:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c7b5e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.586822:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7b65 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.586830:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7b65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.586837:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7b65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.587852:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c7b6c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.587870:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c7b6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.587880:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c7b6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788528415.587899:0:6510:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000baa5c02c reply state 00000000dde85591 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c7b6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.587911:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c7b6c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.587919:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a90ca6c6a00) 00010000:00010000:1.0:1788528415.587922:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788528415.587926:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788528415.587933:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788528415.587941:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c7b5e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.587948:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c7b5e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.587955:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c7b5e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.587962:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17a00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528415.587968:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c7b5e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.587987:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c7b5e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.587997:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90ca6c6f00) 00010000:00010000:1.0:1788528415.588000:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528415.588004:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c7b5e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.588011:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c7b5e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788528415.588041:0:6510:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000baa5c02c reply state 00000000dde85591 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7b65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.588050:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7b65 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.588056:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a90ca6c6700) 00010000:00010000:1.0:1788528415.588058:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788528415.588061:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788528415.588886:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:10497:x1875407719649792:12345-192.168.203.38@tcp:36:mkdir.0 Request processed in 2496us (4935us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788528415.588898:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:0.0:1788528415.600790:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528415.601086:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719649920 00000100:00100000:2.0:1788528415.601101:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719649920 00000100:00100000:2.0:1788528415.601272:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:2.0:1788528415.601286:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:10498:x1875407719649920:12345-192.168.203.38@tcp:101:chmod.0 00010000:00010000:2.0:1788528415.601324:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528415.601355:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c7b73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfc36 expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.601691:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c7b7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.601710:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c7b7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.601724:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c7b7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528415.601784:0:13480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788528415.601789:0:13480:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788528415.601834:0:13480:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c7b7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.601867:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c7b73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc36 expref: 9 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.601904:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c7b7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc36 expref: 8 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.601914:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a8fc27f0400) 00010000:00010000:2.0:1788528415.601918:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788528415.601922:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101850400, rc 0) 00000100:00100000:2.0:1788528415.602000:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:10498:x1875407719649920:12345-192.168.203.38@tcp:101:chmod.0 Request processed in 717us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528415.602008:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:1.0:1788528415.605007:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528415.610465:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719650176 00000100:00100000:3.0:1788528415.610499:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719650176 00000100:00100000:3.0:1788528415.610612:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:3.0:1788528415.610627:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:10498:x1875407719650176:12345-192.168.203.38@tcp:36:chmod.0 00010000:00010000:3.0:1788528415.610702:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528415.610736:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c7b7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc36 expref: 8 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.610761:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a8fc27f0400) 00010000:00010000:3.0:1788528415.610775:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788528415.610810:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c7b81 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.610827:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c7b81 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.610839:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c7b81 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788528415.612026:0:6508:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eefd0460 reply state 0000000060d0dff0 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c7b81 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.612072:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c7b81 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.612081:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a8fc1faa500) 00010000:00010000:3.0:1788528415.612085:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788528415.612089:0:6508:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788528415.612104:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788528415.613090:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+9:10498:x1875407719650176:12345-192.168.203.38@tcp:36:chmod.0 Request processed in 2455us (8085us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788528415.613104:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:3.0:1788528415.670122:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528415.670624:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719650304 00000100:00100000:1.0:1788528415.670641:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719650304 00000100:00100000:1.0:1788528415.670723:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:1.0:1788528415.670736:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+9:10499:x1875407719650304:12345-192.168.203.38@tcp:101:chown.0 00010000:00010000:1.0:1788528415.670769:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528415.670813:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c7b88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfc3d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.670907:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c7b8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.670926:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c7b8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.670940:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c7b8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528415.670997:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788528415.671001:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788528415.671047:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c7b8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.671079:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c7b88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc3d expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.671114:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c7b8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc3d expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.671124:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a8fc1faa500) 00010000:00010000:1.0:1788528415.671128:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788528415.671132:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e16c00, rc 0) 00000100:00100000:1.0:1788528415.671235:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+10:10499:x1875407719650304:12345-192.168.203.38@tcp:101:chown.0 Request processed in 502us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528415.671243:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:0.0:1788528415.675540:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528415.675795:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719650432 00000100:00100000:2.0:1788528415.675809:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719650432 00000100:00100000:2.0:1788528415.675884:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:2.0:1788528415.675897:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+10:10499:x1875407719650432:12345-192.168.203.38@tcp:101:chown.0 00010000:00010000:2.0:1788528415.675923:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528415.675949:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c7b96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfc44 expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.676051:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c7b9d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.676069:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c7b9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.676083:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c7b9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.676187:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c7ba4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.676196:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c7ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.676204:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c7ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.676313:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c7bab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.676322:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c7bab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.676330:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c7bab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528415.676383:0:13480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788528415.676388:0:13480:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788528415.676414:0:13480:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c7bab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.676428:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c7b9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.676435:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c7b9d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.676442:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c7b9d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.676458:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101851000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528415.676463:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c7b9d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.676471:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c7b9d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.677378:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a8fc1faa500) 00010000:00010000:2.0:1788528415.677387:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528415.677396:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c7b9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.677406:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c7b9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.677426:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c7ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.677433:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c7ba4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.677440:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c7ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.677445:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528415.677448:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c7ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.677454:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c7ba4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.678186:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a90ca6c6700) 00010000:00010000:2.0:1788528415.678201:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528415.678208:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c7ba4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.678219:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c7ba4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.678289:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c7b96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc44 expref: 12 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.678320:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c7bab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc44 expref: 11 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.678339:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a90ca6c6a00) 00010000:00010000:2.0:1788528415.678343:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788528415.678346:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101850e00, rc 0) 00000100:00100000:2.0:1788528415.678458:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+11:10499:x1875407719650432:12345-192.168.203.38@tcp:101:chown.0 Request processed in 2561us (2930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528415.678470:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:2.0:1788528415.684434:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528415.688055:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719650560 00000100:00100000:1.0:1788528415.688101:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719650560 00000100:00100000:1.0:1788528415.688198:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:1.0:1788528415.688212:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+11:10499:x1875407719650560:12345-192.168.203.38@tcp:900:chown.0 00000100:00100000:1.0:1788528415.688352:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+11:10499:x1875407719650560:12345-192.168.203.38@tcp:900:chown.0 Request processed in 142us (3931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528415.688361:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:3.0:1788528415.691218:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528415.691418:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719650816 00000100:00100000:2.0:1788528415.691440:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719650816 00000100:00100000:2.0:1788528415.691516:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:2.0:1788528415.691528:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+11:10499:x1875407719650816:12345-192.168.203.38@tcp:36:chown.0 00010000:00010000:2.0:1788528415.691642:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528415.691677:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c7bab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc44 expref: 11 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.691717:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a90ca6c6a00) 00010000:00010000:2.0:1788528415.691724:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788528415.691756:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c7bb2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.691772:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c7bb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.691784:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c7bb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788528415.698129:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:0.0:1788528415.698242:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7b65 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788528415.698246:0:6508:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e894b387 reply state 000000009250c1df transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c7bb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528415.698267:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7b65 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528415.698278:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7b65 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.698279:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c7bb2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528415.698292:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528415.698308:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a90ca6c6a00) 00010000:00010000:0.0:1788528415.698310:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7b65 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.698314:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788528415.698322:0:6508:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788528415.698338:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788528415.698350:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7b65 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528415.698368:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a90ca6c6700) 00010000:00010000:0.0:1788528415.698371:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528415.698376:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7b65 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528415.698383:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7b65 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528415.698423:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c7b6c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528415.698431:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c7b6c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528415.698437:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c7b6c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528415.698444:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528415.698447:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c7b6c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528415.698454:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c7b6c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528415.698462:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a90ca6c6a00) 00010000:00010000:0.0:1788528415.698465:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528415.698468:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c7b6c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1788528415.698478:0:6508:0:(ldlm_lib.c:3496:target_send_reply()) Schedule reply immediately 00010000:00010000:0.0:1788528415.698487:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c7b6c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528415.698505:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c7b81 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528415.698512:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:10499:x1875407719650816:12345-192.168.203.38@tcp:36:chown.0 Request processed in 6978us (7300us total) trans 4294967301 rc 0/0 00010000:00010000:0.0:1788528415.698515:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c7b81 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528415.698528:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c7b81 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528415.698532:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 28 00010000:00010000:0.0:1788528415.698540:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528415.698543:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c7b81 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528415.698549:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c7b81 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528415.698596:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a8fc1faa500) 00010000:00010000:0.0:1788528415.698599:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788528415.698603:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c7b81 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528415.698609:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c7b81 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.698932:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c7bb2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.698941:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c7bb2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.698949:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c7bb2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.698955:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528415.698958:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c7bb2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.698964:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c7bb2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.698974:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a90ca6c6a00) 00010000:00010000:3.0:1788528415.698977:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788528415.698980:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c7bb2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.698998:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c7bb2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528415.729891:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528415.729989:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719650944 00000100:00100000:3.0:1788528415.730002:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719650944 00000100:00100000:3.0:1788528415.730074:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 29 00000100:00100000:3.0:1788528415.730086:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:10500:x1875407719650944:12345-192.168.203.38@tcp:101:touch.500 00010000:00010000:3.0:1788528415.730117:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528415.730144:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c7bb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfc4b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788528415.735310:0:6509:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 5089us 00010000:00010000:1.0:1788528415.747002:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17000/0x892c60dda91c7bc0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.747030:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17000/0x892c60dda91c7bc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.747045:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17000/0x892c60dda91c7bc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.747065:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c7bc7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.747073:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c7bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.747080:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c7bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.747245:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c7bce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.747253:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c7bce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.747260:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c7bce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528415.747319:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788528415.747324:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788528415.747372:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c7bce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.747386:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17000/0x892c60dda91c7bc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.747392:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17000/0x892c60dda91c7bc0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.747399:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17000/0x892c60dda91c7bc0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.747405:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528415.747410:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17000/0x892c60dda91c7bc0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.747417:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17000/0x892c60dda91c7bc0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.747431:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a8fc1faa500) 00010000:00010000:1.0:1788528415.747434:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528415.747440:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17000/0x892c60dda91c7bc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.747445:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17000/0x892c60dda91c7bc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.747468:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c7bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.747484:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c7bc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.747489:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c7bc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.747495:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528415.747498:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c7bc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.747504:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c7bc7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.747513:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a90ca6c6f00) 00010000:00010000:1.0:1788528415.747515:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528415.747518:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c7bc7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.747523:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c7bc7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.747609:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c7bb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc4b expref: 8 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.747627:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c7bce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc4b expref: 7 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.747635:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a90ca6c6900) 00010000:00010000:1.0:1788528415.747638:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788528415.747647:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e17c00, rc 0) 00000100:00100000:1.0:1788528415.747748:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:10500:x1875407719650944:12345-192.168.203.38@tcp:101:touch.500 Request processed in 17663us (17871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528415.747758:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 29 00000100:00100000:0.0:1788528415.750904:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528415.750998:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719651200 00000100:00100000:2.0:1788528415.751012:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719651200 00000100:00100000:2.0:1788528415.751091:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:2.0:1788528415.751103:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:10500:x1875407719651200:12345-192.168.203.38@tcp:101:touch.500 00010000:00010000:2.0:1788528415.751147:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528415.751174:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c7bd5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfc52 expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.751317:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c7bdc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.751335:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c7bdc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.751347:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c7bdc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.751684:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c7be3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.751708:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c7be3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.751722:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c7be3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788528415.752132:0:13480:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788528415.752282:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c7bea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.752293:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c7bea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.752315:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c7bea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.752651:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c7bdc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.752661:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c7bdc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.752668:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c7bdc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.752688:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528415.752865:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c7bdc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.752875:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c7bdc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.752889:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a90ca6c6900) 00010000:00010000:2.0:1788528415.752893:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528415.752898:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c7bdc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.752905:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c7bdc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788528415.752919:0:13480:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002005fb9d reply state 00000000af44bf73 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c7be3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.752931:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c7be3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.752937:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6a3bfed6 (ffff8a8fc27f0300) 00010000:00010000:2.0:1788528415.752947:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788528415.752950:0:13480:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788528415.752991:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c7bd5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc52 expref: 10 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.753008:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c7bea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc52 expref: 9 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.753016:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a8fc27f0700) 00010000:00010000:2.0:1788528415.753018:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788528415.753020:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101850000, rc 0) 00000100:00100000:2.0:1788528415.753099:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+10:10500:x1875407719651200:12345-192.168.203.38@tcp:101:touch.500 Request processed in 1998us (2210us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788528415.753108:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:0.0:1788528415.758467:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528415.758610:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719651456 00000100:00100000:2.0:1788528415.758624:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719651456 00000100:00100000:2.0:1788528415.758696:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 31 00000100:00100000:2.0:1788528415.758708:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc36f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+10:10500:x1875407719651456:12345-192.168.203.38@tcp:36:touch.500 00010000:00010000:2.0:1788528415.758786:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528415.758819:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c7bea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc52 expref: 10 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.758843:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a8fc27f0700) 00010000:00010000:2.0:1788528415.758855:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788528415.758945:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7bf8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.758960:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7bf8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.758978:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7bf8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788528415.759112:0:6508:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e3bf9c35 reply state 000000006c2d5126 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7bf8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.759127:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7bf8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.759133:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a8fc27f0c00) 00010000:00010000:2.0:1788528415.759136:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788528415.759139:0:6508:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788528415.759248:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc36f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+11:10500:x1875407719651456:12345-192.168.203.38@tcp:36:touch.500 Request processed in 542us (796us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788528415.759256:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 31 00000100:00100000:0.0:1788528415.766015:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528415.766424:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719651584 00000100:00100000:1.0:1788528415.766436:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719651584 00000100:00100000:1.0:1788528415.766520:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 32 00000100:00100000:1.0:1788528415.766533:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc36f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+11:10500:x1875407719651584:12345-192.168.203.38@tcp:101:touch.500 00010000:00010000:1.0:1788528415.766718:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528415.766805:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17000/0x892c60dda91c7bff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfc59 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.766884:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17000/0x892c60dda91c7bff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc59 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.766900:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17000/0x892c60dda91c7bff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc59 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.766923:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a8fc27f0c00) 00010000:00010000:1.0:1788528415.766926:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788528415.766931:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e17000, rc 0) 00000100:00100000:1.0:1788528415.767041:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc36f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+12:10500:x1875407719651584:12345-192.168.203.38@tcp:101:touch.500 Request processed in 510us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528415.767049:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 32 00000100:00100000:1.0:1788528415.769703:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528415.769845:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719651712 00000100:00100000:3.0:1788528415.769858:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719651712 00000100:00100000:3.0:1788528415.769915:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:3.0:1788528415.769925:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2402:x1875407719651712:12345-192.168.203.38@tcp:8:touch.500 00010000:00080000:3.0:1788528415.769975:0:8725:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from 80304108-f3b9-46ea-888c-b2a7ec20e3e2@192.168.203.38@tcp t0 exp 0000000000000000 cur 284 last 0 00000020:00000080:3.0:1788528415.770012:0:8725:0:(genops.c:1385:class_connect()) connect: client 80304108-f3b9-46ea-888c-b2a7ec20e3e2, cookie 0x892c60dda91c7c06 00002000:00100000:3.0:1788528415.770027:0:8725:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 80304108-f3b9-46ea-888c-b2a7ec20e3e2/ffff8a8fc3d0b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788528415.770039:0:8725:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788528415.770141:0:8725:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788528415.770177:0:8725:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d0d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788528415.770274:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2402:x1875407719651712:12345-192.168.203.38@tcp:8:touch.500 Request processed in 349us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528415.770282:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:0.0:1788528415.776287:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528415.786410:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719651840 00000100:00100000:2.0:1788528415.786433:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719651840 00000100:00100000:2.0:1788528415.786541:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:2.0:1788528415.786570:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc36f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:0:x1875407719651840:12345-192.168.203.38@tcp:2:touch.500 00000100:00080000:3.0:1788528415.787261:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788528415.789014:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:2.0:1788528415.789035:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 80304108-f3b9-46ea-888c-b2a7ec20e3e2 00000100:00100000:3.0:1788528415.795322:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc36f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:0:x1875407719651840:12345-192.168.203.38@tcp:2:touch.500 Request processed in 8743us (19024us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788528415.795338:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:1.0:1788528415.804238:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528415.804360:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719652096 00000100:00100000:0.0:1788528415.804374:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719652096 00000100:00100000:0.0:1788528415.804460:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:0.0:1788528415.804473:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+12:10500:x1875407719652096:12345-192.168.203.38@tcp:35:touch.500 00000100:00100000:1.0:1788528415.805426:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+13:10500:x1875407719652096:12345-192.168.203.38@tcp:35:touch.500 Request processed in 939us (1186us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788528415.805458:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:1.0:1788528415.817412:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528415.817779:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719652224 00000100:00100000:2.0:1788528415.817790:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719652224 00000100:00100000:2.0:1788528415.817850:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:2.0:1788528415.817860:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+13:10501:x1875407719652224:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:2.0:1788528415.818052:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528415.818075:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b400/0x892c60dda91c7c0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfc60 expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528415.818266:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3e00/0x892c60dda91c7c14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528415.818290:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3e00/0x892c60dda91c7c14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528415.818316:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3e00/0x892c60dda91c7c14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788528415.818396:0:13480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788528415.818401:0:13480:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788528415.818454:0:13480:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3e00/0x892c60dda91c7c14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528415.818492:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b400/0x892c60dda91c7c0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc60 expref: 15 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528415.818517:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3e00/0x892c60dda91c7c14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc60 expref: 14 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528415.818527:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a90ca6c6900) 00010000:00010000:0.0:1788528415.818531:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788528415.818536:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e3e00, rc 0) 00000100:00100000:0.0:1788528415.818685:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+14:10501:x1875407719652224:12345-192.168.203.38@tcp:101:rm.0 Request processed in 825us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528415.818710:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:0.0:1788528415.825874:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528415.826022:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719652480 00000100:00100000:2.0:1788528415.826035:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719652480 00000100:00100000:2.0:1788528415.826120:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 34 00000100:00100000:2.0:1788528415.826131:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc36f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+14:10501:x1875407719652480:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:2.0:1788528415.826157:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528415.826181:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c7c1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfc67 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528415.826320:0:8449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788528415.827046:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c7c1b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc67 expref: 16 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.827065:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a8fc1faa500) 00010000:00010000:2.0:1788528415.827068:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788528415.827075:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c7c1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc67 expref: 16 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.827090:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3b800, rc 0) 00000100:00100000:2.0:1788528415.827185:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc36f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+15:10501:x1875407719652480:12345-192.168.203.38@tcp:101:rm.0 Request processed in 1055us (1326us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1788528415.827195:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 34 00000100:00100000:2.0:1788528415.839858:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528415.840199:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719652608 00000100:00100000:3.0:1788528415.840213:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719652608 00000100:00100000:3.0:1788528415.840287:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:3.0:1788528415.840309:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+15:10501:x1875407719652608:12345-192.168.203.38@tcp:37:rm.0 00000100:00100000:2.0:1788528415.848741:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+15:10501:x1875407719652608:12345-192.168.203.38@tcp:37:rm.0 Request processed in 8427us (8880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528415.848764:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:0.0:1788528415.861987:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528415.862131:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719652864 00000100:00100000:1.0:1788528415.862144:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719652864 00000100:00100000:1.0:1788528415.862226:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:1.0:1788528415.862238:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e15450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+15:10501:x1875407719652864:12345-192.168.203.38@tcp:35:rm.0 00000100:00100000:1.0:1788528415.862841:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e15450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+16:10501:x1875407719652864:12345-192.168.203.38@tcp:35:rm.0 Request processed in 602us (865us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788528415.862851:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4 00010000:00010000:1.0:1788528415.871108:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528415.872000:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528415.872103:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719653120 00000100:00100000:3.0:1788528415.872114:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719653120 00000100:00100000:3.0:1788528415.872198:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 35 00000100:00100000:3.0:1788528415.872210:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+16:10501:x1875407719653120:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:3.0:1788528415.872240:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528415.872266:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429a00/0x892c60dda91c7c29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfc6e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.872415:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c7c30 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.872446:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c7c30 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.872459:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c7c30 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528415.872472:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788528415.872652:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429a00/0x892c60dda91c7c29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc6e expref: 19 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.872701:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c7c30 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc6e expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.872712:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a90ca6c6900) 00010000:00010000:3.0:1788528415.872716:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788528415.872721:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3429400, rc 0) 00000100:00100000:3.0:1788528415.872790:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+18:10501:x1875407719653120:12345-192.168.203.38@tcp:101:rm.0 Request processed in 581us (799us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788528415.872799:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 35 00000100:00100000:0.0:1788528415.885262:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528415.885433:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719653248 00000100:00100000:2.0:1788528415.885446:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719653248 00000100:00100000:2.0:1788528415.885523:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:2.0:1788528415.885534:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc36f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+18:10501:x1875407719653248:12345-192.168.203.38@tcp:41:rm.0 00000004:00000024:2.0:1788528415.885642:0:13480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847026688 avail 7383982080 00000100:00100000:2.0:1788528415.885726:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc36f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+18:10501:x1875407719653248:12345-192.168.203.38@tcp:41:rm.0 Request processed in 193us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528415.885735:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:0.0:1788528415.890410:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528415.890667:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719653376 00000100:00100000:2.0:1788528415.890681:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719653376 00000100:00100000:2.0:1788528415.890756:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:2.0:1788528415.890768:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+18:10501:x1875407719653376:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:2.0:1788528415.890795:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528415.890821:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c7c3e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfc75 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.890902:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7c45 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.890920:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7c45 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.890933:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7c45 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.890945:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c7c4c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.890952:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c7c4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.890976:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c7c4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.891079:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b000/0x892c60dda91c7c53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.891087:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b000/0x892c60dda91c7c53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.891094:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b000/0x892c60dda91c7c53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528415.891134:0:8449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788528415.891139:0:8449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788528415.891160:0:8449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b000/0x892c60dda91c7c53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.891175:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b000/0x892c60dda91c7c53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.891183:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7c45 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.891189:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7c45 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.891196:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7c45 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.891201:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528415.891206:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7c45 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.891221:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7c45 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.891235:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a90ca6c6900) 00010000:00010000:2.0:1788528415.891238:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528415.891243:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7c45 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.891249:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7c45 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.891264:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c7c4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.891269:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c7c4c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.891274:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c7c4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.891279:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3ae00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528415.891281:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c7c4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.891287:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c7c4c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.891294:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6a3bfed6 (ffff8a8fc27f0300) 00010000:00010000:2.0:1788528415.891308:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528415.891311:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c7c4c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.891326:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c7c4c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.891370:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c7c3e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc75 expref: 20 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.891386:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b000/0x892c60dda91c7c53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc75 expref: 19 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.891394:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a8fc27f0c00) 00010000:00010000:2.0:1788528415.891397:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788528415.891400:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3b000, rc 0) 00000100:00100000:2.0:1788528415.892582:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+19:10501:x1875407719653376:12345-192.168.203.38@tcp:101:rm.0 Request processed in 1805us (2175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528415.892710:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:1.0:1788528415.900443:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528415.900534:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719653632 00000100:00100000:2.0:1788528415.900547:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719653632 00000100:00100000:2.0:1788528415.900661:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 38 00000100:00100000:2.0:1788528415.900676:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+19:10501:x1875407719653632:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1788528415.900758:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788528415.900791:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b000/0x892c60dda91c7c53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc75 expref: 19 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.900823:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17000/0x892c60dda91c7bff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc59 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.900872:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a8fc27f0c00) 00010000:00010000:2.0:1788528415.900887:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3e00/0x892c60dda91c7c14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc60 expref: 17 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.900901:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a90ca6c6900) 00010000:00010000:2.0:1788528415.900905:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788528415.900936:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c7c5a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.900951:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c7c5a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.900963:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c7c5a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.900978:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ac00/0x892c60dda91c7c61 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.900987:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ac00/0x892c60dda91c7c61 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.900994:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ac00/0x892c60dda91c7c61 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.901116:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b200/0x892c60dda91c7c68 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.901128:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b200/0x892c60dda91c7c68 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.901147:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b200/0x892c60dda91c7c68 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788528415.901469:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788528415.901481:0:6508:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 285118926572ns, next at 286118923795ns, rc = 0 00010000:00010000:2.0:1788528415.901795:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c7c6f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.901808:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c7c6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.901816:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c7c6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.901825:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c7c6f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.901832:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c7c6f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.901838:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c7c6f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.901954:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788528415.901983:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b200/0x892c60dda91c7c68 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.901990:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b200/0x892c60dda91c7c68 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.901997:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b200/0x892c60dda91c7c68 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.902012:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3b200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528415.902018:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b200/0x892c60dda91c7c68 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.902026:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b200/0x892c60dda91c7c68 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.902038:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a8fc27f0c00) 00010000:00010000:2.0:1788528415.902041:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788528415.902045:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b200/0x892c60dda91c7c68 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.902051:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b200/0x892c60dda91c7c68 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.902070:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c7c5a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.902075:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c7c5a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.902081:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c7c5a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.902086:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528415.902088:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c7c5a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.902094:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c7c5a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.902110:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a90ca6c6900) 00010000:00010000:2.0:1788528415.902112:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528415.902115:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c7c5a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.902121:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c7c5a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788528415.902132:0:6508:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000369390c2 reply state 00000000838c3fc3 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ac00/0x892c60dda91c7c61 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.902143:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ac00/0x892c60dda91c7c61 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528415.902149:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6a3bfed6 (ffff8a8fc27f0300) 00010000:00010000:2.0:1788528415.902151:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788528415.902154:0:6508:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788528415.902267:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+18:10501:x1875407719653632:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1592us (1848us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788528415.902276:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 38 00010000:00010000:1.0:1788528415.908178:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528415.908198:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c7c6f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.908212:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3b600 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528415.908217:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c7c6f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.908231:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c7c6f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.908255:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a8fc27f0c00) 00010000:00010000:1.0:1788528415.908259:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788528415.908264:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c7c6f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528415.908860:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528415.908952:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719653888 00000100:00100000:2.0:1788528415.908965:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719653888 00000100:00100000:2.0:1788528415.909040:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:2.0:1788528415.909052:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+18:10501:x1875407719653888:12345-192.168.203.38@tcp:35:rm.0 00000100:00100000:2.0:1788528415.909382:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+19:10501:x1875407719653888:12345-192.168.203.38@tcp:35:rm.0 Request processed in 331us (528us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788528415.909392:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5 00010000:00010000:1.0:1788528415.910869:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c7c6f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528415.910894:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528415.910896:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528415.910899:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528415.911942:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528415.912031:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719654144 00000100:00100000:3.0:1788528415.912044:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719654144 00000100:00100000:3.0:1788528415.912128:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:3.0:1788528415.912139:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+19:10501:x1875407719654144:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:3.0:1788528415.912224:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788528415.912258:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c7c30 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc6e expref: 19 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.912281:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c7bce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc4b expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.912314:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a90ca6c6900) 00010000:00010000:3.0:1788528415.912334:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c7b8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc3d expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.912345:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a8fc1faa500) 00010000:00010000:3.0:1788528415.912372:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788528415.912400:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429a00/0x892c60dda91c7c76 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.912415:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429a00/0x892c60dda91c7c76 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.912436:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429a00/0x892c60dda91c7c76 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.912449:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429c00/0x892c60dda91c7c7d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.912456:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429c00/0x892c60dda91c7c7d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.912462:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429c00/0x892c60dda91c7c7d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.912770:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c7c84 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.912780:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c7c84 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.912787:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c7c84 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528415.913077:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788528415.913096:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c7c84 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.913104:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c7c84 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.913118:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c7c84 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.913125:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3429800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528415.913129:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c7c84 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.913138:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c7c84 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.913149:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a8fc1fa8800) 00010000:00010000:3.0:1788528415.913153:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788528415.913157:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c7c84 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.913163:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c7c84 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.913183:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429a00/0x892c60dda91c7c76 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.913190:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429a00/0x892c60dda91c7c76 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.913195:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429a00/0x892c60dda91c7c76 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.913201:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3429a00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528415.913203:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429a00/0x892c60dda91c7c76 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.913219:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429a00/0x892c60dda91c7c76 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.913227:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a8fc1fa8400) 00010000:00010000:3.0:1788528415.913230:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528415.913233:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429a00/0x892c60dda91c7c76 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.913238:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429a00/0x892c60dda91c7c76 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788528415.913250:0:6510:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025a07a7f reply state 0000000018c6b2bd transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429c00/0x892c60dda91c7c7d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.913263:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429c00/0x892c60dda91c7c7d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528415.913269:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a8fc1fa8600) 00010000:00010000:3.0:1788528415.913271:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788528415.913274:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788528415.913662:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+18:10501:x1875407719654144:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1522us (1728us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788528415.913672:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:1.0:1788528415.934976:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788528415.935008:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735465600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788528415.935100:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528415.935201:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735465600 00000100:00100000:1.0:1788528415.935211:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735465600 00000100:00100000:1.0:1788528415.935271:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788528415.935283:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735465600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788528415.935335:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528415.935403:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735465600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528415.935411:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:2.0:1788528415.935607:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90fa8ad500 x1875407735465600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528415.935648:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735465600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788528415.936850:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735465728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788528415.936918:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528415.937029:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735465728 00000100:00100000:1.0:1788528415.937040:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735465728 00000100:00100000:1.0:1788528415.937098:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788528415.937109:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735465728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788528415.937132:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528415.937292:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735465728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 184us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528415.937310:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:2.0:1788528415.937403:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6fd4380 x1875407735465728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528415.937425:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735465728:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788528416.894890:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528416.961414:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735465856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788528416.961511:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528416.961977:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735465856 00000100:00100000:3.0:1788528416.961989:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735465856 00000100:00100000:3.0:1788528416.962059:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788528416.962070:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735465856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788528416.962122:0:9268:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788528416.962189:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735465856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528416.962197:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788528416.962258:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735465856:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788528417.918695:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528418.944791:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528419.014808:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528419.014852:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528419.014879:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528419.014907:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528419.014939:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528419.014960:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719654528 00000100:00100000:1.0:1788528419.014960:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719654784 00000100:00100000:1.0:1788528419.014977:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719654784 00000100:00100000:2.0:1788528419.014985:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719654528 00000100:00100000:0.0:1788528419.014992:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528419.015070:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719654272 00000100:00100000:3.0:1788528419.015081:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719654272 00000100:00100000:3.0:1788528419.015602:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 361 00000100:00100000:3.0:1788528419.015613:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2406:x1875407719654272:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528419.015678:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2406:x1875407719654272:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 67us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528419.015698:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 361 00000100:00100000:3.0:1788528419.015733:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719654656 00000100:00100000:3.0:1788528419.015737:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719654656 00000100:00100000:0.0:1788528419.018416:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719654400 00000100:00100000:2.0:1788528419.018429:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719654912 00000100:00100000:0.0:1788528419.018430:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719654400 00000100:00100000:2.0:1788528419.018444:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719654912 00000100:00100000:2.0:1788528419.018503:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 198 00000100:00100000:2.0:1788528419.018516:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2406:x1875407719654528:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528419.018584:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 199 00000100:00100000:0.0:1788528419.018596:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2406:x1875407719654912:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528419.018638:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2406:x1875407719654528:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 122us (3781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528419.018648:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 198 00000100:00100000:0.0:1788528419.018658:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2406:x1875407719654912:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 65us (3667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528419.018667:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 199 00000100:00100000:2.0:1788528419.018682:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 200 00000100:00100000:2.0:1788528419.018695:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+18:2406:x1875407719654400:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528419.019504:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+18:2406:x1875407719654400:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 807us (4590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528419.019517:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 200 00000100:00080000:2.0:1788528419.019597:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788528419.019605:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788528419.019608:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788528419.021632:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 201 00000100:00100000:1.0:1788528419.021656:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2406:x1875407719654784:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528419.021771:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2406:x1875407719654784:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 124us (6890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528419.021780:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 201 00000100:00100000:3.0:1788528419.022080:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 75 00000100:00100000:3.0:1788528419.022090:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2406:x1875407719654656:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528419.022128:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2406:x1875407719654656:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 40us (7189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528419.022135:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 75 00000001:02000400:3.0:1788528419.961379:0:13672:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1788528419.967701:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528420.030825:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:0.0:1788528420.030835:0:9980:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 289248280232ns, next at 290248277404ns, rc = 0 00000100:00100000:3.0:1788528420.030850:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735465984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788528420.030923:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528420.031307:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735465984 00000100:00100000:0.0:1788528420.031315:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735465984 00000100:00100000:0.0:1788528420.031368:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788528420.031378:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735465984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788528420.031420:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528420.031469:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735465984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528420.031475:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1788528420.031497:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788528420.031525:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6fd4700 x1875407735465984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528420.031544:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735465984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788528420.031776:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735466112:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788528420.031815:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528420.031856:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735466112 00000100:00100000:1.0:1788528420.031860:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735466112 00000100:00100000:1.0:1788528420.031896:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788528420.031903:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735466112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788528420.031915:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528420.031948:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735466112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528420.031954:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1788528420.031968:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788528420.031987:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa4d500 x1875407735466112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528420.032001:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735466112:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788528420.032354:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735466496:0@lo:400:kworker.0 00000100:00100000:0.0:1788528420.032384:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528420.032412:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788528420.032417:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735466368:0@lo:400:kworker.0 00000100:00100000:0.0:1788528420.032441:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528420.032741:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735466496 00000100:00100000:3.0:1788528420.032753:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735466496 00000100:00100000:3.0:1788528420.032791:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788528420.032797:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735466496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528420.032839:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735466496:12345-0@lo:400:kworker.0 Request processed in 42us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528420.032845:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788528420.032912:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735466496:0@lo:400:kworker.0 00000100:00100000:2.0:1788528420.033532:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735466368 00000100:00100000:2.0:1788528420.033544:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735466368 00000100:00100000:2.0:1788528420.033613:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788528420.033622:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735466368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528420.033666:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735466368:12345-0@lo:400:kworker.0 Request processed in 46us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528420.033672:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788528420.033762:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735467008:0@lo:400:kworker.0 00000100:00100000:0.0:1788528420.033798:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528420.033821:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735467520:0@lo:400:kworker.0 00000100:00100000:1.0:1788528420.033834:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735466240:0@lo:400:kworker.0 00000100:00100000:0.0:1788528420.033842:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528420.033878:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528420.033883:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735466368:0@lo:400:kworker.0 00000100:00100000:0.0:1788528420.033904:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788528420.033911:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735466880:0@lo:400:kworker.0 00000100:00100000:1.0:1788528420.033917:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735466752:0@lo:400:kworker.0 00000100:00100000:0.0:1788528420.033938:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528420.033953:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528420.033961:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735467392:0@lo:400:kworker.0 00000100:00100000:1.0:1788528420.033991:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735467264:0@lo:400:kworker.0 00000100:00100000:0.0:1788528420.033999:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528420.034029:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528420.034031:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735467008 00000100:00100000:0.0:1788528420.034035:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735467008 00000100:00100000:1.0:1788528420.034058:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788528420.034068:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735467520 00000100:00100000:0.0:1788528420.034071:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735467520 00000100:00100000:1.0:1788528420.034084:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735466624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788528420.034085:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735466752 00000100:00100000:0.0:1788528420.034090:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735466752 00000100:00100000:0.0:1788528420.034107:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788528420.034115:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735467008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528420.034123:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528420.034147:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1875407735467136:0@lo:400:kworker.0 00000100:00100000:0.0:1788528420.034161:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735467008:12345-0@lo:400:kworker.0 Request processed in 47us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528420.034169:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788528420.034177:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528420.034185:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735467136 00000100:00100000:0.0:1788528420.034190:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735467136 00000100:00100000:1.0:1788528420.034195:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735467648:0@lo:400:kworker.0 00000100:00100000:1.0:1788528420.034221:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528420.034225:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788528420.034233:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735467520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528420.034264:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735467520:12345-0@lo:400:kworker.0 Request processed in 32us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528420.034282:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788528420.034292:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735467648 00000100:00100000:0.0:1788528420.034295:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735467648 00000100:00100000:0.0:1788528420.034311:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788528420.034316:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735466752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528420.034348:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735466752:12345-0@lo:400:kworker.0 Request processed in 32us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528420.034353:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788528420.034365:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788528420.034371:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875407735467136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528420.034403:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875407735467136:12345-0@lo:400:kworker.0 Request processed in 33us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528420.034409:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788528420.034421:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788528420.034427:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735467648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528420.034452:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735467648:12345-0@lo:400:kworker.0 Request processed in 26us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528420.034458:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788528420.034478:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735466880 00000100:00100000:0.0:1788528420.034482:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735466880 00000100:00100000:0.0:1788528420.034501:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735466624 00000100:00100000:0.0:1788528420.034504:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735466624 00000100:00100000:0.0:1788528420.034517:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788528420.034522:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735466880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528420.034571:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735466880:12345-0@lo:400:kworker.0 Request processed in 30us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528420.034577:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788528420.034589:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788528420.034595:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735466624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788528420.034618:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788528420.034647:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735466624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528420.034653:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788528420.034671:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735467392 00000100:00100000:0.0:1788528420.034675:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735467392 00000100:00100000:0.0:1788528420.034699:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735467264 00000100:00100000:0.0:1788528420.034702:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735467264 00000100:00100000:0.0:1788528420.034732:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788528420.034738:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735467392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528420.034770:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735467392:12345-0@lo:400:kworker.0 Request processed in 33us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528420.034775:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788528420.034786:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788528420.034792:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735467264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528420.034817:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735467264:12345-0@lo:400:kworker.0 Request processed in 26us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528420.034822:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788528420.034853:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735466624:0@lo:41:osp-pre-0-1.0 00010000:00080000:0.0:1788528420.034865:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90faa0bb80 x1875407735467136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528420.034875:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1875407735467136:0@lo:400:kworker.0 00010000:00080000:0.0:1788528420.034884:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6f4b800 x1875407735467648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528420.034892:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735467648:0@lo:400:kworker.0 00000100:00100000:0.0:1788528420.034902:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735466752:0@lo:400:kworker.0 00010000:00080000:0.0:1788528420.034911:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa4d500 x1875407735467264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528420.034918:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735467264:0@lo:400:kworker.0 00000100:00080000:0.0:1788528420.034953:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788528420.034957:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788528420.034965:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788528420.034987:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735466880:0@lo:400:kworker.0 00010000:00080000:0.0:1788528420.034997:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6f48700 x1875407735467392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528420.035004:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735467392:0@lo:400:kworker.0 00000100:00100000:0.0:1788528420.035013:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735467008:0@lo:400:kworker.0 00000100:00100000:0.0:1788528420.035021:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735467520:0@lo:400:kworker.0 00000100:00100000:3.0:1788528420.035769:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735466240 00000100:00100000:3.0:1788528420.035777:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735466240 00000100:00100000:3.0:1788528420.035812:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1788528420.035819:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:3640:x1875407735466240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528420.036025:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735466240:0@lo:400:kworker.0 00000100:00100000:3.0:1788528420.036131:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:3640:x1875407735466240:12345-0@lo:400:kworker.0 Request processed in 49us (1990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528420.036141:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000020:00000080:2.0:1788528420.919876:0:13720:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe96eb5a30 20000000:00000080:2.0:1788528420.919900:0:13720:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a8fc35a7800 uarg=0000000000000000 20000000:01000000:2.0:1788528420.919956:0:13720:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788528420.919963:0:13720:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788528420.919970:0:13720:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788528420.921617:0:13721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788528420.921977:0:13720:0:(mgs_llog.c:4126:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788528420.934461:0:13720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788528420.934523:0:13720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788528420.934543:0:13720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788528420.934593:0:13720:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788528420.934616:0:13720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7c8b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528420.934636:0:13720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9101850600/0x892c60dda91c7b1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7b18 expref: 26 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528420.934648:0:13720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90f6e17e00/0x892c60dda91c7b26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc28 expref: 13 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528420.934655:0:13720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9101850800/0x892c60dda91c7b34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7b2d expref: 26 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528420.934662:0:13720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9101850c00/0x892c60dda91c7b42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7b3b expref: 26 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528420.934689:0:13720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90f6e17800/0x892c60dda91c7b50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7b49 expref: 26 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528420.934698:0:13720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9101851800/0x892c60dda91c7b57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc2f expref: 13 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528420.934707:0:13720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7c8b lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528420.934750:0:13720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9101851800/0x892c60dda91c7b57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc2f expref: 13 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528420.934767:0:13720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a9101851800/0x892c60dda91c7b57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc2f expref: 13 pid: 6500 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528420.934781:0:13720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc374fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875407735467776:192.168.203.38@tcp:104: 00010000:00010000:0.0:1788528420.935153:0:13720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90f6e17800/0x892c60dda91c7b50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c7b49 expref: 26 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528420.935166:0:13720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a90f6e17800/0x892c60dda91c7b50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c7b49 expref: 26 pid: 6501 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528420.935178:0:13720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc374e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875407735467904:0@lo:104: 00000100:00100000:0.0:1788528420.935212:0:13720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788528420.935250:0:13720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9101850c00/0x892c60dda91c7b42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c7b3b expref: 26 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528420.935258:0:13720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9101850c00/0x892c60dda91c7b42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c7b3b expref: 26 pid: 6502 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528420.935289:0:13720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc374c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875407735468032:0@lo:104: 00000100:00100000:0.0:1788528420.935314:0:13720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788528420.935335:0:13720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9101850800/0x892c60dda91c7b34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c7b2d expref: 26 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528420.935347:0:13720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9101850800/0x892c60dda91c7b34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c7b2d expref: 26 pid: 6502 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528420.935357:0:13720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc374e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875407735468160:0@lo:104: 00000100:00100000:2.0:1788528420.935373:0:8437:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1788528420.935400:0:13720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90f6e17e00/0x892c60dda91c7b26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc28 expref: 13 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528420.935413:0:13720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a90f6e17e00/0x892c60dda91c7b26 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc28 expref: 13 pid: 6500 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528420.935427:0:8437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528420.935444:0:13720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875407735468288:192.168.203.38@tcp:104: 00000100:00100000:2.0:1788528420.935533:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735467904 00000100:00100000:2.0:1788528420.935546:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735467904 00000100:00100000:2.0:1788528420.935749:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735468032 00000100:00100000:2.0:1788528420.935753:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735468032 00000100:00100000:2.0:1788528420.935764:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735468160 00000100:00100000:2.0:1788528420.935766:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735468160 00000100:00100000:2.0:1788528420.935780:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788528420.935789:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dd052447-840d-4bcc-891b-140c465c7625+5:13720:x1875407735467904:12345-0@lo:104: 00010000:00010000:2.0:1788528420.935811:0:8437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7b49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7b50 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528420.935885:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788528420.935892:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dd052447-840d-4bcc-891b-140c465c7625+5:13720:x1875407735467904:12345-0@lo:104: Request processed in 103us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528420.935898:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788528420.935926:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788528420.935931:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3dc3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dd052447-840d-4bcc-891b-140c465c7625+4:13720:x1875407735468032:12345-0@lo:104: 00010000:00010000:2.0:1788528420.935938:0:8437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c7b3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7b42 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528420.935968:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788528420.935972:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3dc3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dd052447-840d-4bcc-891b-140c465c7625+4:13720:x1875407735468032:12345-0@lo:104: Request processed in 42us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528420.935977:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788528420.936030:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788528420.936036:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dd052447-840d-4bcc-891b-140c465c7625+3:13720:x1875407735468160:12345-0@lo:104: 00010000:00010000:2.0:1788528420.936044:0:8437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7b2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7b34 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528420.936077:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788528420.936081:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dd052447-840d-4bcc-891b-140c465c7625+3:13720:x1875407735468160:12345-0@lo:104: Request processed in 46us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528420.936086:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:1.0:1788528420.936161:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788528420.936170:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7b49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7b50 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528420.936179:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850200 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528420.936184:0:6497:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7b49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c7b50 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528420.936193:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7b49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c7b50 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528420.936201:0:6497:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7b49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c7b50 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528420.936205:0:6497:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788528420.936253:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7b49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7b50 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528420.936259:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528420.936297:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7b49 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7b50 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528420.936316:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a9101850200/0x892c60dda91c7b49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7b50 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528420.936331:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788528420.936334:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c7b3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7b42 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528420.936340:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428200 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528420.936343:0:6497:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c7b3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c7b42 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528420.936349:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c7b3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c7b42 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528420.936356:0:6497:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c7b3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c7b42 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528420.936361:0:6497:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788528420.936398:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c7b3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7b42 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528420.936405:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528420.936423:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c7b3b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7b42 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528420.936431:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c7b3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7b42 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528420.936442:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528420.936451:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7b2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7b34 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528420.936458:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101851400 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528420.936461:0:6497:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7b2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c7b34 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528420.936469:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7b2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c7b34 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528420.936475:0:6497:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7b2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c7b34 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528420.936481:0:6497:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788528420.936495:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7b2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7b34 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528420.936500:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528420.936508:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7b2d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7b34 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528420.936513:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a9101851400/0x892c60dda91c7b2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7b34 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528420.936536:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528420.936538:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528420.936540:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528420.936548:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528420.936607:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735468416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528420.936664:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528420.936720:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735468544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528420.936748:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528420.936766:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788528420.936772:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735468672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528420.936790:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788528420.936936:0:13720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9101850600/0x892c60dda91c7b1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c7b18 expref: 26 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528420.936946:0:13720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9101850600/0x892c60dda91c7b1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c7b18 expref: 26 pid: 6501 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528420.936956:0:13720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875407735468800:0@lo:104: 00000100:00100000:0.0:1788528420.936982:0:13720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528420.936997:0:13720:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3ca8480 going to sleep for 11 seconds 00000100:00100000:0.0:1788528420.937016:0:13720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc374e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875407735467904:0@lo:104: 00000100:00100000:0.0:1788528420.937026:0:13720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc374c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875407735468032:0@lo:104: 00000100:00100000:0.0:1788528420.937043:0:13720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc374e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875407735468160:0@lo:104: 00000100:00100000:2.0:1788528420.938139:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735468800 00000100:00100000:2.0:1788528420.938151:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735468800 00000100:00100000:2.0:1788528420.938207:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788528420.938217:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dd052447-840d-4bcc-891b-140c465c7625+3:13720:x1875407735468800:12345-0@lo:104: 00010000:00010000:2.0:1788528420.938230:0:8437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7b18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7b1f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528420.938467:0:13720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc374fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875407735467776:192.168.203.38@tcp:104: 00000100:00100000:0.0:1788528420.938481:0:13720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875407735468288:192.168.203.38@tcp:104: 00000100:00100000:0.0:1788528420.938491:0:13720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875407735468800:0@lo:104: 00010000:00010000:0.0:1788528420.938540:0:13720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7c8b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528420.939417:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788528420.939428:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dd052447-840d-4bcc-891b-140c465c7625+3:13720:x1875407735468800:12345-0@lo:104: Request processed in 1211us (2443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528420.939453:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1788528420.939530:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528420.939544:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7b18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c7b1f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.939582:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16e00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:3.0:1788528420.939588:0:8440:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7b18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c7b1f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.939602:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7b18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c7b1f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788528420.939611:0:8440:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7b18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c7b1f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528420.939619:0:8440:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788528420.939637:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735468416 00000100:00100000:2.0:1788528420.939646:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735468416 00010000:00010000:2.0:1788528420.939678:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90f6e17800/0x892c60dda91c7b50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7b49 expref: 27 pid: 6501 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.939683:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7b18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7b1f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.939708:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788528420.939708:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735468544 00000100:00100000:2.0:1788528420.939716:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735468544 00010000:00010000:2.0:1788528420.939735:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9101850c00/0x892c60dda91c7b42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7b3b expref: 28 pid: 6502 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.939751:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7b18 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7b1f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528420.939760:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735468672 00010000:00010000:3.0:1788528420.939762:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16e00/0x892c60dda91c7b18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c7b1f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528420.939768:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735468672 00010000:00010000:2.0:1788528420.939784:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9101850800/0x892c60dda91c7b34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7b2d expref: 29 pid: 6502 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.939790:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528420.939795:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528420.939799:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528420.939806:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788528420.939824:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735468928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788528420.939834:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3f74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+29:3640:x1875407735468416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788528420.939851:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528420.939857:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90f6e17800/0x892c60dda91c7b50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7b49 expref: 29 pid: 6501 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528420.939869:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90f6e17800/0x892c60dda91c7b50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c7b49 expref: 29 pid: 6501 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528420.939885:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90f6e17800/0x892c60dda91c7b50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c7b49 expref: 29 pid: 6501 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528420.939899:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528420.939948:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3f74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+28:3640:x1875407735468416:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (3283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528420.939979:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788528420.939987:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528420.940004:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735468928 00000100:00100000:2.0:1788528420.940010:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735468928 00010000:00010000:2.0:1788528420.940025:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9101850600/0x892c60dda91c7b1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7b18 expref: 28 pid: 6501 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528420.940050:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788528420.940063:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3f75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+28:3637:x1875407735468544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788528420.940071:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528420.940076:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9101850c00/0x892c60dda91c7b42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7b3b expref: 28 pid: 6502 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528420.940086:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9101850c00/0x892c60dda91c7b42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c7b3b expref: 28 pid: 6502 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528420.940093:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735468416:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788528420.940102:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101850c00/0x892c60dda91c7b42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c7b3b expref: 28 pid: 6502 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528420.940116:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528420.940170:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3f75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735468544:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (3418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528420.940179:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788528420.940196:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788528420.940202:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3f74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+26:3637:x1875407735468672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788528420.940210:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528420.940214:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9101850800/0x892c60dda91c7b34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7b2d expref: 26 pid: 6502 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528420.940236:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9101850800/0x892c60dda91c7b34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c7b2d expref: 26 pid: 6502 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528420.940246:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101850800/0x892c60dda91c7b34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c7b2d expref: 26 pid: 6502 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528420.940253:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528420.940289:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3f74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+25:3637:x1875407735468672:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (3497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528420.940295:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788528420.940308:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788528420.940316:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90efa84450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+24:3639:x1875407735468928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788528420.940324:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528420.940329:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9101850600/0x892c60dda91c7b1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c7b18 expref: 24 pid: 6501 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528420.940336:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9101850600/0x892c60dda91c7b1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c7b18 expref: 24 pid: 6501 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528420.940346:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101850600/0x892c60dda91c7b1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c7b18 expref: 24 pid: 6501 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528420.940354:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528420.940392:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90efa84450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+23:3639:x1875407735468928:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528420.940399:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788528420.940451:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735468928:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788528420.940988:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528420.941067:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735468672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528420.941078:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735468544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788528420.942443:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528420.942629:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528420.943189:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719655040 00000100:00100000:2.0:1788528420.943202:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719655040 00010000:00010000:2.0:1788528420.943277:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9101851800/0x892c60dda91c7b57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc2f expref: 14 pid: 6500 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528420.943319:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719655168 00000100:00100000:2.0:1788528420.943323:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719655168 00010000:00010000:2.0:1788528420.943336:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90f6e17e00/0x892c60dda91c7b26 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc28 expref: 15 pid: 6500 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528420.943369:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:2.0:1788528420.943383:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+15:2403:x1875407719655040:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528420.943400:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528420.943408:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9101851800/0x892c60dda91c7b57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc2f expref: 15 pid: 6500 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528420.943424:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9101851800/0x892c60dda91c7b57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc2f expref: 15 pid: 6500 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528420.943452:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101851800/0x892c60dda91c7b57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc2f expref: 15 pid: 6500 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528420.943465:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 57 00010000:00010000:2.0:1788528420.943475:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528420.943489:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2403:x1875407719655168:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788528420.943521:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528420.943532:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90f6e17e00/0x892c60dda91c7b26 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc28 expref: 14 pid: 6500 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528420.943548:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2403:x1875407719655040:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 166us (1112us total) trans 0 rc 0/0 00010000:00010000:3.0:1788528420.943600:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90f6e17e00/0x892c60dda91c7b26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc28 expref: 14 pid: 6500 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.943639:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90f6e17e00/0x892c60dda91c7b26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc28 expref: 14 pid: 6500 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528420.943649:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 56 00010000:00010000:3.0:1788528420.943693:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7c8b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.943701:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7c8b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.943731:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7c8b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.943741:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7c8b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.943748:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7c8b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.943755:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7c8b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.943762:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e3800 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528420.943767:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7c8b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.943775:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7c8b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.943789:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7c8b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.943800:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788528420.943902:0:13720:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7c8b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528420.943914:0:13720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7c8b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528420.943921:0:13720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc26e3800/0x892c60dda91c7c8b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528420.946650:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+12:2403:x1875407719655168:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 3042us (3891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528420.946680:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 57 00000004:00080000:0.0:1788528420.947363:0:6487:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:0.0:1788528420.947421:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1788528420.947433:0:6487:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788528420.947541:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735469056:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788528420.947638:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788528420.947726:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c7be3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.947739:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c7be3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.947747:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c7be3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.947755:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101851000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528420.947760:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c7be3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528420.947765:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735469056 00010000:00010000:3.0:1788528420.947769:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c7be3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.947791:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6a3bfed6 (ffff8a8fc27f0300) 00010000:00010000:3.0:1788528420.947794:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528420.947801:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c7be3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.947807:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c7be3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.947822:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7bf8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.947829:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7bf8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.947851:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7bf8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.947857:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3ba00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528420.947861:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7bf8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.947868:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7bf8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.947877:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a8fc27f0c00) 00010000:00010000:3.0:1788528420.947880:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528420.947883:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7bf8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528420.947884:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735469056 00010000:00010000:3.0:1788528420.947889:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7bf8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528420.947974:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788528420.947984:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735469056:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788528420.948027:0:8423:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:0.0:1788528420.948068:0:8423:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9ac71f, atime: 0x6a9ac71f, ctime: 0x6a9ac71f, blocks: 0x0 00010000:00010000:0.0:1788528420.948087:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e407c76/0x892c60dda91c7c92 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528420.948103:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=290s v=(0 0) 00010000:00010000:0.0:1788528420.948108:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788528420.948115:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e407c76/0x892c60dda91c7c92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528420.948133:0:8423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e407c76/0x892c60dda91c7c92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528420.948142:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e407c76/0x892c60dda91c7c92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528420.948150:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e407c76/0x892c60dda91c7c92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528420.948168:0:8423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788528420.948322:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ac00/0x892c60dda91c7c61 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.948329:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ac00/0x892c60dda91c7c61 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.948334:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ac00/0x892c60dda91c7c61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.948344:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3ac00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528420.948347:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ac00/0x892c60dda91c7c61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.948362:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ac00/0x892c60dda91c7c61 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.948371:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6a3bfed6 (ffff8a8fc27f0300) 00010000:00010000:3.0:1788528420.948374:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528420.948377:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ac00/0x892c60dda91c7c61 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528420.948381:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1875407735469056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 399us (743us total) trans 4294967301 rc 0/0 00010000:00010000:3.0:1788528420.948383:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ac00/0x892c60dda91c7c61 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528420.948389:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788528420.948399:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429c00/0x892c60dda91c7c7d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.948405:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429c00/0x892c60dda91c7c7d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528420.948625:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528420.948633:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e407c76/0x892c60dda91c7c92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528420.948653:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e3600 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528420.948658:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e407c76/0x892c60dda91c7c92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528420.948666:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e407c76/0x892c60dda91c7c92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528420.948685:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e407c76/0x892c60dda91c7c92 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528420.948692:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e407c76/0x892c60dda91c7c92 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528420.948709:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528420.948711:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528420.948713:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528420.948737:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429c00/0x892c60dda91c7c7d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.948743:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3429c00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528420.948746:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429c00/0x892c60dda91c7c7d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.948751:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429c00/0x892c60dda91c7c7d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788528420.948753:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a90f5a0b800/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788528420.948760:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735469056:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788528420.948761:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a8fc1fa8600) 00010000:00010000:3.0:1788528420.948763:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528420.948767:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429c00/0x892c60dda91c7c7d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528420.948779:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429c00/0x892c60dda91c7c7d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528420.993155:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528421.054741:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735469184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788528421.054973:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528421.055083:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735469184 00000100:00100000:2.0:1788528421.055094:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735469184 00000100:00100000:2.0:1788528421.055170:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788528421.055182:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735469184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788528421.055222:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528421.055287:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735469184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528421.055295:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:2.0:1788528421.055349:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f5a0aa00 x1875407735469184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528421.055372:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735469312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788528421.055374:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735469184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788528421.055411:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528421.055440:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735469312 00000100:00100000:2.0:1788528421.055445:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735469312 00000100:00100000:2.0:1788528421.055480:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788528421.055487:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735469312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788528421.055498:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528421.055533:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735469312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528421.055540:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:2.0:1788528421.055595:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90faa0bb80 x1875407735469312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528421.055609:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735469312:0@lo:13:osp-pre-0-1.0 00000020:00000080:1.0:1788528421.822441:0:13769:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdeb6f53b0 20000000:00000080:1.0:1788528421.822465:0:13769:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a8fc269bc00 uarg=0000000000000000 20000000:01000000:1.0:1788528421.822526:0:13769:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1788528421.822534:0:13769:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1788528421.822540:0:13769:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:2.0:1788528421.824791:0:13770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1788528421.825325:0:13769:0:(mgs_llog.c:4126:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:1.0:1788528421.825482:0:13769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:1.0:1788528421.825518:0:13769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:1.0:1788528421.825533:0:13769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:1.0:1788528421.825547:0:13769:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788528421.825620:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a90f6e16800/0x892c60dda91c7c99 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528421.825642:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90f6e16800/0x892c60dda91c7c99 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528421.825665:0:13769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a90f6e16800/0x892c60dda91c7c99 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528421.825673:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a90f6e16800/0x892c60dda91c7c99 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528421.825681:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a90f6e16800/0x892c60dda91c7c99 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528421.825707:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a90f6e16800/0x892c60dda91c7c99 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528421.825714:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16800 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528421.825719:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a90f6e16800/0x892c60dda91c7c99 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528421.825728:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a90f6e16800/0x892c60dda91c7c99 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528421.825744:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a90f6e16800/0x892c60dda91c7c99 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528421.825753:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a90f6e16800/0x892c60dda91c7c99 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528421.825760:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90f6e16800/0x892c60dda91c7c99 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528422.015075:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528422.026224:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528422.026478:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719655296 00000100:00100000:3.0:1788528422.026491:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719655296 00000100:00100000:2.0:1788528422.026766:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 363 00000100:00100000:2.0:1788528422.026781:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+12:6172:x1875407719655296:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528422.026802:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528422.026835:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90f6f3ac00/0x892c60dda91c7ca0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfc7c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528422.026870:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90f6f3ac00/0x892c60dda91c7ca0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc7c expref: 13 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528422.026886:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90f6f3ac00/0x892c60dda91c7ca0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc7c expref: 13 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528422.026897:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3ac00, rc 0) 00000100:00100000:2.0:1788528422.026974:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+13:6172:x1875407719655296:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 197us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528422.026982:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 363 00000100:00100000:2.0:1788528422.038910:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528422.039216:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719655424 00000100:00100000:3.0:1788528422.039230:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719655424 00000100:00100000:3.0:1788528422.039312:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 364 00000100:00100000:3.0:1788528422.039324:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+13:6172:x1875407719655424:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528422.039756:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+13:6172:x1875407719655424:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 431us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528422.039766:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 364 00000100:00100000:0.0:1788528422.057512:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528422.057583:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719655552 00000100:00100000:0.0:1788528422.057596:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719655552 00000100:00100000:0.0:1788528422.057664:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 365 00000100:00100000:0.0:1788528422.057677:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+13:6172:x1875407719655552:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788528422.058978:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+13:6172:x1875407719655552:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 Request processed in 1298us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528422.058996:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 365 00000100:00100000:2.0:1788528422.066588:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528422.066644:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719655680 00000100:00100000:2.0:1788528422.066656:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719655680 00000100:00100000:2.0:1788528422.066716:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 366 00000100:00100000:2.0:1788528422.066728:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+13:10785:x1875407719655680:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788528422.066911:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+13:10785:x1875407719655680:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 184us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528422.066919:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 366 00000100:00100000:0.0:1788528422.076905:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528422.077001:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719655808 00000100:00100000:3.0:1788528422.077014:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719655808 00000100:00100000:3.0:1788528422.077083:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 367 00000100:00100000:3.0:1788528422.077095:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c8116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+13:10785:x1875407719655808:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788528422.077448:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c8116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+13:10785:x1875407719655808:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 355us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528422.077457:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 367 00000100:00100000:2.0:1788528422.079664:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735469440:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788528422.079813:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528422.079976:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528422.080199:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719655936 00000100:00100000:2.0:1788528422.080209:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719655936 00000100:00100000:2.0:1788528422.080285:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 368 00000100:00100000:2.0:1788528422.080296:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c8116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+13:6172:x1875407719655936:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528422.080334:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528422.080357:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90f6f3aa00/0x892c60dda91c7ca7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfc83 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528422.080411:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735469440 00000100:00100000:3.0:1788528422.080416:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735469440 00000100:00100000:3.0:1788528422.080454:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00010000:00010000:2.0:1788528422.080458:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90f6f3aa00/0x892c60dda91c7ca7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc83 expref: 14 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528422.080465:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735469440:12345-0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788528422.080476:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90f6f3aa00/0x892c60dda91c7ca7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc83 expref: 14 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528422.080487:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3aa00, rc 0) 00000004:00000024:3.0:1788528422.080499:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788528422.080602:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735469440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 139us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528422.080619:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788528422.080626:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c8116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:6172:x1875407719655936:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 331us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528422.080635:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 368 00000100:00100000:3.0:1788528422.080699:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735469440:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788528422.083729:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528422.084277:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719656064 00000100:00100000:3.0:1788528422.084290:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719656064 00000100:00100000:3.0:1788528422.084367:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 369 00000100:00100000:3.0:1788528422.084379:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c8116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:6172:x1875407719656064:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528422.084810:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c8116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:6172:x1875407719656064:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 430us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528422.084821:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 369 00000100:00100000:2.0:1788528422.088237:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528422.088306:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719656192 00000100:00100000:0.0:1788528422.088319:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719656192 00000100:00100000:0.0:1788528422.088384:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 370 00000100:00100000:0.0:1788528422.088398:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:6172:x1875407719656192:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788528422.088623:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:6172:x1875407719656192:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 Request processed in 228us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528422.088632:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 370 00000100:00100000:1.0:1788528422.094820:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528422.094911:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719656320 00000100:00100000:3.0:1788528422.094924:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719656320 00000100:00100000:3.0:1788528422.094996:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 371 00000100:00100000:3.0:1788528422.095009:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:10788:x1875407719656320:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788528422.095234:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:10788:x1875407719656320:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 226us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528422.095244:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 371 00000100:00100000:3.0:1788528422.099796:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528422.099971:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719656448 00000100:00100000:0.0:1788528422.099985:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719656448 00000100:00100000:0.0:1788528422.100076:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 372 00000100:00100000:0.0:1788528422.100089:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:10788:x1875407719656448:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788528422.100874:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:10788:x1875407719656448:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 783us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528422.100885:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 372 10000000:01000000:0.0:1788528422.464329:0:6506:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:0.0:1788528422.464339:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a8fc1fe4800 from 7 10000000:01000000:0.0:1788528422.464345:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788528422.464407:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3e00/0x892c60dda91c7cae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528422.464419:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3e00/0x892c60dda91c7cae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528422.464451:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3e00/0x892c60dda91c7cae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528422.464484:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735469568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788528422.464593:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528422.464662:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3dede40 going to sleep for 11 seconds 00000100:00100000:3.0:1788528422.464802:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735469568 00000100:00100000:3.0:1788528422.464812:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735469568 00000100:00100000:3.0:1788528422.464882:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1788528422.464893:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+23:6506:x1875407735469568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788528422.464909:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528422.464926:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc3429a00/0x892c60dda91c7cb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7cae expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528422.464980:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc3429a00/0x892c60dda91c7cb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7cae expref: 24 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528422.464993:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc3429a00/0x892c60dda91c7cb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7cae expref: 24 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528422.465003:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3429a00, rc 0) 00000100:00100000:3.0:1788528422.465058:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735469568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528422.465065:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1788528422.465124:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735469568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788528422.465140:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3e00/0x892c60dda91c7cae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7cb5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528422.465149:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3e00/0x892c60dda91c7cae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7cb5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788528422.465516:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 7 count 7 00000040:00080000:3.0:1788528422.466869:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788528422.467762:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788528422.467801:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788528422.467819:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788528422.467848:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788528422.467862:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788528422.467883:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788528422.467888:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 6 count 7 00000100:00100000:3.0:1788528422.468883:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735469696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528422.469806:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528422.469927:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc267f480 going to sleep for 11 seconds 00000100:00100000:0.0:1788528422.480302:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735469696 00000100:00100000:0.0:1788528422.480336:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735469696 00000100:00100000:0.0:1788528422.480440:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788528422.480453:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735469696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788528422.480711:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735469696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (10906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528422.480721:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1788528422.481198:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735469696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788528422.481281:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3f75f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735469824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788528422.481354:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528422.481406:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6efdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788528422.481578:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735469824 00000100:00100000:3.0:1788528422.481586:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735469824 00000100:00100000:3.0:1788528422.481642:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1788528422.481651:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735469824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788528422.481769:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735469824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528422.481777:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1788528422.482173:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3f75f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735469824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788528422.483675:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788528422.483811:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3f75f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735469952:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788528422.484477:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528422.484536:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6efdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788528422.484642:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735469952 00000100:00100000:3.0:1788528422.484652:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735469952 00000100:00100000:3.0:1788528422.484757:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1788528422.484769:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735469952:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788528422.484932:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735469952:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 165us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528422.484940:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1788528422.485043:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3f75f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735469952:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788528422.485323:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788528422.485358:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1788528422.485387:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1788528422.485405:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1788528422.485422:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1788528422.485436:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1788528422.485450:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1788528422.485463:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1788528422.485483:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1788528422.485499:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1788528422.485514:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1788528422.485548:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3f75f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735470080:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788528422.485627:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528422.488879:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6efdb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788528422.496715:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735470080 00000100:00100000:0.0:1788528422.496743:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735470080 00000100:00100000:0.0:1788528422.496843:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1788528422.496866:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735470080:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788528422.497466:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735470080:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 611us (11837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528422.497477:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1788528422.502189:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3f75f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735470080:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788528422.502353:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1788528422.502471:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788528422.509691:0:13782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788528422.509708:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528422.509711:0:13782:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788528422.509724:0:13782:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a8fc1fe4800 00000020:00000080:3.0:1788528422.509727:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788528422.509812:0:13782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788528422.509816:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528422.509817:0:13782:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788528422.509821:0:13782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788528422.509824:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528422.509825:0:13782:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788528422.509829:0:13782:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a8fc1fe4800 00000020:00000080:3.0:1788528422.509831:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788528422.509854:0:13782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788528422.511067:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528422.511070:0:13782:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788528422.511078:0:13782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1788528422.512101:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788528422.512121:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788528422.512135:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3e00/0x892c60dda91c7cae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7cb5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528422.512150:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3e00/0x892c60dda91c7cae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7cb5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528422.512169:0:6506:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:2.0:1788528422.512172:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a90fa76f800 from 7 10000000:01000000:2.0:1788528422.512175:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788528422.512218:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6f3ae00/0x892c60dda91c7cbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528422.512237:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90f6f3ae00/0x892c60dda91c7cbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528422.512262:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90f6f3ae00/0x892c60dda91c7cbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528422.512293:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735470208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788528422.512959:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528422.513022:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc36e5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788528422.513422:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735470208 00000100:00100000:1.0:1788528422.513433:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735470208 00000100:00100000:1.0:1788528422.513490:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1788528422.513499:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+24:6506:x1875407735470208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788528422.513516:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528422.513534:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90f6e16c00/0x892c60dda91c7cc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7cbc expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528422.513604:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90f6e16c00/0x892c60dda91c7cc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7cbc expref: 25 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528422.513616:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90f6e16c00/0x892c60dda91c7cc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7cbc expref: 25 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528422.513627:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e16c00, rc 0) 00000100:00100000:1.0:1788528422.513685:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735470208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528422.513692:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1788528422.513844:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735470208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788528422.513871:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90f6f3ae00/0x892c60dda91c7cbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7cc3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528422.513881:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90f6f3ae00/0x892c60dda91c7cbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7cc3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788528422.514039:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 7 count 7 00000040:00080000:3.0:1788528422.514369:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788528422.514803:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1788528422.514827:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 112 off8528 00000040:00080000:3.0:1788528422.514838:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 224 off8752 00000040:00080000:3.0:1788528422.514849:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8976 00000040:00080000:2.0:1788528422.517776:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 112 off9088 00000040:00080000:2.0:1788528422.517869:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 224 off9312 00000040:00080000:2.0:1788528422.517878:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 6 count 7 00000100:00100000:2.0:1788528422.518033:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735470336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528422.518125:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528422.518180:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc36e5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788528422.518183:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735470336 00000100:00100000:3.0:1788528422.518193:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735470336 00000100:00100000:3.0:1788528422.518264:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1788528422.518275:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735470336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528422.518459:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735470336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 186us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528422.518467:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1788528422.520752:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735470336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528422.520842:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735470464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788528422.522845:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528422.522907:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc267f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528422.523147:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735470464 00000100:00100000:0.0:1788528422.523158:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735470464 00000100:00100000:0.0:1788528422.523223:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1788528422.523233:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735470464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788528422.523587:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735470464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 322us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528422.523602:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1788528422.523771:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735470464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788528422.524516:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788528422.524784:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735470592:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788528422.524872:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528422.524921:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc36e5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788528422.527674:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735470592 00000100:00100000:1.0:1788528422.527692:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735470592 00000100:00100000:1.0:1788528422.527763:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1788528422.527775:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735470592:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788528422.528000:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735470592:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 227us (3127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528422.528008:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1788528422.528925:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735470592:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788528422.529226:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1788528422.529273:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 112 off8528 00000040:00080000:2.0:1788528422.529289:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 224 off8752 00000040:00080000:2.0:1788528422.529330:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8976 00000040:00080000:2.0:1788528422.529345:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 112 off9088 00000040:00080000:2.0:1788528422.529359:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 224 off9312 00000040:00080000:2.0:1788528422.529383:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 224 off9536 00000040:00080000:2.0:1788528422.529400:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 128 off9664 00000040:00080000:2.0:1788528422.529414:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1788528422.529428:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 224 off10112 00000040:00080000:2.0:1788528422.529443:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 128 off10240 00000100:00100000:2.0:1788528422.529489:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735470720:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788528422.529591:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528422.529638:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc36e5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788528422.529851:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735470720 00000100:00100000:0.0:1788528422.529859:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735470720 00000100:00100000:0.0:1788528422.529916:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1788528422.529926:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735470720:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788528422.530058:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735470720:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 133us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528422.530065:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1788528422.530207:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735470720:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788528422.530271:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10464 00000040:00080000:2.0:1788528422.530281:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788528422.534478:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788528422.534496:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528422.534499:0:13785:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788528422.534507:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:3.0:1788528422.534518:0:13785:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a90fa76f800 00000020:00000080:3.0:1788528422.534521:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788528422.534747:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788528422.534752:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528422.534754:0:13785:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788528422.534758:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788528422.534761:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528422.534763:0:13785:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788528422.534767:0:13785:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a90fa76f800 00000020:00000080:3.0:1788528422.534769:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788528422.536546:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788528422.536596:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528422.536598:0:13785:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788528422.536605:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 13 count 13 00000020:01000000:3.0:1788528422.536778:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788528422.536795:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788528422.536809:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6f3ae00/0x892c60dda91c7cbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7cc3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528422.536830:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90f6f3ae00/0x892c60dda91c7cbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7cc3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528422.536852:0:6506:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:3.0:1788528422.536868:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a90f5add000 from 7 10000000:01000000:3.0:1788528422.536872:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788528422.536923:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c7cca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528422.536933:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c7cca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528422.536947:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c7cca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528422.536990:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735470848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788528422.537077:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528422.537138:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc267f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788528422.537601:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735470848 00000100:00100000:2.0:1788528422.537611:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735470848 00000100:00100000:2.0:1788528422.537666:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1788528422.537678:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+25:6506:x1875407735470848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528422.537695:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528422.537712:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90f6f3b800/0x892c60dda91c7cd1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7cca expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528422.537741:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90f6f3b800/0x892c60dda91c7cd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7cca expref: 26 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528422.537753:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90f6f3b800/0x892c60dda91c7cd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7cca expref: 26 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528422.537769:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3b800, rc 0) 00000100:00100000:2.0:1788528422.537828:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735470848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528422.537835:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1788528422.540649:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735470848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528422.540689:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c7cca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7cd1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528422.540704:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c7cca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7cd1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788528422.540883:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 7 count 7 00000040:00080000:2.0:1788528422.541237:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788528422.542612:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].1, 224 off8416 00000040:00080000:2.0:1788528422.542668:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].2, 112 off8528 00000040:00080000:2.0:1788528422.542685:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].3, 224 off8752 00000040:00080000:2.0:1788528422.542700:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].4, 224 off8976 00000040:00080000:2.0:1788528422.542714:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].5, 112 off9088 00000040:00080000:2.0:1788528422.542738:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].6, 224 off9312 00000040:00080000:2.0:1788528422.542743:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 6 count 7 00000100:00100000:2.0:1788528422.543071:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735470976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528422.543159:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528422.543296:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc36e5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788528422.546517:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735470976 00000100:00100000:3.0:1788528422.546536:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735470976 00000040:00080000:1.0:1788528422.547196:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788528422.548356:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1788528422.548371:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735470976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528422.548743:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735470976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 374us (5582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528422.548758:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1788528422.549177:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735470976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788528422.549261:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735471104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788528422.552675:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528422.552777:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3ded3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528422.553672:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735471104 00000100:00100000:3.0:1788528422.553686:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735471104 00000100:00100000:3.0:1788528422.553759:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1788528422.553770:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735471104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788528422.553970:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735471104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 201us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528422.553979:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1788528422.554088:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735471104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788528422.554687:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788528422.554791:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735471232:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788528422.554876:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528422.554919:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3ded3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528422.555291:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735471232 00000100:00100000:3.0:1788528422.555300:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735471232 00000100:00100000:3.0:1788528422.555355:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1788528422.555365:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735471232:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788528422.555485:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735471232:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 121us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528422.555493:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1788528422.555495:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735471232:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788528422.555723:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].1, 224 off8416 00000040:00080000:0.0:1788528422.555751:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].2, 112 off8528 00000040:00080000:0.0:1788528422.555766:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].3, 224 off8752 00000040:00080000:0.0:1788528422.555778:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].4, 224 off8976 00000040:00080000:0.0:1788528422.555792:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].5, 112 off9088 00000040:00080000:0.0:1788528422.555803:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].6, 224 off9312 00000040:00080000:0.0:1788528422.555814:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].7, 224 off9536 00000040:00080000:0.0:1788528422.556046:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].8, 128 off9664 00000040:00080000:0.0:1788528422.556062:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].9, 224 off9888 00000040:00080000:0.0:1788528422.556082:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].10, 224 off10112 00000040:00080000:0.0:1788528422.556094:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].11, 128 off10240 00000100:00100000:0.0:1788528422.556127:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735471360:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788528422.556180:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528422.556275:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3ded3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528422.559771:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735471360 00000100:00100000:3.0:1788528422.559790:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735471360 00000100:00100000:2.0:1788528422.559955:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1788528422.559968:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735471360:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788528422.560202:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735471360:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 236us (4020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528422.560210:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1788528422.560309:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735471360:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788528422.560415:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].12, 224 off10464 00000040:00080000:0.0:1788528422.560433:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788528422.561412:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788528422.561425:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528422.561428:0:13790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788528422.561439:0:13790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a90f5add000 00000020:00000080:3.0:1788528422.561441:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788528422.561516:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788528422.561519:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528422.561521:0:13790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788528422.561524:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788528422.561527:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528422.561529:0:13790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788528422.561538:0:13790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a90f5add000 00000020:00000080:3.0:1788528422.561540:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788528422.561587:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788528422.561591:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528422.561593:0:13790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788528422.561596:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 13 count 13 00000020:01000000:0.0:1788528422.561942:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788528422.561955:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788528422.561969:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c7cca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7cd1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528422.561982:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c7cca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7cd1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528422.561995:0:6506:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:0.0:1788528422.561998:0:6506:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a90c7f88000 from 7 10000000:01000000:0.0:1788528422.562001:0:6506:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788528422.562044:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3200/0x892c60dda91c7cd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528422.562051:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3200/0x892c60dda91c7cd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528422.562061:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3200/0x892c60dda91c7cd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528422.562089:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735471488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788528422.562157:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528422.562212:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735471488 00000100:00100000:0.0:1788528422.562220:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735471488 00000100:00100000:0.0:1788528422.562279:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788528422.562288:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+26:6506:x1875407735471488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788528422.562303:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528422.562318:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc26e3600/0x892c60dda91c7cdf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c7cd8 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528422.562344:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc26e3600/0x892c60dda91c7cdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c7cd8 expref: 27 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528422.562356:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc26e3600/0x892c60dda91c7cdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c7cd8 expref: 27 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528422.562366:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e3600, rc 0) 00000100:00100000:0.0:1788528422.562399:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+27:6506:x1875407735471488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528422.562406:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788528422.562450:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3ded3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528422.562470:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735471488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788528422.562485:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3200/0x892c60dda91c7cd8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7cdf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528422.562495:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3200/0x892c60dda91c7cd8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7cdf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528422.562532:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735471616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788528422.562586:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528422.562714:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735471616 00000100:00100000:2.0:1788528422.562720:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735471616 00000100:00100000:0.0:1788528422.562765:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3ded3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528422.567762:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1788528422.567787:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:6506:x1875407735471616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528422.568068:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:6506:x1875407735471616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 289us (5480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528422.568077:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1788528422.568409:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735471616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788528422.568662:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735471744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788528422.568733:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528422.568777:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3dedd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788528422.568839:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735471744 00000100:00100000:3.0:1788528422.568847:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735471744 00000100:00100000:3.0:1788528422.568900:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1788528422.568909:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:6506:x1875407735471744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788528422.569016:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:6506:x1875407735471744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528422.569023:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1788528422.569104:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd052447-840d-4bcc-891b-140c465c7625:6506:1875407735471744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788528422.569460:0:13791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:13791:1875407735471872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788528422.569501:0:13791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528422.569525:0:13791:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3ded240 going to sleep for 11 seconds 00000100:00100000:3.0:1788528422.570664:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735471872 00000100:00100000:3.0:1788528422.570678:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735471872 00000100:00100000:3.0:1788528422.570735:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1788528422.570745:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:13791:x1875407735471872:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788528422.570911:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:13791:x1875407735471872:12345-0@lo:502:llog_process_th.0 Request processed in 168us (1409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528422.570919:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1788528422.571023:0:13791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:13791:1875407735471872:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788528422.571061:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788528422.571073:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528422.571076:0:13791:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788528422.571085:0:13791:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a90c7f88000 00000020:00000080:0.0:1788528422.571088:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788528422.571142:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528422.571323:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528422.571326:0:13791:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788528422.571331:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788528422.571334:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528422.571336:0:13791:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788528422.571340:0:13791:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a90c7f88000 00000020:00000080:0.0:1788528422.571342:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788528422.571589:0:13791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:13791:1875407735472000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788528422.571646:0:13791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528422.571681:0:13791:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3ded240 going to sleep for 11 seconds 00000100:00100000:3.0:1788528422.571979:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735472000 00000100:00100000:3.0:1788528422.571987:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735472000 00000100:00100000:3.0:1788528422.572034:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1788528422.572042:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:13791:x1875407735472000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788528422.572152:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:13791:x1875407735472000:12345-0@lo:502:llog_process_th.0 Request processed in 111us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528422.572160:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1788528422.577427:0:13791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd052447-840d-4bcc-891b-140c465c7625:13791:1875407735472000:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788528422.577491:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528422.577508:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528422.577511:0:13791:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788528422.577518:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788528422.581367:0:6506:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788528422.581393:0:6506:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788528422.581407:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3200/0x892c60dda91c7cd8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7cdf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528422.581422:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3200/0x892c60dda91c7cd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7cdf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528423.039358:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788528423.553724:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788528423.554492:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788528424.065418:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528424.134717:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528424.134765:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528424.134804:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528424.134940:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719656576 00000100:00100000:3.0:1788528424.134954:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719656576 00000100:00100000:3.0:1788528424.135026:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 393 00000100:00100000:3.0:1788528424.135039:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2406:x1875407719656576:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528424.136304:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2406:x1875407719656576:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 1253us (1587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528424.136322:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 393 00000100:00100000:2.0:1788528424.137508:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719656832 00000100:00100000:2.0:1788528424.137527:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719656832 00000100:00100000:2.0:1788528424.137623:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719657088 00000100:00100000:2.0:1788528424.137627:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719657088 00000100:00100000:2.0:1788528424.137652:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 208 00000100:00100000:2.0:1788528424.137663:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2406:x1875407719656832:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528424.142134:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528424.142221:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528424.142263:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719656704 00000100:00100000:0.0:1788528424.142272:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528424.142275:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719656704 00000100:00100000:0.0:1788528424.142307:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719656960 00000100:00100000:0.0:1788528424.142312:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719656960 00000100:00100000:0.0:1788528424.142373:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 78 00000100:00100000:0.0:1788528424.142385:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2406:x1875407719656960:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528424.142472:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2406:x1875407719656960:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 89us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528424.142480:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 78 00000100:00100000:0.0:1788528424.142704:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719657216 00000100:00100000:0.0:1788528424.142709:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719657216 00000100:00100000:0.0:1788528424.142737:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 209 00000100:00100000:0.0:1788528424.142753:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2406:x1875407719657088:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528424.142791:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2406:x1875407719657088:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 40us (7987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528424.142798:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 209 00000100:00100000:0.0:1788528424.142813:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 210 00000100:00100000:0.0:1788528424.142818:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2406:x1875407719657216:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528424.142840:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2406:x1875407719657216:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 22us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528424.142846:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 210 00000100:00080000:0.0:1788528424.142867:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788528424.142873:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788528424.142875:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788528424.143929:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 211 00000100:00100000:1.0:1788528424.143942:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2406:x1875407719656704:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528424.144029:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2406:x1875407719656704:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 89us (1910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528424.144038:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 211 00000100:00080000:0.0:1788528424.144254:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788528424.144279:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2406:x1875407719656832:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 6616us (9510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528424.144289:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 208 00010000:00010000:0.0:1788528425.088263:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528425.150963:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788528425.150994:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735472128:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788528425.151109:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528425.151309:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735472128 00000100:00100000:1.0:1788528425.151321:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735472128 00000100:00100000:1.0:1788528425.151404:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788528425.151424:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735472128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788528425.151470:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528425.151522:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735472128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528425.151529:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1788528425.151770:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788528425.151790:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735472512:0@lo:400:kworker.0 00000100:00100000:3.0:1788528425.151829:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528425.151856:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe6e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1875407735473024:0@lo:400:kworker.0 00000100:00100000:3.0:1788528425.151878:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528425.151894:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe6e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1875407735473536:0@lo:400:kworker.0 00000100:00100000:3.0:1788528425.151914:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528425.151962:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735472128:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788528425.151985:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788528425.151991:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe6e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735472640:0@lo:400:kworker.0 00000100:00100000:3.0:1788528425.152024:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528425.152044:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe6e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735473152:0@lo:400:kworker.0 00000100:00100000:3.0:1788528425.152081:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528425.152097:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe6e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735473664:0@lo:400:kworker.0 00000100:00100000:3.0:1788528425.152157:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528425.152187:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735472640 00000100:00100000:3.0:1788528425.152193:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735472640 00000100:00100000:3.0:1788528425.152248:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788528425.152256:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735472640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528425.152301:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735472640:12345-0@lo:400:kworker.0 Request processed in 46us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528425.152308:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788528425.152346:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735472512 00000100:00100000:3.0:1788528425.152350:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735472512 00000100:00100000:3.0:1788528425.152372:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735473024 00000100:00100000:3.0:1788528425.152374:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735473024 00000100:00100000:3.0:1788528425.152394:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735473536 00000100:00100000:3.0:1788528425.152396:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735473536 00000100:00100000:3.0:1788528425.152410:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735473152 00000100:00100000:3.0:1788528425.152412:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735473152 00000100:00100000:3.0:1788528425.152423:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735473664 00000100:00100000:3.0:1788528425.152425:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735473664 00000100:00100000:3.0:1788528425.152437:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788528425.152706:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735472512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528425.152744:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735472512:12345-0@lo:400:kworker.0 Request processed in 43us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528425.152751:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788528425.152768:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788528425.152775:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875407735473024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528425.152788:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788528425.152801:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875407735473536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528425.152807:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875407735473024:12345-0@lo:400:kworker.0 Request processed in 32us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528425.152815:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788528425.152838:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788528425.152846:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735473152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528425.152855:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875407735473536:12345-0@lo:400:kworker.0 Request processed in 57us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528425.152873:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788528425.152884:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735473152:12345-0@lo:400:kworker.0 Request processed in 39us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528425.152892:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788528425.153047:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe6e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735472256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788528425.153101:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528425.153126:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe6e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735472768:0@lo:400:kworker.0 00000100:00100000:2.0:1788528425.153160:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528425.153172:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe6e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735473280:0@lo:400:kworker.0 00000100:00100000:2.0:1788528425.153197:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528425.153215:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe6e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735473792:0@lo:400:kworker.0 00000100:00100000:2.0:1788528425.153246:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528425.153268:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788528425.153275:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe6e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735472384:0@lo:400:kworker.0 00000100:00100000:2.0:1788528425.153305:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528425.153345:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe6e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735472896:0@lo:400:kworker.0 00000100:00100000:2.0:1788528425.153369:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528425.153387:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe6e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735473408:0@lo:400:kworker.0 00000100:00100000:2.0:1788528425.153408:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528425.153423:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735473920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528425.153452:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528425.153485:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735472768 00000100:00100000:2.0:1788528425.153491:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735472768 00000100:00100000:0.0:1788528425.157339:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788528425.157378:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735473664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528425.157484:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735473280 00000100:00100000:1.0:1788528425.157495:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735473280 00000100:00100000:0.0:1788528425.157504:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735473664:12345-0@lo:400:kworker.0 Request processed in 147us (5345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528425.157513:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788528425.157665:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735473792 00000100:00100000:1.0:1788528425.157669:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735473792 00000100:00100000:1.0:1788528425.157687:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735473408 00000100:00100000:1.0:1788528425.157698:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735473408 00000100:00100000:1.0:1788528425.157713:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788528425.157719:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735473280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528425.157765:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735473280:12345-0@lo:400:kworker.0 Request processed in 46us (4566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528425.157771:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788528425.157783:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788528425.157788:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1875407735473792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528425.157840:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1875407735473792:12345-0@lo:400:kworker.0 Request processed in 52us (4594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528425.157846:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788528425.157861:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788528425.157871:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6feea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735473408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528425.157896:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6feea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735473408:12345-0@lo:400:kworker.0 Request processed in 30us (4488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528425.157902:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788528425.157950:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735472896 00000100:00100000:1.0:1788528425.157955:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735472896 00000100:00100000:1.0:1788528425.158133:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735473920 00000100:00100000:1.0:1788528425.158137:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735473920 00000100:00100000:1.0:1788528425.158151:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788528425.158157:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735472896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528425.158200:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735472896:12345-0@lo:400:kworker.0 Request processed in 42us (4830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528425.158205:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788528425.158216:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788528425.158222:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735473920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788528425.158263:0:9268:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788528425.158300:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735473920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (4857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528425.158306:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788528425.158328:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735472384 00000100:00100000:1.0:1788528425.158402:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735472384 00000100:00100000:1.0:1788528425.158434:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1788528425.158505:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735472384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528425.158637:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735472384:12345-0@lo:400:kworker.0 Request processed in 197us (5331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528425.158644:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1788528425.158765:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735472256 00000100:00100000:1.0:1788528425.158770:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735472256 00000100:00100000:1.0:1788528425.158798:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788528425.158804:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1875407735472256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788528425.158817:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528425.158851:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1875407735472256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (5749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528425.158858:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1788528425.158925:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788528425.158931:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788528425.158934:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788528425.158937:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788528425.159099:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe6e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735472640:0@lo:400:kworker.0 00010000:00080000:1.0:1788528425.159123:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90fe6e5c00 x1875407735473152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528425.159135:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe6e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735473152:0@lo:400:kworker.0 00010000:00080000:1.0:1788528425.159151:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90fe6e5180 x1875407735473664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528425.159164:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe6e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735473664:0@lo:400:kworker.0 00000100:00100000:1.0:1788528425.159181:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735472512:0@lo:400:kworker.0 00000100:00100000:1.0:1788528425.159193:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe6e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1875407735473024:0@lo:400:kworker.0 00000100:00100000:1.0:1788528425.159205:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe6e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1875407735473536:0@lo:400:kworker.0 00000100:00100000:0.0:1788528425.159890:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe6e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735472384:0@lo:400:kworker.0 00000100:00100000:0.0:1788528425.159942:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe6e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735472896:0@lo:400:kworker.0 00010000:00080000:0.0:1788528425.159969:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90fe6e4000 x1875407735473408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528425.159982:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe6e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735473408:0@lo:400:kworker.0 00000100:00100000:0.0:1788528425.160004:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735473920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788528425.160021:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe6e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735472256:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788528425.160035:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90fe6e6300 x1875407735473280/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528425.160045:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe6e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735473280:0@lo:400:kworker.0 00000100:00100000:0.0:1788528425.160056:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe6e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735473792:0@lo:400:kworker.0 00000100:00100000:2.0:1788528425.160149:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788528425.160165:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735472768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528425.160264:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735472768:12345-0@lo:400:kworker.0 Request processed in 105us (7103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528425.160273:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788528425.160345:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe6e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735472768:0@lo:400:kworker.0 00010000:00010000:2.0:1788528426.112305:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528426.175976:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788528426.176007:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735474048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788528426.176149:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788528426.176163:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe6e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735474176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788528426.176170:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528426.176242:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528426.176331:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735474048 00000100:00100000:2.0:1788528426.176340:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735474048 00000100:00100000:2.0:1788528426.176403:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735474176 00000100:00100000:2.0:1788528426.176406:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735474176 00000100:00100000:2.0:1788528426.176443:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788528426.176453:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735474048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788528426.176488:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528426.176629:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788528426.176707:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3f76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735474176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788528426.176720:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528426.176791:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3f76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735474176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 154us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528426.176799:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:1.0:1788528426.176846:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90fe6e7100 x1875407735474176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528426.176867:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe6e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735474176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788528426.177328:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735474048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 874us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528426.177338:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:3.0:1788528426.178385:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3c61f80 x1875407735474048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528426.178408:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735474048:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788528426.693508:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:1.0:1788528427.134803:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528427.199684:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788528427.199709:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe6e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735474304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788528427.199784:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528427.200000:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735474304 00000100:00100000:1.0:1788528427.200009:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735474304 00000100:00100000:1.0:1788528427.200069:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788528427.200078:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735474304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788528427.200111:0:9268:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:1.0:1788528427.200170:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735474304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528427.200177:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788528427.200361:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe6e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735474304:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788528428.158718:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528429.183725:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528429.254758:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528429.254807:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528429.254832:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719657344 00000100:00100000:0.0:1788528429.254849:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528429.254850:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719657344 00000100:00100000:0.0:1788528429.254892:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528429.254915:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719657472 00000100:00100000:2.0:1788528429.254924:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719657472 00000100:00100000:0.0:1788528429.254924:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528429.254964:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528429.255009:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719657600 00000100:00100000:2.0:1788528429.255014:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719657600 00000100:00100000:0.0:1788528429.255020:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719657856 00000100:00100000:0.0:1788528429.255032:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719657856 00000100:00100000:2.0:1788528429.255036:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719657984 00000100:00100000:2.0:1788528429.255042:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719657984 00000100:00100000:0.0:1788528429.255113:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 218 00000100:00100000:0.0:1788528429.255124:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719657472:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528429.255153:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 219 00000100:00100000:2.0:1788528429.255166:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719657600:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528429.255288:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719657600:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 123us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528429.255300:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 219 00000100:00100000:0.0:1788528429.255308:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719657472:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 181us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528429.255320:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 218 00000100:00100000:0.0:1788528429.255345:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 220 00000100:00100000:0.0:1788528429.255353:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719657984:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528429.255380:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719657984:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 27us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528429.255386:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 220 00000100:00100000:0.0:1788528429.255398:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 221 00000100:00100000:0.0:1788528429.255405:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719657856:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528429.255427:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719657856:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 23us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528429.255433:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 221 00000100:00100000:1.0:1788528429.255595:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719657728 00000100:00100000:1.0:1788528429.255603:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719657728 00000100:00100000:3.0:1788528429.255642:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 395 00000100:00100000:3.0:1788528429.255659:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2403:x1875407719657344:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528429.255671:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 82 00000100:00100000:1.0:1788528429.255685:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719657728:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528429.255712:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2403:x1875407719657344:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 56us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528429.255722:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 395 00000100:00100000:1.0:1788528429.255734:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719657728:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 50us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528429.255755:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 82 00000100:00080000:1.0:1788528429.255790:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788528429.255796:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788528429.255799:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788528430.206918:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528430.270837:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788528430.270861:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3f75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735474560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788528430.270928:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528430.271280:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735474816:0@lo:400:kworker.0 00000100:00100000:1.0:1788528430.271314:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528430.271343:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc374e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735475328:0@lo:400:kworker.0 00000100:00100000:1.0:1788528430.271364:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528430.271384:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1875407735475840:0@lo:400:kworker.0 00000100:00100000:1.0:1788528430.271404:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528430.271424:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788528430.271429:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735474944:0@lo:400:kworker.0 00000100:00100000:1.0:1788528430.271451:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528430.271468:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc374c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735475456:0@lo:400:kworker.0 00000100:00100000:1.0:1788528430.271490:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528430.271506:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735475968:0@lo:400:kworker.0 00000100:00100000:1.0:1788528430.271525:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528430.271581:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735475456 00000100:00100000:1.0:1788528430.271589:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735475456 00000100:00100000:1.0:1788528430.271633:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735475968 00000100:00100000:1.0:1788528430.271637:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735475968 00000100:00100000:1.0:1788528430.271657:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788528430.271666:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3f77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735475456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528430.271731:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3f77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735475456:12345-0@lo:400:kworker.0 Request processed in 66us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528430.271739:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788528430.271758:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788528430.271766:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3f77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735475968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528430.271783:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735474688:0@lo:400:kworker.0 00000100:00100000:1.0:1788528430.271797:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3f77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735475968:12345-0@lo:400:kworker.0 Request processed in 31us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528430.271803:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788528430.271847:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735474816 00000100:00100000:1.0:1788528430.271851:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735474816 00000100:00100000:1.0:1788528430.271877:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735475328 00000100:00100000:1.0:1788528430.271880:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735475328 00000100:00100000:1.0:1788528430.271893:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735475840 00000100:00100000:1.0:1788528430.271895:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735475840 00000100:00100000:1.0:1788528430.271907:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735474944 00000100:00100000:1.0:1788528430.271909:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735474944 00000100:00100000:1.0:1788528430.271922:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788528430.271930:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735474816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528430.271938:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528430.271974:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735474816:12345-0@lo:400:kworker.0 Request processed in 44us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528430.271976:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc374fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1875407735475200:0@lo:400:kworker.0 00000100:00100000:1.0:1788528430.271988:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788528430.272004:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788528430.272014:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735475328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528430.272044:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735475328:12345-0@lo:400:kworker.0 Request processed in 34us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528430.272050:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788528430.272061:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788528430.272075:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875407735475840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528430.272103:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875407735475840:12345-0@lo:400:kworker.0 Request processed in 29us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528430.272121:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788528430.272134:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788528430.272139:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3f74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735474944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528430.272165:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3f74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735474944:12345-0@lo:400:kworker.0 Request processed in 26us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528430.272167:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528430.272174:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788528430.272188:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735475200 00000100:00100000:1.0:1788528430.272192:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735475200 00000100:00100000:3.0:1788528430.272195:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc374c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1875407735475712:0@lo:400:kworker.0 00000100:00100000:1.0:1788528430.272223:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788528430.272231:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875407735475200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528430.272238:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528430.272258:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3f75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735476224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788528430.272271:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875407735475200:12345-0@lo:400:kworker.0 Request processed in 40us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528430.272278:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788528430.272290:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528430.272291:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735475712 00000100:00100000:1.0:1788528430.272296:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735475712 00000100:00100000:1.0:1788528430.272318:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788528430.272325:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875407735475712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528430.272334:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc374fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1875407735475200:0@lo:400:kworker.0 00000100:00100000:1.0:1788528430.272372:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875407735475712:12345-0@lo:400:kworker.0 Request processed in 46us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528430.272379:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:1.0:1788528430.272401:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788528430.272404:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788528430.272407:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788528430.272409:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788528430.272444:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735474944:0@lo:400:kworker.0 00010000:00080000:1.0:1788528430.272457:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc374c380 x1875407735475456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528430.272466:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc374c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735475456:0@lo:400:kworker.0 00000100:00100000:1.0:1788528430.272475:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735475968:0@lo:400:kworker.0 00000100:00100000:1.0:1788528430.272484:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735474816:0@lo:400:kworker.0 00010000:00080000:1.0:1788528430.272493:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc374e680 x1875407735475328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528430.272501:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc374e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735475328:0@lo:400:kworker.0 00010000:00080000:1.0:1788528430.272509:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90fa8ad500 x1875407735475840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528430.272516:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1875407735475840:0@lo:400:kworker.0 00000100:00100000:1.0:1788528430.272581:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735474688 00000100:00100000:1.0:1788528430.272586:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735474688 00000100:00100000:3.0:1788528430.272596:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc374c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1875407735475712:0@lo:400:kworker.0 00000100:00100000:3.0:1788528430.272609:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1788528430.272615:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1788528430.272619:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe6e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735474432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788528430.272626:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+27:3640:x1875407735474688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528430.272650:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528430.272674:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+27:3640:x1875407735474688:12345-0@lo:400:kworker.0 Request processed in 50us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528430.272675:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735475072:0@lo:400:kworker.0 00000100:00100000:1.0:1788528430.272688:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1788528430.272712:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528430.275588:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735476224 00000100:00100000:1.0:1788528430.275602:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735476224 00000100:00100000:1.0:1788528430.275661:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735474432 00000100:00100000:1.0:1788528430.275665:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735474432 00000100:00100000:1.0:1788528430.275693:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788528430.275977:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc374e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735475584:0@lo:400:kworker.0 00000100:00100000:3.0:1788528430.276447:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528430.276476:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735476096:0@lo:400:kworker.0 00000100:00100000:3.0:1788528430.276502:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528430.276537:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735474688:0@lo:400:kworker.0 00000100:00100000:3.0:1788528430.276587:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735475584 00000100:00100000:3.0:1788528430.276590:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735475584 00000100:00100000:3.0:1788528430.276622:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735476096 00000100:00100000:3.0:1788528430.276625:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735476096 00000100:00100000:3.0:1788528430.276637:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788528430.276651:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735475584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528430.276716:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735475584:12345-0@lo:400:kworker.0 Request processed in 65us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528430.276878:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788528430.276898:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788528430.276904:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1875407735476096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528430.276934:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1875407735476096:12345-0@lo:400:kworker.0 Request processed in 31us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528430.276940:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:3.0:1788528430.276975:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc374e300 x1875407735475584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528430.276987:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc374e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735475584:0@lo:400:kworker.0 00000100:00100000:3.0:1788528430.276995:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1788528430.277000:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a90f5a0b800, transno 4294967301 00000100:00100000:3.0:1788528430.277011:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735476096:0@lo:400:kworker.0 00000100:00100000:3.0:1788528430.277299:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788528430.277309:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735474432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788528430.277332:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788528430.277439:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735474432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (4789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528430.277446:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788528430.277482:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe6e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735474432:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788528430.277658:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788528430.277664:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788528430.279282:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735476224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788528430.279310:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528430.279390:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735476224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3674us (7101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528430.279398:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788528430.279464:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3f75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735476224:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788528430.279886:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735474560 00000100:00100000:0.0:1788528430.279894:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735474560 00000100:00100000:0.0:1788528430.279940:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735475072 00000100:00100000:0.0:1788528430.279944:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735475072 00000100:00100000:0.0:1788528430.279960:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788528430.279967:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735474560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788528430.279993:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788528430.280035:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735474560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (9107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528430.280041:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788528430.280056:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788528430.280076:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735475072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528430.280128:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735475072:12345-0@lo:400:kworker.0 Request processed in 52us (7417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528430.280135:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788528430.280170:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735475072:0@lo:400:kworker.0 00000100:00100000:1.0:1788528430.282342:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3f75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735474560:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788528431.230977:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528431.295188:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788528431.295221:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe6e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735476352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788528431.295292:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528431.295414:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735476352 00000100:00100000:0.0:1788528431.295422:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735476352 00000100:00100000:0.0:1788528431.295474:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788528431.295483:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735476352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788528431.295511:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528431.295579:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735476352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528431.295585:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:3.0:1788528431.295668:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90fe6e6a00 x1875407735476352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528431.295697:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe6e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735476352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788528431.295966:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788528431.295977:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735476480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788528431.296009:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528431.296120:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735476480 00000100:00100000:2.0:1788528431.296126:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735476480 00000100:00100000:2.0:1788528431.296161:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788528431.296168:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3f75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735476480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788528431.296180:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528431.296231:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3f75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735476480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528431.296237:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:1.0:1788528431.296305:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f8e22300 x1875407735476480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528431.296318:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735476480:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788528432.256708:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528432.318749:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735476608:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788528432.318821:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528432.318887:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735476608 00000100:00100000:1.0:1788528432.318894:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735476608 00000100:00100000:1.0:1788528432.318948:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788528432.318956:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735476608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788528432.318988:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:1.0:1788528432.319040:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735476608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528432.319047:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788528432.319164:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735476608:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788528433.279432:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788528433.791395:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788528433.794340:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788528434.306262:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528434.376388:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528434.376433:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528434.376534:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528434.380279:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719658112 00000100:00100000:3.0:1788528434.380303:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719658112 00000100:00100000:3.0:1788528434.380421:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 397 00000100:00100000:3.0:1788528434.380435:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2403:x1875407719658112:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528434.380542:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2403:x1875407719658112:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 110us (4169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528434.380550:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 397 00000100:00100000:0.0:1788528434.381728:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528434.381805:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719658368 00000100:00100000:1.0:1788528434.381815:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719658368 00000100:00100000:1.0:1788528434.381878:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719658624 00000100:00100000:1.0:1788528434.381881:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719658624 00000100:00100000:1.0:1788528434.381904:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 228 00000100:00100000:1.0:1788528434.381913:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719658368:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528434.381983:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719658368:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 72us (5549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528434.381991:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 228 00000100:00100000:1.0:1788528434.382007:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 229 00000100:00100000:1.0:1788528434.382013:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719658624:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528434.382036:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719658624:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 23us (5502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528434.382042:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 229 00000100:00100000:2.0:1788528434.383977:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719658240 00000100:00100000:2.0:1788528434.383998:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719658240 00000100:00100000:2.0:1788528434.384099:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 230 00000100:00100000:2.0:1788528434.384110:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719658240:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528434.384229:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719658240:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 120us (2507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528434.384237:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 230 00000100:00080000:2.0:1788528434.384295:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788528434.384300:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788528434.384665:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528434.384702:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528434.385667:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719658752 00000100:00100000:1.0:1788528434.385679:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719658752 00000100:00100000:1.0:1788528434.385764:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 231 00000100:00100000:1.0:1788528434.385775:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719658752:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528434.385851:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719658752:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 78us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528434.385858:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 231 00000100:00080000:2.0:1788528434.386443:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788528434.386881:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719658496 00000100:00100000:3.0:1788528434.386890:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719658496 00000100:00100000:3.0:1788528434.387119:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 87 00000100:00100000:3.0:1788528434.387130:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719658496:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528434.387212:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719658496:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 84us (2548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528434.387220:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 87 00000100:00080000:2.0:1788528434.387801:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788528435.327222:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528435.390997:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788528435.391029:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3f75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735476736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788528435.391117:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528435.391371:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735476736 00000100:00100000:2.0:1788528435.391380:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735476736 00000100:00100000:2.0:1788528435.391451:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788528435.391462:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735476736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788528435.391504:0:9268:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788528435.391586:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735476736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528435.391594:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788528435.392174:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735476864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788528435.392242:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528435.392333:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3f75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735476736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788528435.392421:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735476864 00000100:00100000:0.0:1788528435.392428:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735476864 00000100:00100000:0.0:1788528435.392492:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788528435.392502:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3f74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735476864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788528435.392531:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528435.392610:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3f74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735476864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528435.392618:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:2.0:1788528435.392751:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788528435.392934:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735476864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788528435.393370:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735477248:0@lo:400:kworker.0 00000100:00100000:0.0:1788528435.393425:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528435.393450:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735477760:0@lo:400:kworker.0 00000100:00100000:0.0:1788528435.393477:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528435.393495:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735478272:0@lo:400:kworker.0 00000100:00100000:0.0:1788528435.393516:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528435.393535:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788528435.393540:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe6e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735477120:0@lo:400:kworker.0 00000100:00100000:0.0:1788528435.393580:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528435.393596:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe6e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1875407735477632:0@lo:400:kworker.0 00000100:00100000:0.0:1788528435.393615:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528435.393630:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735478144:0@lo:400:kworker.0 00000100:00100000:0.0:1788528435.393651:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528435.393699:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe6e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735476992:0@lo:400:kworker.0 00000100:00100000:0.0:1788528435.393730:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528435.394060:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735477760 00000100:00100000:3.0:1788528435.394069:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735477760 00000100:00100000:3.0:1788528435.394120:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735478272 00000100:00100000:3.0:1788528435.394124:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735478272 00000100:00100000:3.0:1788528435.394149:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788528435.394157:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fabb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735477760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528435.394239:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fabb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735477760:12345-0@lo:400:kworker.0 Request processed in 82us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528435.394247:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788528435.394492:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735477248 00000100:00100000:2.0:1788528435.394496:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735477248 00000100:00100000:2.0:1788528435.394531:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735477120 00000100:00100000:2.0:1788528435.394534:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735477120 00000100:00100000:2.0:1788528435.394550:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735477632 00000100:00100000:2.0:1788528435.394568:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735477632 00000100:00100000:2.0:1788528435.394583:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735478144 00000100:00100000:2.0:1788528435.394586:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735478144 00000100:00100000:2.0:1788528435.394600:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788528435.394614:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735477248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528435.394654:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735477248:12345-0@lo:400:kworker.0 Request processed in 41us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528435.394661:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788528435.394804:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788528435.394812:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735477120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528435.394843:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735477120:12345-0@lo:400:kworker.0 Request processed in 32us (1263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528435.394849:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788528435.394864:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788528435.394869:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875407735477632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528435.394898:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875407735477632:12345-0@lo:400:kworker.0 Request processed in 29us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528435.394903:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788528435.395172:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788528435.395184:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735478144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528435.395221:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735478144:12345-0@lo:400:kworker.0 Request processed in 41us (1569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528435.395229:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788528435.395256:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788528435.395265:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735478272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528435.395296:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735478272:12345-0@lo:400:kworker.0 Request processed in 34us (1779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528435.395302:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788528435.395330:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe6e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735477376:0@lo:400:kworker.0 00000100:00100000:1.0:1788528435.395368:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788528435.397332:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788528435.397342:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788528435.397345:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788528435.397397:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe6e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735477120:0@lo:400:kworker.0 00010000:00080000:3.0:1788528435.397419:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90fe6e4380 x1875407735477632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528435.397431:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe6e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1875407735477632:0@lo:400:kworker.0 00010000:00080000:3.0:1788528435.397445:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90c81a6d80 x1875407735478144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528435.397452:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735478144:0@lo:400:kworker.0 00000100:00100000:3.0:1788528435.397466:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735477248:0@lo:400:kworker.0 00010000:00080000:3.0:1788528435.397479:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90c81a4e00 x1875407735477760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528435.397488:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735477760:0@lo:400:kworker.0 00000100:00100000:3.0:1788528435.397501:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735478272:0@lo:400:kworker.0 00000100:00100000:3.0:1788528435.397633:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735477376 00000100:00100000:3.0:1788528435.397640:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735477376 00000100:00100000:0.0:1788528435.398623:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe6e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735477504:0@lo:400:kworker.0 00000100:00100000:0.0:1788528435.398900:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528435.399049:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735478016:0@lo:400:kworker.0 00000100:00100000:0.0:1788528435.399076:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528435.399103:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788528435.399109:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735478400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788528435.399159:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528435.400863:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788528435.400890:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735477376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528435.403046:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735476992 00000100:00100000:2.0:1788528435.403067:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735476992 00000100:00100000:2.0:1788528435.403159:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1788528435.403181:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d9d54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:3638:x1875407735476992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528435.403296:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d9d54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:3638:x1875407735476992:12345-0@lo:400:kworker.0 Request processed in 116us (9563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528435.403603:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe6e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735476992:0@lo:400:kworker.0 00000100:00100000:0.0:1788528435.403651:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735478400 00000100:00100000:0.0:1788528435.403656:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735478400 00000100:00100000:3.0:1788528435.403823:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735477376:12345-0@lo:400:kworker.0 Request processed in 2946us (8453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528435.403852:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788528435.404548:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe6e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735477376:0@lo:400:kworker.0 00000100:00100000:1.0:1788528435.404578:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735477888:0@lo:400:kworker.0 00000100:00100000:1.0:1788528435.404633:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528435.405348:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788528435.405364:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735478400:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788528435.405571:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735477504 00000100:00100000:3.0:1788528435.405580:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735477504 00000100:00100000:3.0:1788528435.405628:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735478016 00000100:00100000:3.0:1788528435.405632:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735478016 00000100:00100000:3.0:1788528435.405659:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788528435.405666:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735477504:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1788528435.406203:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528435.406291:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735478400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 933us (7130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528435.406300:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788528435.406377:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735478400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788528435.406492:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735477888 00000100:00100000:0.0:1788528435.406498:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735477888 00000100:00100000:0.0:1788528435.406539:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788528435.406547:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3f77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735477888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528435.406604:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3f77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735477888:12345-0@lo:400:kworker.0 Request processed in 58us (1972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528435.406611:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1788528435.406644:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788528435.406649:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788528435.406662:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788528435.406671:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735478016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528435.406811:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735477504:12345-0@lo:400:kworker.0 Request processed in 1145us (7910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528435.406819:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788528435.407046:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00010000:00080000:1.0:1788528435.407186:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90c81a5f80 x1875407735477888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528435.407200:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735477888:0@lo:400:kworker.0 00000100:00100000:1.0:1788528435.407244:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe6e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735477504:0@lo:400:kworker.0 00000100:00100000:0.0:1788528435.407334:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735478016:12345-0@lo:400:kworker.0 Request processed in 664us (8256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528435.407341:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788528435.407536:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735478016:0@lo:400:kworker.0 00010000:00010000:2.0:1788528436.350881:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528436.415191:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735478528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788528436.415294:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528436.415709:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735478528 00000100:00100000:2.0:1788528436.415720:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735478528 00000100:00100000:2.0:1788528436.415792:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788528436.415804:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3f77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735478528:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788528436.415845:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735478656:0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788528436.415865:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788528436.415893:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528436.415935:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3f77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735478528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528436.415945:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788528436.415949:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735478656 00000100:00100000:3.0:1788528436.415954:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735478656 00000100:00100000:3.0:1788528436.415990:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788528436.415999:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735478656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788528436.416011:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788528436.416063:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735478656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528436.416069:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:1.0:1788528436.416264:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f8e22680 x1875407735478528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528436.416286:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735478528:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788528436.416882:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90c81a5c00 x1875407735478656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528436.416901:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735478656:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788528437.374886:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528437.439216:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735478784:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788528437.439578:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528437.439820:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735478784 00000100:00100000:3.0:1788528437.439832:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735478784 00000100:00100000:3.0:1788528437.439892:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788528437.439904:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735478784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788528437.439950:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788528437.440028:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735478784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528437.440054:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788528437.441036:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735478784:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788528438.399654:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528439.422827:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528439.495062:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528439.495175:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528439.495216:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528439.495604:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719659136 00000100:00100000:1.0:1788528439.495615:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719659136 00000100:00100000:1.0:1788528439.495676:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719659008 00000100:00100000:1.0:1788528439.495679:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719659008 00000100:00100000:1.0:1788528439.495702:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 238 00000100:00100000:1.0:1788528439.495711:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719659136:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528439.495783:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719659136:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 74us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528439.495791:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 238 00000100:00100000:1.0:1788528439.495807:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 239 00000100:00100000:1.0:1788528439.495813:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719659008:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528439.495838:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719659008:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 25us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528439.495843:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 239 00000100:00080000:0.0:1788528439.496195:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788528439.496200:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788528439.496330:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719658880 00000100:00100000:2.0:1788528439.496394:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719658880 00000100:00100000:2.0:1788528439.496476:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 399 00000100:00100000:2.0:1788528439.496485:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2403:x1875407719658880:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528439.496531:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2403:x1875407719658880:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 48us (1479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528439.496538:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 399 00000100:00100000:0.0:1788528439.533240:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528439.533389:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528439.541341:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528439.542886:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719659264 00000100:00100000:2.0:1788528439.542899:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719659264 00000100:00100000:2.0:1788528439.542988:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:2.0:1788528439.543000:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2402:x1875407719659264:12345-192.168.203.38@tcp:9:kworker.0 00000020:00000080:2.0:1788528439.543027:0:8421:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c7c06 00000100:00080000:2.0:1788528439.543037:0:8421:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d0d000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788528439.543079:0:8421:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1788528439.543270:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+2:2402:x1875407719659264:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 272us (1937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528439.543278:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 27 00010000:00010000:2.0:1788528439.543300:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788528439.545403:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788528439.552051:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719659392 00000100:00100000:3.0:1788528439.552067:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719659392 00000100:00100000:3.0:1788528439.552173:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719659520 00000100:00100000:3.0:1788528439.552177:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719659520 00000100:00100000:3.0:1788528439.552214:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 240 00000100:00100000:3.0:1788528439.552224:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2404:x1875407719659392:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528439.552305:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2404:x1875407719659392:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 82us (19074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528439.552313:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 240 00000100:00100000:3.0:1788528439.552332:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 241 00000100:00100000:3.0:1788528439.552339:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2404:x1875407719659520:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528439.552379:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2404:x1875407719659520:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 27us (18977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528439.552385:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 241 00000100:00080000:0.0:1788528439.552802:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788528439.552807:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788528440.449905:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528440.510866:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735478912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788528440.510908:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735479040:0@lo:400:kworker.0 00000100:00100000:1.0:1788528440.510908:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735479168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788528440.511014:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528440.511015:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528440.511072:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788528440.511080:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735479296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788528440.511123:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528440.511175:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735479296 00000100:00100000:1.0:1788528440.511184:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735479296 00000100:00100000:1.0:1788528440.513118:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788528440.513145:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3f74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735479296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788528440.513177:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528440.513434:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3f74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735479296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 305us (2309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528440.513441:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1788528440.513470:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788528440.513487:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735479680:0@lo:400:kworker.0 00000100:00100000:1.0:1788528440.513609:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528440.513674:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735479296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788528440.513705:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735479168 00000100:00100000:1.0:1788528440.513710:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735479168 00000100:00100000:0.0:1788528440.514508:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735480192:0@lo:400:kworker.0 00000100:00100000:0.0:1788528440.514573:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528440.514608:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788528440.514614:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1875407735479808:0@lo:400:kworker.0 00000100:00100000:0.0:1788528440.514640:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528440.514664:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1875407735480320:0@lo:400:kworker.0 00000100:00100000:0.0:1788528440.514685:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528440.514733:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735480192 00000100:00100000:0.0:1788528440.514738:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735480192 00000100:00100000:0.0:1788528440.514781:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788528440.514790:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735480192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528440.514833:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735480192:12345-0@lo:400:kworker.0 Request processed in 44us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528440.514839:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788528440.514860:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735479808 00000100:00100000:0.0:1788528440.514863:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735479808 00000100:00100000:0.0:1788528440.514891:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735480320 00000100:00100000:0.0:1788528440.514907:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735480320 00000100:00100000:0.0:1788528440.514933:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788528440.514940:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875407735479808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528440.515324:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875407735479808:12345-0@lo:400:kworker.0 Request processed in 383us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528440.515330:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788528440.515344:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788528440.515351:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875407735480320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528440.515385:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875407735480320:12345-0@lo:400:kworker.0 Request processed in 35us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528440.515391:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:0.0:1788528440.515415:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788528440.515419:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788528440.515443:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1875407735479808:0@lo:400:kworker.0 00000100:00100000:0.0:1788528440.515457:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1875407735480320:0@lo:400:kworker.0 00000100:00100000:1.0:1788528440.515467:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735479680 00010000:00080000:0.0:1788528440.515471:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90fab2c700 x1875407735480192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528440.515473:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735479680 00000100:00100000:0.0:1788528440.515485:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735480192:0@lo:400:kworker.0 00000100:00100000:1.0:1788528440.515495:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788528440.515504:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735479168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788528440.515596:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788528440.515635:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735479168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (4630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528440.515642:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788528440.515653:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788528440.515658:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735479680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528440.515681:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735479680:12345-0@lo:400:kworker.0 Request processed in 23us (2072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528440.515695:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788528440.515756:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735479040 00000100:00100000:0.0:1788528440.515761:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735479040 00000100:00100000:0.0:1788528440.515793:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1788528440.515800:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735479040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528440.515905:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735479680:0@lo:400:kworker.0 00000100:00100000:0.0:1788528440.516641:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735479040:12345-0@lo:400:kworker.0 Request processed in 839us (5632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528440.516650:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1788528440.517222:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735479168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788528440.518568:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735479040:0@lo:400:kworker.0 00000100:00100000:3.0:1788528440.518599:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735479424:0@lo:400:kworker.0 00000100:00100000:3.0:1788528440.518648:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528440.518686:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735479936:0@lo:400:kworker.0 00000100:00100000:2.0:1788528440.518707:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528440.518721:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528440.518816:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735478912 00000100:00100000:0.0:1788528440.518827:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735478912 00000100:00100000:0.0:1788528440.518901:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788528440.518912:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735478912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788528440.518944:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528440.519853:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735479424 00000100:00100000:1.0:1788528440.519863:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735479424 00000100:00100000:1.0:1788528440.519916:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735479936 00000100:00100000:1.0:1788528440.519920:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735479936 00000100:00100000:1.0:1788528440.519948:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788528440.519957:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735479424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528440.524771:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788528440.524805:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735479936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528440.524883:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735479936:12345-0@lo:400:kworker.0 Request processed in 84us (6163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528440.524891:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00010000:00080000:3.0:1788528440.524946:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90fab2c000 x1875407735479936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528440.524961:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735479936:0@lo:400:kworker.0 00000100:00100000:3.0:1788528440.525990:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1875407735480448:0@lo:400:kworker.0 00000100:00100000:3.0:1788528440.526043:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528440.526082:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735480448 00000100:00100000:3.0:1788528440.526089:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735480448 00000100:00100000:3.0:1788528440.526145:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788528440.526153:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875407735480448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528440.526193:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875407735480448:12345-0@lo:400:kworker.0 Request processed in 41us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528440.526215:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00010000:00080000:3.0:1788528440.526256:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90fab2f480 x1875407735480448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528440.526268:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1875407735480448:0@lo:400:kworker.0 00000100:00100000:3.0:1788528440.526292:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788528440.526299:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735479552:0@lo:400:kworker.0 00000100:00100000:3.0:1788528440.526323:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528440.526342:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735479552 00000100:00100000:3.0:1788528440.526346:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735479552 00000100:00100000:3.0:1788528440.526368:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788528440.526386:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735479552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528440.526416:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735479552:12345-0@lo:400:kworker.0 Request processed in 31us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528440.526422:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788528440.526448:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735479552:0@lo:400:kworker.0 00000100:00100000:3.0:1788528440.526455:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735480064:0@lo:400:kworker.0 00000100:00100000:3.0:1788528440.526480:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528440.526506:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735480064 00000100:00100000:3.0:1788528440.526509:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735480064 00000100:00100000:3.0:1788528440.526946:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788528440.526955:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735480064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528440.527050:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735480064:12345-0@lo:400:kworker.0 Request processed in 97us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528440.527057:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:3.0:1788528440.527092:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90fab2e680 x1875407735480064/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528440.527103:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735480064:0@lo:400:kworker.0 00000100:00100000:3.0:1788528440.527111:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735480576:0@lo:400:kworker.0 00000100:00100000:3.0:1788528440.527149:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528440.527175:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735480576 00000100:00100000:3.0:1788528440.527179:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735480576 00000100:00100000:3.0:1788528440.527623:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788528440.527631:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3637:x1875407735480576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528440.527667:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3637:x1875407735480576:12345-0@lo:400:kworker.0 Request processed in 38us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528440.527686:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788528440.527719:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735480576:0@lo:400:kworker.0 00000100:00080000:3.0:1788528440.528251:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788528440.528258:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788528440.528261:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788528440.528497:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735479424:12345-0@lo:400:kworker.0 Request processed in 8538us (9846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528440.528506:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788528440.529169:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735479424:0@lo:400:kworker.0 00000100:00100000:0.0:1788528440.539877:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735478912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 20952us (21162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528440.539895:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788528440.549443:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735478912:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788528441.470854:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528441.534877:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788528441.534900:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc327df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735480704:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788528441.534970:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528441.535089:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735480704 00000100:00100000:0.0:1788528441.535098:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735480704 00000100:00100000:0.0:1788528441.535155:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788528441.535164:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735480704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788528441.535191:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528441.535257:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735480704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528441.535264:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:2.0:1788528441.535637:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc327df80 x1875407735480704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528441.535654:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc327df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735480704:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788528441.536719:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735480832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788528441.536789:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528441.537032:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735480832 00000100:00100000:2.0:1788528441.537040:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735480832 00000100:00100000:2.0:1788528441.537087:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788528441.537096:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735480832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788528441.537113:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528441.537167:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735480832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528441.537173:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:2.0:1788528441.537218:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f8e22680 x1875407735480832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528441.537234:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735480832:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788528442.500480:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528442.564720:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735480960:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788528442.564830:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528442.564928:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735480960 00000100:00100000:2.0:1788528442.564939:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735480960 00000100:00100000:2.0:1788528442.565001:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788528442.565011:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735480960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788528442.565053:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788528442.565106:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735480960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528442.565127:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788528442.565188:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735480960:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788528443.008159:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788528443.015920:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788528443.522738:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528444.547712:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528444.616255:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528444.616303:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528444.616335:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719659776 00000100:00100000:0.0:1788528444.616343:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719659776 00000100:00100000:0.0:1788528444.616413:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 248 00000100:00100000:0.0:1788528444.616424:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2406:x1875407719659776:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528444.616502:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2406:x1875407719659776:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 81us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528444.616510:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 248 00000100:00080000:1.0:1788528444.617464:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788528444.617484:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719659648 00000100:00100000:1.0:1788528444.617492:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719659648 00000100:00100000:1.0:1788528444.617528:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 401 00000100:00100000:1.0:1788528444.617538:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2406:x1875407719659648:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528444.617610:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2406:x1875407719659648:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 75us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528444.617618:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 401 00000100:00100000:3.0:1788528444.617668:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528444.618649:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528444.618688:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528444.618839:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719660032 00000100:00100000:2.0:1788528444.618846:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719660032 00000100:00100000:2.0:1788528444.618891:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719659904 00000100:00100000:2.0:1788528444.618894:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719659904 00000100:00100000:2.0:1788528444.618990:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719660160 00000100:00100000:2.0:1788528444.618995:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719660160 00000100:00100000:2.0:1788528444.619016:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 249 00000100:00100000:2.0:1788528444.619023:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2405:x1875407719660032:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528444.619075:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2405:x1875407719660032:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 52us (1415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528444.619081:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 249 00000100:00100000:2.0:1788528444.619111:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 250 00000100:00100000:2.0:1788528444.619118:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2405:x1875407719659904:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528444.619143:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2405:x1875407719659904:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 26us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528444.619161:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 250 00000100:00100000:2.0:1788528444.619175:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 251 00000100:00100000:2.0:1788528444.619181:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2405:x1875407719660160:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528444.619206:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2405:x1875407719660160:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 25us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528444.619212:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 251 00000100:00080000:1.0:1788528444.619585:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788528444.619593:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788528445.567962:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528445.630708:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735481216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788528445.630708:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735481088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788528445.631611:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528445.631669:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735481728:0@lo:400:kworker.0 00000100:00100000:0.0:1788528445.632184:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528445.632892:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735482240:0@lo:400:kworker.0 00000100:00100000:0.0:1788528445.632932:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528445.632970:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735482752:0@lo:400:kworker.0 00000100:00100000:0.0:1788528445.632997:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528445.633601:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788528445.633611:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735481344:0@lo:400:kworker.0 00000100:00100000:0.0:1788528445.633648:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528445.633674:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735481856:0@lo:400:kworker.0 00000100:00100000:0.0:1788528445.633699:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528445.633716:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735482368:0@lo:400:kworker.0 00000100:00100000:0.0:1788528445.633737:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528445.633754:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735482880:0@lo:400:kworker.0 00000100:00100000:0.0:1788528445.633777:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528445.634057:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528445.634109:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735481600:0@lo:400:kworker.0 00000100:00100000:1.0:1788528445.634140:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528445.634158:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735482112:0@lo:400:kworker.0 00000100:00100000:1.0:1788528445.634183:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528445.634202:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1875407735482624:0@lo:400:kworker.0 00000100:00100000:1.0:1788528445.634224:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528445.634242:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788528445.634249:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f8e22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735481472:0@lo:400:kworker.0 00000100:00100000:1.0:1788528445.634272:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528445.634292:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735481984:0@lo:400:kworker.0 00000100:00100000:1.0:1788528445.634316:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528445.634333:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735482496:0@lo:400:kworker.0 00000100:00100000:1.0:1788528445.634352:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528445.634492:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735483008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788528445.634600:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528445.634702:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735481856 00000100:00100000:1.0:1788528445.634710:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735481856 00000100:00100000:1.0:1788528445.634743:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735481216 00000100:00100000:1.0:1788528445.634746:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735481216 00000100:00100000:1.0:1788528445.634758:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735481600 00000100:00100000:1.0:1788528445.634760:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735481600 00000100:00100000:1.0:1788528445.634773:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788528445.634793:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735481856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528445.635592:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735481088 00000100:00100000:0.0:1788528445.635599:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735481088 00000100:00100000:0.0:1788528445.635654:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735483008 00000100:00100000:0.0:1788528445.635657:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735483008 00000100:00100000:0.0:1788528445.635675:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788528445.635681:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735481088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788528445.635705:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000001:00100000:2.0:1788528445.636181:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 80304108-f3b9-46ea-888c-b2a7ec20e3e2 00000020:00000080:2.0:1788528445.636187:0:9506:0:(genops.c:885:class_export_put()) final put ffff8a8fc3d0b800/80304108-f3b9-46ea-888c-b2a7ec20e3e2 00000020:00000080:2.0:1788528445.636323:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3d0b800/80304108-f3b9-46ea-888c-b2a7ec20e3e2 for lustre-OST0001 00000020:00000080:2.0:1788528445.636362:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc3d0d000 for lustre-OST0001 00000100:00100000:2.0:1788528445.639395:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788528445.639417:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735483008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788528445.639446:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528445.639937:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735483008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 528us (5335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528445.639946:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788528445.639989:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735482240 00000100:00100000:2.0:1788528445.639996:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735482240 00000100:00100000:1.0:1788528445.640051:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735481856:12345-0@lo:400:kworker.0 Request processed in 5267us (6347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528445.640060:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788528445.640137:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735483008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788528445.640168:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788528445.640176:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1875407735481216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788528445.640205:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788528445.640208:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735482752 00000100:00100000:1.0:1788528445.640246:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1875407735481216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (6189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528445.640253:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788528445.640266:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788528445.640273:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735481600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528445.640278:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735482752 00000100:00100000:2.0:1788528445.640304:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735482368 00000100:00100000:2.0:1788528445.640308:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735482368 00000100:00100000:1.0:1788528445.640311:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735481600:12345-0@lo:400:kworker.0 Request processed in 37us (6169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528445.640320:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788528445.640325:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735482880 00000100:00100000:2.0:1788528445.640329:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735482880 00000100:00100000:1.0:1788528445.640346:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735481728 00000100:00100000:2.0:1788528445.640349:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788528445.640352:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735481728 00000100:00100000:2.0:1788528445.640359:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735482240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528445.640493:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735482112 00000100:00100000:1.0:1788528445.640497:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735482112 00000100:00100000:1.0:1788528445.640729:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735482624 00000100:00100000:1.0:1788528445.640733:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735482624 00000100:00100000:1.0:1788528445.640748:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735481472 00000100:00100000:1.0:1788528445.640751:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735481472 00000100:00100000:1.0:1788528445.640764:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735481984 00000100:00100000:1.0:1788528445.640766:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735481984 00000100:00100000:1.0:1788528445.640791:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735482496 00000100:00100000:1.0:1788528445.640795:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735482496 00000100:00100000:1.0:1788528445.640811:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788528445.640817:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735481728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528445.642662:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1875407735481088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6974us (11045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528445.642676:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788528445.642742:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735481856:0@lo:400:kworker.0 00000100:00100000:2.0:1788528445.648548:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735482240:12345-0@lo:400:kworker.0 Request processed in 8182us (15606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528445.648577:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788528445.648612:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788528445.648624:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735482752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528445.648692:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735482752:12345-0@lo:400:kworker.0 Request processed in 72us (15693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528445.648698:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788528445.648711:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788528445.648718:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735482368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528445.648755:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735482368:12345-0@lo:400:kworker.0 Request processed in 38us (15017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528445.648761:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788528445.648774:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788528445.648781:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735482880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528445.649147:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735482880:12345-0@lo:400:kworker.0 Request processed in 366us (15368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528445.649154:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788528445.649194:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735481344 00000100:00100000:2.0:1788528445.649203:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735481344 00000100:00100000:2.0:1788528445.649643:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1788528445.649651:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:3639:x1875407735481344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528445.649750:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:3639:x1875407735481344:12345-0@lo:400:kworker.0 Request processed in 99us (16100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528445.649756:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1788528445.650545:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788528445.650580:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875407735482112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528445.650626:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875407735482112:12345-0@lo:400:kworker.0 Request processed in 52us (16443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528445.650632:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788528445.650651:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788528445.650668:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875407735482624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528445.650698:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875407735482624:12345-0@lo:400:kworker.0 Request processed in 32us (16474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528445.650704:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788528445.650717:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788528445.650724:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735481472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528445.650754:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735481472:12345-0@lo:400:kworker.0 Request processed in 30us (16482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528445.650759:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788528445.650771:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788528445.650777:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735481984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528445.653625:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735481984:12345-0@lo:400:kworker.0 Request processed in 2838us (19299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528445.653639:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788528445.653689:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788528445.653706:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735482496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528445.653768:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735482496:12345-0@lo:400:kworker.0 Request processed in 72us (19415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528445.653775:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00080000:2.0:1788528445.655739:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788528445.655747:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788528445.655751:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788528445.655753:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788528445.655831:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735481472:0@lo:400:kworker.0 00000100:00100000:2.0:1788528445.655847:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735481984:0@lo:400:kworker.0 00000100:00100000:2.0:1788528445.655858:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735482496:0@lo:400:kworker.0 00000100:00100000:2.0:1788528445.655869:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735481600:0@lo:400:kworker.0 00010000:00080000:2.0:1788528445.655883:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6ea0e00 x1875407735482112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528445.655893:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735482112:0@lo:400:kworker.0 00010000:00080000:2.0:1788528445.655904:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc30aca80 x1875407735482624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528445.655910:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1875407735482624:0@lo:400:kworker.0 00000100:00100000:2.0:1788528445.655926:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735481216:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788528445.656733:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735481728:12345-0@lo:400:kworker.0 Request processed in 15911us (24545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528445.656757:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788528445.660938:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735481728:0@lo:400:kworker.0 00010000:00080000:1.0:1788528445.665381:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6ea0380 x1875407735482240/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528445.665400:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735482240:0@lo:400:kworker.0 00000100:00100000:1.0:1788528445.665416:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735482752:0@lo:400:kworker.0 00000100:00100000:1.0:1788528445.665436:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735481088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788528445.665474:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f8e22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735481344:0@lo:400:kworker.0 00010000:00080000:1.0:1788528445.666115:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6ea3b80 x1875407735482368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528445.666127:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735482368:0@lo:400:kworker.0 00000100:00100000:1.0:1788528445.666143:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735482880:0@lo:400:kworker.0 00010000:00010000:2.0:1788528446.594790:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528446.659214:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788528446.659246:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735483136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788528446.659352:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528446.659449:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735483136 00000100:00100000:1.0:1788528446.659459:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735483136 00000100:00100000:1.0:1788528446.659517:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788528446.659527:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735483136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788528446.659592:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528446.659645:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735483136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528446.659652:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:1.0:1788528446.659712:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3c60a80 x1875407735483136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528446.659736:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735483136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788528446.661116:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788528446.661137:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735483264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788528446.661196:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528446.661491:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735483264 00000100:00100000:0.0:1788528446.661500:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735483264 00000100:00100000:0.0:1788528446.661577:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788528446.661587:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735483264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788528446.661608:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528446.661654:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735483264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528446.661662:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:3.0:1788528446.661745:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6da2300 x1875407735483264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528446.661764:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735483264:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788528447.616503:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528447.679461:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735483392:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788528447.679589:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528447.679881:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735483392 00000100:00100000:1.0:1788528447.679892:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735483392 00000100:00100000:1.0:1788528447.679971:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788528447.679983:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735483392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788528447.680037:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:1.0:1788528447.681152:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735483392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1166us (1557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528447.681165:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788528447.681260:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735483392:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788528448.639499:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788528449.186408:0:14049:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 09:27:27 (1788528447) 00010000:00010000:1.0:1788528449.666776:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528449.733798:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528449.733901:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528449.733987:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528449.734269:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719660288 00000100:00100000:0.0:1788528449.734285:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719660288 00000100:00100000:0.0:1788528449.734342:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 403 00000100:00100000:0.0:1788528449.734350:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2404:x1875407719660288:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528449.734410:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2404:x1875407719660288:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 61us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528449.734428:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 403 00000100:00100000:2.0:1788528449.735112:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719660416 00000100:00100000:2.0:1788528449.735117:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719660416 00000100:00080000:3.0:1788528449.735250:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788528449.735379:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528449.737496:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719660544 00000100:00100000:2.0:1788528449.737506:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719660544 00000100:00100000:0.0:1788528449.737531:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528449.737599:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719660800 00000100:00100000:0.0:1788528449.737603:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719660800 00000100:00100000:0.0:1788528449.737632:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 258 00000100:00100000:1.0:1788528449.737636:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719660672 00000100:00100000:1.0:1788528449.737643:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719660672 00000100:00100000:0.0:1788528449.737643:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719660416:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528449.737676:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 259 00000100:00100000:1.0:1788528449.737685:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2404:x1875407719660544:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528449.737714:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719660416:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 71us (3922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528449.737721:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2404:x1875407719660544:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 35us (2342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528449.737727:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 258 00000100:00100000:1.0:1788528449.738160:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 259 00000100:00100000:0.0:1788528449.738167:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 260 00000100:00100000:1.0:1788528449.738180:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 261 00000100:00100000:0.0:1788528449.738181:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2404:x1875407719660800:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528449.738191:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719660672:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528449.738224:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719660672:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 36us (4236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528449.738229:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 261 00000100:00080000:1.0:1788528449.738373:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788528449.738388:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788528449.738391:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2404:x1875407719660800:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 38us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528449.738403:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 260 00010000:00010000:2.0:1788528450.689814:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528450.751128:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735483648:0@lo:400:kworker.0 00000100:00100000:2.0:1788528450.751235:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528450.751311:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735484160:0@lo:400:kworker.0 00000100:00100000:0.0:1788528450.751369:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735483776:0@lo:400:kworker.0 00000100:00100000:2.0:1788528450.751377:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528450.751409:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735484672:0@lo:400:kworker.0 00000100:00100000:3.0:1788528450.751502:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735483520:0@lo:400:kworker.0 00000100:00100000:1.0:1788528450.751636:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735483648 00000100:00100000:1.0:1788528450.751644:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735483648 00000100:00100000:1.0:1788528450.751687:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735484160 00000100:00100000:1.0:1788528450.751690:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735484160 00000100:00100000:1.0:1788528450.751717:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788528450.751725:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735483648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528450.751894:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528450.751935:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735485184:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528450.752150:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528450.752194:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735483904:0@lo:400:kworker.0 00000100:00100000:2.0:1788528450.752292:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528450.752305:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735484416:0@lo:400:kworker.0 00000100:00100000:2.0:1788528450.752329:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528450.752491:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735484928:0@lo:400:kworker.0 00000100:00100000:0.0:1788528450.752506:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528450.752566:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735484288:0@lo:400:kworker.0 00000100:00100000:0.0:1788528450.752602:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528450.752615:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735484800:0@lo:400:kworker.0 00000100:00100000:0.0:1788528450.752637:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528450.752656:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fab2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735485312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788528450.752680:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528450.752734:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735485184 00000100:00100000:0.0:1788528450.752739:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735485184 00000100:00100000:0.0:1788528450.752770:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735483776 00000100:00100000:0.0:1788528450.752773:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735483776 00000100:00100000:0.0:1788528450.752785:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788528450.752792:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3638:x1875407735485184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788528450.752819:0:9268:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788528450.752862:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3638:x1875407735485184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528450.752869:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788528450.752884:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788528450.752890:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735483776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528450.752922:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735483776:12345-0@lo:400:kworker.0 Request processed in 33us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528450.752928:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788528450.752942:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735485312 00000100:00100000:0.0:1788528450.752945:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735485312 00000100:00100000:0.0:1788528450.752966:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788528450.752971:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735485312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788528450.754705:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528450.754782:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735485312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1808us (2098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528450.754791:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788528450.754865:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fab2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735485312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788528450.754881:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735483776:0@lo:400:kworker.0 00000100:00100000:0.0:1788528450.754923:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735485184:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1788528450.754980:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788528450.756100:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788528450.756119:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735484672 00000100:00100000:0.0:1788528450.756127:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735484672 00000100:00100000:0.0:1788528450.756172:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735483904 00000100:00100000:0.0:1788528450.756175:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735483904 00000100:00100000:0.0:1788528450.756184:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735484288 00000100:00100000:0.0:1788528450.756186:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735484288 00000100:00100000:0.0:1788528450.756196:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735484800 00000100:00100000:0.0:1788528450.756198:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735484800 00000100:00100000:0.0:1788528450.756286:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788528450.756294:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735484160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528450.756363:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735484160:12345-0@lo:400:kworker.0 Request processed in 70us (4990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528450.756371:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788528450.756386:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788528450.756392:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735484672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528450.756422:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735484672:12345-0@lo:400:kworker.0 Request processed in 31us (4530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528450.756429:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788528450.756441:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788528450.756447:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735483904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528450.756473:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735483904:12345-0@lo:400:kworker.0 Request processed in 27us (4182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528450.756479:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788528450.756488:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788528450.756495:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735484288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528450.756542:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735484288:12345-0@lo:400:kworker.0 Request processed in 48us (3939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528450.756548:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788528450.756578:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788528450.756585:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735484800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528450.756613:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735484800:12345-0@lo:400:kworker.0 Request processed in 29us (3976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528450.756618:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:0.0:1788528450.756633:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788528450.756636:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788528450.756660:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc30afb80 x1875407735484288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528450.756674:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735484288:0@lo:400:kworker.0 00010000:00080000:0.0:1788528450.756685:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6ea0380 x1875407735484800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528450.756694:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735484800:0@lo:400:kworker.0 00000100:00100000:0.0:1788528450.756728:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735484160:0@lo:400:kworker.0 00000100:00100000:0.0:1788528450.756738:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735484672:0@lo:400:kworker.0 00000100:00100000:0.0:1788528450.756843:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788528450.756854:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3d7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735485440:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788528450.756889:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528450.756947:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735485440 00000100:00100000:0.0:1788528450.756951:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735485440 00000100:00100000:0.0:1788528450.759019:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788528450.759066:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735485440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788528450.759103:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528450.759182:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735485440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 137us (2292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528450.759190:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:0.0:1788528450.759395:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788528450.759439:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3d7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735485440:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788528450.759587:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735484416 00000100:00100000:0.0:1788528450.759594:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735484416 00000100:00100000:0.0:1788528450.759643:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788528450.759650:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735484416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528450.759687:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735484416:12345-0@lo:400:kworker.0 Request processed in 38us (7356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528450.759693:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1788528450.759707:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788528450.759950:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528450.760305:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735483904:0@lo:400:kworker.0 00010000:00080000:2.0:1788528450.760325:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc30aea00 x1875407735484416/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528450.760337:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735484416:0@lo:400:kworker.0 00000100:00100000:0.0:1788528450.760459:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735484928 00000100:00100000:0.0:1788528450.760465:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735484928 00000100:00100000:0.0:1788528450.760506:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788528450.760513:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735484928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528450.760585:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735484928:12345-0@lo:400:kworker.0 Request processed in 72us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528450.760591:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788528450.762780:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735484928:0@lo:400:kworker.0 00000100:00100000:1.0:1788528450.763941:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735483648:12345-0@lo:400:kworker.0 Request processed in 12212us (12703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528450.763954:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788528450.764146:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735483648:0@lo:400:kworker.0 00000100:00100000:3.0:1788528450.764548:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528450.764648:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735483520 00000100:00100000:2.0:1788528450.764658:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735483520 00000100:00100000:3.0:1788528450.764669:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735484032:0@lo:400:kworker.0 00000100:00100000:2.0:1788528450.764715:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1788528450.764729:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735483520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528450.764749:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528450.764843:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735484032 00000100:00100000:1.0:1788528450.764849:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735484032 00000100:00100000:1.0:1788528450.764881:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788528450.764887:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735484032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528450.770605:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735484544:0@lo:400:kworker.0 00000100:00100000:3.0:1788528450.770697:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528450.770753:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735484544 00000100:00100000:3.0:1788528450.770776:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735484544 00000100:00100000:3.0:1788528450.770850:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788528450.770860:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735484544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528450.770920:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735484544:12345-0@lo:400:kworker.0 Request processed in 61us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528450.770927:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:3.0:1788528450.770957:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788528450.770988:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3f76a00 x1875407735484544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528450.771006:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735484544:0@lo:400:kworker.0 00000100:00100000:3.0:1788528450.771015:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735485056:0@lo:400:kworker.0 00000100:00100000:3.0:1788528450.771041:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528450.771074:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735485056 00000100:00100000:3.0:1788528450.771078:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735485056 00000100:00100000:3.0:1788528450.771111:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788528450.771116:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735485056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528450.771149:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735485056:12345-0@lo:400:kworker.0 Request processed in 33us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528450.771156:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788528450.771181:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735485056:0@lo:400:kworker.0 00000100:00100000:3.0:1788528450.771218:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735483520:0@lo:400:kworker.0 00000100:00100000:1.0:1788528450.772547:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735484032:12345-0@lo:400:kworker.0 Request processed in 7651us (7792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528450.772576:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788528450.773650:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735483520:12345-0@lo:400:kworker.0 Request processed in 8919us (10680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528450.773662:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1788528450.774964:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735484032:0@lo:400:kworker.0 00000100:00100000:1.0:1788528451.445088:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528451.445536:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719660928 00000100:00100000:0.0:1788528451.445546:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719660928 00000100:00100000:0.0:1788528451.445665:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:0.0:1788528451.445676:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:11078:x1875407719660928:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788528451.445706:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528451.445729:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fce00/0x892c60dda91c7ce6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfc8a expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528451.445793:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fda00/0x892c60dda91c7ced lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528451.445807:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fda00/0x892c60dda91c7ced lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528451.445821:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fda00/0x892c60dda91c7ced lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788528451.445871:0:13480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788528451.445875:0:13480:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788528451.445916:0:13480:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fda00/0x892c60dda91c7ced lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528451.445941:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fce00/0x892c60dda91c7ce6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc8a expref: 7 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528451.445960:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fda00/0x892c60dda91c7ced lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc8a expref: 6 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528451.445968:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a8fc2653000) 00010000:00010000:0.0:1788528451.445971:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788528451.445975:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c13fda00, rc 0) 00000100:00100000:0.0:1788528451.446040:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:11078:x1875407719660928:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 366us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528451.446067:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 40 00000100:00080000:3.0:1788528451.446648:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788528451.453839:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528451.453962:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719661056 00000100:00100000:2.0:1788528451.453975:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719661056 00000100:00100000:2.0:1788528451.454064:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:2.0:1788528451.454076:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:11079:x1875407719661056:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788528451.454112:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528451.454139:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7cf4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfc91 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.454221:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7cfb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.454239:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7cfb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.454254:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7cfb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.454273:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7d02 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.454281:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7d02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.454287:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7d02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.454364:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b000/0x892c60dda91c7d09 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.454372:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b000/0x892c60dda91c7d09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.454404:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b000/0x892c60dda91c7d09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528451.454455:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788528451.454459:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788528451.454486:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b000/0x892c60dda91c7d09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.454499:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7cfb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.454507:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7cfb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.454515:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7cfb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.454521:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528451.454525:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7cfb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.454534:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7cfb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.454549:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a8fc2653000) 00010000:00010000:2.0:1788528451.454600:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528451.454607:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7cfb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.454615:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7cfb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.454641:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7d02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.454646:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7d02 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.454653:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7d02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.454659:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528451.454661:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7d02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.454667:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7d02 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.454692:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8a8fc2721000) 00010000:00010000:2.0:1788528451.454695:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528451.454698:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7d02 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.454705:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7d02 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.454740:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7cf4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc91 expref: 8 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.454755:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b000/0x892c60dda91c7d09 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc91 expref: 7 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.454774:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a8fc2721700) 00010000:00010000:2.0:1788528451.454777:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788528451.454779:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3b000, rc 0) 00000100:00100000:2.0:1788528451.454856:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:11079:x1875407719661056:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 782us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528451.454864:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:2.0:1788528451.458762:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528451.458903:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719661184 00000100:00100000:1.0:1788528451.458917:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719661184 00000100:00100000:1.0:1788528451.458990:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:1.0:1788528451.459003:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:11079:x1875407719661184:12345-192.168.203.38@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788528451.459123:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:11079:x1875407719661184:12345-192.168.203.38@tcp:900:lhsmtool_posix.0 Request processed in 122us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528451.459133:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:1.0:1788528451.466383:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528451.466505:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719661440 00000100:00100000:2.0:1788528451.466518:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719661440 00000100:00100000:2.0:1788528451.466648:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 42 00000100:00100000:2.0:1788528451.466658:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:11079:x1875407719661440:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788528451.466681:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528451.466703:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7d10 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfc98 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.466787:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7d17 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.466800:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7d17 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.466809:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7d17 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.468036:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7d1e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.468075:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7d1e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.468101:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7d1e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.468228:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b200/0x892c60dda91c7d25 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.468237:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b200/0x892c60dda91c7d25 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.468244:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b200/0x892c60dda91c7d25 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528451.468256:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788528451.468355:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7d17 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.468375:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7d17 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.468384:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7d17 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.468389:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528451.468394:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7d17 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.468402:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7d17 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.468416:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a8fc2721700) 00010000:00010000:2.0:1788528451.468419:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528451.468431:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7d17 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.468439:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7d17 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.468452:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7d1e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.468459:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7d1e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.468465:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7d1e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.468470:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528451.468473:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7d1e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.468479:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7d1e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.468487:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8a8fc2721000) 00010000:00010000:2.0:1788528451.468490:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528451.468493:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7d1e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.468499:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7d1e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.468819:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7d10 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc98 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.468849:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b200/0x892c60dda91c7d25 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc98 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528451.468858:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a8fc2721c00) 00010000:00010000:2.0:1788528451.468860:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528451.468862:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3b200, rc 0) 00000100:00100000:2.0:1788528451.468936:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+9:11079:x1875407719661440:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 2277us (2567us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788528451.468945:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 42 00000100:00100000:0.0:1788528451.479441:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528451.479628:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719661568 00000100:00100000:2.0:1788528451.479641:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719661568 00000100:00100000:2.0:1788528451.479715:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:2.0:1788528451.479727:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+9:11079:x1875407719661568:12345-192.168.203.38@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788528451.479868:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+9:11079:x1875407719661568:12345-192.168.203.38@tcp:59:lhsmtool_posix.0 Request processed in 143us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528451.479876:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:0.0:1788528451.492236:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528451.492460:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719661696 00000100:00100000:3.0:1788528451.492475:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719661696 00000100:00100000:3.0:1788528451.492620:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:3.0:1788528451.492634:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:11079:x1875407719661696:12345-192.168.203.38@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1788528451.493484:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1788528451.494739:0:8449:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2049us 00000100:00100000:0.0:1788528451.554493:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:11079:x1875407719661696:12345-192.168.203.38@tcp:59:lhsmtool_posix.0 Request processed in 61845us (62256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528451.554511:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 44 00010000:00010000:2.0:1788528451.710766:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528451.774960:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788528451.774991:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735485568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788528451.775100:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528451.775640:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735485568 00000100:00100000:3.0:1788528451.775651:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735485568 00000100:00100000:3.0:1788528451.775724:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788528451.775736:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735485568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788528451.775775:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788528451.775841:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735485568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528451.775848:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:3.0:1788528451.775900:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3eb1c00 x1875407735485568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528451.775933:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735485568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788528451.776173:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788528451.776186:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735485696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788528451.776251:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528451.776628:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735485696 00000100:00100000:2.0:1788528451.776634:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735485696 00000100:00100000:2.0:1788528451.776678:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788528451.776686:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735485696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788528451.776701:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528451.776820:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735485696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528451.776827:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:1.0:1788528451.776912:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6fd7800 x1875407735485696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528451.777106:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735485696:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1788528452.223593:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788528452.226755:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788528452.734757:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528452.801223:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735485824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788528452.801293:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528452.802256:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735485824 00000100:00100000:1.0:1788528452.802268:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735485824 00000100:00100000:1.0:1788528452.802323:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788528452.802333:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735485824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788528452.802382:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:1.0:1788528452.802445:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735485824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528452.802452:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788528452.802502:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735485824:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788528453.248669:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788528453.249349:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788528453.493129:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528453.494720:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719661824 00000100:00100000:0.0:1788528453.494733:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719661824 00000100:00100000:0.0:1788528453.494850:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:0.0:1788528453.494862:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+9:11122:x1875407719661824:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1788528453.494882:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528453.494903:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fce00/0x892c60dda91c7d33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfc9f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.494968:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7d3a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.494983:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7d3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.494996:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7d3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.495010:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7d41 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.495031:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7d41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.495073:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7d41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.495118:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7d3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.495125:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7d3a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.495132:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7d3a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.495137:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528453.495142:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7d3a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.495149:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7d3a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.495160:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a8fc2653000) 00010000:00010000:0.0:1788528453.495163:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528453.495168:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7d3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.495174:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7d3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.495197:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7d41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.495208:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7d41 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.495215:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7d41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.495220:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528453.495223:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7d41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.495230:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7d41 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.495238:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8a90c87bec00) 00010000:00010000:0.0:1788528453.495240:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528453.495243:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7d41 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.495249:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7d41 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.495283:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fce00/0x892c60dda91c7d33 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc9f expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.495293:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a8fc2653000) 00010000:00010000:0.0:1788528453.495295:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528453.495299:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fce00/0x892c60dda91c7d33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc9f expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.495309:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c13fce00, rc 0) 00000100:00100000:0.0:1788528453.495375:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+9:11122:x1875407719661824:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 515us (2253us total) trans 0 rc 301/301 00000100:00100000:0.0:1788528453.495382:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00080000:1.0:1788528453.495864:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788528453.513576:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528453.514097:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719662080 00000100:00100000:0.0:1788528453.514107:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719662080 00000100:00100000:0.0:1788528453.514269:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 46 00000100:00100000:0.0:1788528453.514279:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+9:11122:x1875407719662080:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:0.0:1788528453.514509:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528453.514537:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fda00/0x892c60dda91c7ced lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc8a expref: 9 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.514555:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a8fc2653000) 00010000:00010000:0.0:1788528453.514713:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788528453.514769:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c7d48 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.514783:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c7d48 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.514792:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c7d48 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.514803:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c7d4f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.514809:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c7d4f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.514816:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c7d4f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.517868:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c7d56 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.517889:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c7d56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.517901:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c7d56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788528453.517919:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001719632b reply state 0000000019ccfce4 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c7d56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.517929:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c7d56 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.517937:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:0.0:1788528453.517940:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788528453.517945:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788528453.517950:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788528453.517958:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c7d48 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.517965:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c7d48 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.517972:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c7d48 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.517978:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528453.517982:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c7d48 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.518007:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c7d48 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.518018:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c87be100) 00010000:00010000:0.0:1788528453.518020:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528453.518025:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c7d48 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.518031:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c7d48 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788528453.518060:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001719632b reply state 0000000019ccfce4 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c7d4f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.518068:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c7d4f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.518074:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8a90c87be200) 00010000:00010000:0.0:1788528453.518076:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788528453.518078:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788528453.518212:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+10:11122:x1875407719662080:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 3931us (4656us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788528453.518221:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 46 00000100:00100000:0.0:1788528453.657766:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528453.657960:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719662208 00000100:00100000:3.0:1788528453.657970:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719662208 00000100:00100000:3.0:1788528453.658032:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 47 00000100:00100000:3.0:1788528453.658053:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3d7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+10:11130:x1875407719662208:12345-192.168.203.38@tcp:101:lctl.0 00010000:00010000:3.0:1788528453.658093:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528453.658119:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c7d5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfca6 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528453.658207:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c7d64 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528453.658222:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c7d64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528453.658243:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c7d64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528453.658291:0:8449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788528453.658295:0:8449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788528453.658335:0:8449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c7d64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528453.658360:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c7d5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfca6 expref: 12 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528453.658387:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c7d64 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfca6 expref: 11 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528453.658397:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90d5d08500) 00010000:00010000:3.0:1788528453.658400:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788528453.658403:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3429800, rc 0) 00000100:00100000:3.0:1788528453.658651:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3d7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+11:11130:x1875407719662208:12345-192.168.203.38@tcp:101:lctl.0 Request processed in 600us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528453.658659:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 47 00000100:00100000:3.0:1788528453.758673:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00010000:00010000:1.0:1788528453.758825:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528453.758888:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719662336 00000100:00100000:0.0:1788528453.758899:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719662336 00000100:00100000:0.0:1788528453.758958:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:0.0:1788528453.758969:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+11:11136:x1875407719662336:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:0.0:1788528453.758988:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528453.759019:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c7d6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfcad expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.759096:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7d72 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.759118:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7d72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.759128:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7d72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.759139:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7d79 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.759146:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7d79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.759151:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7d79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.759516:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031800/0x892c60dda91c7d80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.759526:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031800/0x892c60dda91c7d80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.759534:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031800/0x892c60dda91c7d80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788528453.759592:0:13480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788528453.759596:0:13480:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788528453.759636:0:13480:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031800/0x892c60dda91c7d80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.759655:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7d72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.759662:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7d72 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.759669:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7d72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.759674:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528453.759679:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7d72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.759686:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7d72 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.759697:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90d5d08500) 00010000:00010000:0.0:1788528453.759700:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528453.759705:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7d72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.759711:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7d72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.759724:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7d79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.759730:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7d79 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.759736:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7d79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.759749:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528453.759752:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7d79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.759757:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7d79 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.759765:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8a90c87be200) 00010000:00010000:0.0:1788528453.759767:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528453.759770:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7d79 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.759776:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7d79 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.759803:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c7d6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcad expref: 13 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.759817:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031800/0x892c60dda91c7d80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcad expref: 12 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.759823:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:0.0:1788528453.759825:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788528453.759827:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031800, rc 0) 00000100:00100000:0.0:1788528453.759894:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+12:11136:x1875407719662336:12345-192.168.203.38@tcp:101:bash.0 Request processed in 927us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528453.759902:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:1.0:1788528453.765473:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528453.765646:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719662592 00000100:00100000:0.0:1788528453.765666:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719662592 00000100:00100000:0.0:1788528453.765725:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:0.0:1788528453.765736:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+12:11136:x1875407719662592:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:0.0:1788528453.765755:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528453.765777:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c7d87 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfcb4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.765881:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c7d8e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.765895:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c7d8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.765906:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c7d8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.765918:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c7d95 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.765925:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c7d95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.765931:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c7d95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788528453.766280:0:6509:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788528453.766404:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c7d9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.766414:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c7d9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.766432:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c7d9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.766478:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c7d8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.766486:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c7d8e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.766492:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c7d8e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.766498:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031a00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528453.766502:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c7d8e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.766509:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c7d8e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.766521:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:0.0:1788528453.766524:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528453.766528:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c7d8e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.766535:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c7d8e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788528453.766549:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b907e9b reply state 0000000014833e44 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c7d95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.766611:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c7d95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.766624:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a90c87be100) 00010000:00010000:0.0:1788528453.766627:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788528453.766630:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788528453.766659:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c7d87 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcb4 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.766674:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c7d9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcb4 expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528453.766681:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bec00) 00010000:00010000:0.0:1788528453.766684:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788528453.766686:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031e00, rc 0) 00000100:00100000:0.0:1788528453.766744:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+15:11136:x1875407719662592:12345-192.168.203.38@tcp:101:bash.0 Request processed in 1010us (1279us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788528453.766751:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:2.0:1788528453.775879:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528453.776022:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719662720 00000100:00100000:3.0:1788528453.776032:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719662720 00000100:00100000:3.0:1788528453.776092:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:3.0:1788528453.776101:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2402:x1875407719662720:12345-192.168.203.38@tcp:8:bash.0 00010000:00080000:3.0:1788528453.776134:0:8725:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from 80304108-f3b9-46ea-888c-b2a7ec20e3e2@192.168.203.38@tcp t0 exp 0000000000000000 cur 322 last 0 00000020:00000080:3.0:1788528453.776179:0:8725:0:(genops.c:1385:class_connect()) connect: client 80304108-f3b9-46ea-888c-b2a7ec20e3e2, cookie 0x892c60dda91c7daa 00002000:00100000:3.0:1788528453.776191:0:8725:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 80304108-f3b9-46ea-888c-b2a7ec20e3e2/ffff8a8fc3fdc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788528453.776207:0:8725:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788528453.776287:0:8725:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788528453.776315:0:8725:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3fda000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788528453.776390:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2402:x1875407719662720:12345-192.168.203.38@tcp:8:bash.0 Request processed in 288us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528453.776397:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:1.0:1788528453.790863:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528453.791021:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719662848 00000100:00100000:3.0:1788528453.791033:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719662848 00000100:00100000:3.0:1788528453.791127:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 29 00000100:00100000:3.0:1788528453.791138:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6feea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:0:x1875407719662848:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:3.0:1788528453.791167:0:8422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528453.791441:0:8422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8569505/0x892c60dda91c7db1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfcbb expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788528453.791477:0:8422:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528453.791499:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=323s v=(0 0) 00010000:00010000:3.0:1788528453.791504:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528453.791514:0:8422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8569505/0x892c60dda91c7db1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcbb expref: 7 pid: 8422 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528453.791600:0:8422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b8569505/0x892c60dda91c7db1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcbb expref: 7 pid: 8422 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528453.791859:0:8422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3429400, rc 0) 00000100:00080000:0.0:1788528453.792071:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788528453.795769:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6feea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:0:x1875407719662848:12345-192.168.203.38@tcp:101:bash.0 Request processed in 4622us (4904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528453.795782:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 29 00000100:00100000:1.0:1788528453.803657:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528453.803821:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719662976 00000100:00100000:3.0:1788528453.803830:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719662976 00000100:00100000:3.0:1788528453.803890:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:3.0:1788528453.803900:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:11136:x1875407719662976:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:3.0:1788528453.803921:0:8725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528453.803939:0:8725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3bb4113/0x892c60dda91c7db8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfcc2 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528453.803970:0:8725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8569505/0x892c60dda91c7db1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcbb expref: 8 pid: 8422 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528453.803978:0:8725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528453.803982:0:8725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528453.803987:0:8725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3bb4113/0x892c60dda91c7db8 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcc2 expref: 8 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528453.804025:0:8725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b8569505/0x892c60dda91c7db1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcbb expref: 8 pid: 8422 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528453.804051:0:8725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b8569505/0x892c60dda91c7db1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcbb expref: 8 pid: 8422 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528453.804080:0:8725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe6e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8725:1875407735485952:192.168.203.38@tcp:104: 00000100:00100000:3.0:1788528453.804190:0:8725:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc267f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788528453.808670:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528453.808785:0:8725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe6e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8725:1875407735485952:192.168.203.38@tcp:104: 00010000:00010000:3.0:1788528453.808820:0:8725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a3bb4113/0x892c60dda91c7db8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcc2 expref: 8 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528453.808840:0:8725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3428400, rc 0) 00000100:00100000:3.0:1788528453.808886:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:11136:x1875407719662976:12345-192.168.203.38@tcp:101:bash.0 Request processed in 4987us (5239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528453.808894:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:2.0:1788528453.810113:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719663104 00000100:00100000:2.0:1788528453.810126:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719663104 00010000:00010000:2.0:1788528453.810170:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b8569505/0x892c60dda91c7db1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcbb expref: 8 pid: 8422 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528453.810527:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:2.0:1788528453.810539:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:2404:x1875407719663104:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528453.810571:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528453.810596:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b8569505/0x892c60dda91c7db1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcbb expref: 8 pid: 8422 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528453.810611:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b8569505/0x892c60dda91c7db1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcbb expref: 8 pid: 8422 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528453.810637:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8569505/0x892c60dda91c7db1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcbb expref: 8 pid: 8422 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528453.810653:0:6494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528453.810657:0:6494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528453.810679:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3bb4113/0x892c60dda91c7db8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcc2 expref: 7 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528453.810689:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3bb4113/0x892c60dda91c7db8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcc2 expref: 7 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528453.810724:0:6494:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a3bb4113/0x892c60dda91c7db8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcc2 expref: 7 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528453.810738:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fd7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6494:1875407735486080:192.168.203.38@tcp:105: 00000100:00100000:2.0:1788528453.810859:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d93b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788528453.819697:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fd7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6494:1875407735486080:192.168.203.38@tcp:105: 00010000:00010000:2.0:1788528453.819722:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528453.819783:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2404:x1875407719663104:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 9245us (11121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528453.819795:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:1.0:1788528453.820748:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528453.820823:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719663360 00000100:00100000:3.0:1788528453.820832:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719663360 00000100:00100000:3.0:1788528453.820882:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:3.0:1788528453.820892:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+15:11136:x1875407719663360:12345-192.168.203.38@tcp:35:bash.0 00000001:00080000:3.0:1788528453.821134:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967314 00000100:00100000:3.0:1788528453.821631:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+17:11136:x1875407719663360:12345-192.168.203.38@tcp:35:bash.0 Request processed in 738us (884us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788528453.821641:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6 00000020:00080000:3.0:1788528453.821646:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788528453.992629:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528453.992802:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719663616 00000100:00100000:2.0:1788528453.992812:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719663616 00000100:00100000:2.0:1788528453.992868:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 50 00000100:00100000:2.0:1788528453.992879:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+17:11147:x1875407719663616:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1788528453.992910:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528453.992929:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3bc00/0x892c60dda91c7dbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfcc9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528453.993029:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788528453.993136:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3bc00/0x892c60dda91c7dbf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcc9 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528453.993171:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90d5d08500) 00010000:00010000:2.0:1788528453.993174:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788528453.993179:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3bc00/0x892c60dda91c7dbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcc9 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528453.993192:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3bc00, rc 0) 00000100:00100000:2.0:1788528453.993252:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+18:11147:x1875407719663616:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 375us (633us total) trans 4294967316 rc 301/301 00000100:00100000:2.0:1788528453.993259:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 50 00000100:00100000:1.0:1788528454.002929:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528454.003012:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719663872 00000100:00100000:2.0:1788528454.003024:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719663872 00000100:00100000:2.0:1788528454.003092:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:2.0:1788528454.003103:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+18:11147:x1875407719663872:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:2.0:1788528454.003341:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+19:11147:x1875407719663872:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 239us (420us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788528454.003348:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:3.0:1788528454.116755:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528454.116877:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719664000 00000100:00100000:0.0:1788528454.116887:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719664000 00000100:00100000:0.0:1788528454.117012:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:0.0:1788528454.117023:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+19:11153:x1875407719664000:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1788528454.117057:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528454.117078:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7dcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfcd0 expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.117146:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7dd4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.117184:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.117198:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788528454.117244:0:13480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788528454.117248:0:13480:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788528454.117266:0:13480:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.117290:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7dcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcd0 expref: 21 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.117310:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7dd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcd0 expref: 20 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.117319:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:0.0:1788528454.117322:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788528454.117326:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031200, rc 0) 00000100:00100000:0.0:1788528454.117648:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+20:11153:x1875407719664000:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 625us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528454.117656:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:2.0:1788528454.123462:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528454.123617:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719664256 00000100:00100000:3.0:1788528454.123628:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719664256 00000100:00100000:3.0:1788528454.123687:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:3.0:1788528454.123697:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+20:11153:x1875407719664256:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1788528454.123732:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528454.123752:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c7ddb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfcd7 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528454.123856:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c7de2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528454.123871:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c7de2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528454.123883:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c7de2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528454.123908:0:8449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788528454.124018:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c7ddb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcd7 expref: 23 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528454.124048:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c7de2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcd7 expref: 22 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528454.124056:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bec00) 00010000:00010000:3.0:1788528454.124059:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788528454.124063:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3429000, rc 0) 00000100:00100000:3.0:1788528454.124125:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+22:11153:x1875407719664256:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 430us (682us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788528454.124132:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:3.0:1788528454.132447:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528454.132494:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528454.132579:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719664640 00000100:00100000:0.0:1788528454.132589:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719664640 00000100:00100000:1.0:1788528454.132590:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719664512 00000100:00100000:1.0:1788528454.132593:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719664512 00000100:00100000:0.0:1788528454.132654:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:1.0:1788528454.132657:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:0.0:1788528454.132664:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+23:2406:x1875407719664640:12345-192.168.203.38@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788528454.132677:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+23:11153:x1875407719664512:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1788528454.132679:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528454.132696:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528454.132707:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c7de2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcd7 expref: 23 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.132710:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17000/0x892c60dda91c7df0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfcde expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.132726:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bec00) 00010000:00010000:0.0:1788528454.132732:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528454.132777:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+23:2406:x1875407719664640:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 116us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528454.132785:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 0 00010000:00010000:1.0:1788528454.132811:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c7df7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.132829:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c7df7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.132840:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c7df7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528454.132854:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788528454.132973:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17000/0x892c60dda91c7df0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcde expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.132986:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c7df7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcde expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.132994:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bec00) 00010000:00010000:1.0:1788528454.132996:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788528454.132999:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e17c00, rc 0) 00000100:00100000:1.0:1788528454.133044:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+23:11153:x1875407719664512:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 367us (606us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788528454.133051:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:1.0:1788528454.144226:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528454.144479:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719664768 00000100:00100000:2.0:1788528454.144491:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719664768 00000100:00100000:2.0:1788528454.144874:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 31 00000100:00100000:2.0:1788528454.144887:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2404:x1875407719664768:12345-192.168.203.38@tcp:1:lfs.0 00010000:00010000:2.0:1788528454.144946:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8d3aa4a/0x892c60dda91c7e05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.144968:0:8421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3bb4113/0x892c60dda91c7db8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcc2 expref: 7 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.144991:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528454.144996:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788528454.145002:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d3aa4a/0x892c60dda91c7e05 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.145052:0:8421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a3bb4113/0x892c60dda91c7db8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcc2 expref: 7 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.145067:0:8421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a3bb4113/0x892c60dda91c7db8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcc2 expref: 7 pid: 8725 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528454.145082:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8421:1875407735486208:192.168.203.38@tcp:104: 00000100:00100000:2.0:1788528454.145324:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d93a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788528454.148627:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8421:1875407735486208:192.168.203.38@tcp:104: 00010000:00010000:2.0:1788528454.149007:0:8421:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e8d3aa4a/0x892c60dda91c7e05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528454.149234:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528454.150061:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719664896 00000100:00100000:0.0:1788528454.150072:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719664896 00002000:00100000:0.0:1788528454.150121:0:8426:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8a90faa09500 x1875407719664896/t0(0) o4->80304108-f3b9-46ea-888c-b2a7ec20e3e2@192.168.203.38@tcp:660/0 lens 504/0 e 0 to 0 dl 1788528465 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788528454.150131:0:8426:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a90faa09500 with x1875407719664896 ext(0->12) 00010000:00010000:0.0:1788528454.150140:0:8426:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a3bb4113/0x892c60dda91c7db8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcc2 expref: 8 pid: 8725 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.150153:0:8426:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a3bb4113/0x892c60dda91c7db8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcc2 expref: 8 pid: 8725 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788528454.150171:0:8426:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a90faa09500 00000100:00100000:0.0:1788528454.150206:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:0.0:1788528454.150215:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:2403:x1875407719664896:12345-192.168.203.38@tcp:4:lfs.0 00000001:00100000:0.0:1788528454.155069:0:8416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 80304108-f3b9-46ea-888c-b2a7ec20e3e2 00000100:00100000:2.0:1788528454.161858:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+9:2403:x1875407719664896:12345-192.168.203.38@tcp:4:lfs.0 Request processed in 11633us (12614us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788528454.161877:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 0 00002000:00100000:2.0:1788528454.161889:0:8426:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8a90faa09500 x1875407719664896/t4294967300(0) o4->80304108-f3b9-46ea-888c-b2a7ec20e3e2@192.168.203.38@tcp:660/0 lens 504/448 e 0 to 0 dl 1788528465 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788528454.161910:0:8426:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a90faa09500 with x1875407719664896 ext(0->12) 00010000:00010000:2.0:1788528454.161931:0:8426:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a3bb4113/0x892c60dda91c7db8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcc2 expref: 9 pid: 8725 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.161951:0:8426:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a3bb4113/0x892c60dda91c7db8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcc2 expref: 9 pid: 8725 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788528454.161960:0:8426:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a90faa09500 00000100:00100000:3.0:1788528454.174500:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528454.177624:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719665024 00000100:00100000:1.0:1788528454.177641:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719665024 00010000:00010000:1.0:1788528454.177880:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a3bb4113/0x892c60dda91c7db8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcc2 expref: 9 pid: 8725 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528454.177939:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:1.0:1788528454.177949:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+9:2403:x1875407719665024:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788528454.177964:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788528454.177984:0:6495:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788528454.177987:0:6495:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788528454 00002000:00010000:1.0:1788528454.177988:0:6495:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788528454 00002000:00010000:1.0:1788528454.177991:0:6495:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788528454 00002000:00010000:1.0:1788528454.177992:0:6495:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788528454.177999:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a3bb4113/0x892c60dda91c7db8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcc2 expref: 9 pid: 8725 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.178012:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a3bb4113/0x892c60dda91c7db8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcc2 expref: 9 pid: 8725 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.178047:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3bb4113/0x892c60dda91c7db8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcc2 expref: 9 pid: 8725 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.178064:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788528454.178068:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788528454.178073:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8d3aa4a/0x892c60dda91c7e05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.178102:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d3aa4a/0x892c60dda91c7e05 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.178142:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788528454.178393:0:8421:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e8d3aa4a/0x892c60dda91c7e05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.178404:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8d3aa4a/0x892c60dda91c7e05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.178428:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8d3aa4a/0x892c60dda91c7e05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.178437:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d3aa4a/0x892c60dda91c7e05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.178446:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8d3aa4a/0x892c60dda91c7e05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.178453:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3b400 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528454.178458:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8d3aa4a/0x892c60dda91c7e05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.178468:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8d3aa4a/0x892c60dda91c7e05 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.178493:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8d3aa4a/0x892c60dda91c7e05 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.178503:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8d3aa4a/0x892c60dda91c7e05 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528454.178642:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:2404:x1875407719664768:12345-192.168.203.38@tcp:1:lfs.0 Request processed in 33756us (34422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528454.179172:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 31 00000100:00100000:1.0:1788528454.179807:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2403:x1875407719665024:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 1856us (5313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528454.179817:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:3.0:1788528454.194064:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528454.194298:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719665280 00000100:00100000:2.0:1788528454.194308:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719665280 00000100:00100000:2.0:1788528454.194364:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:2.0:1788528454.194381:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+23:11153:x1875407719665280:12345-192.168.203.38@tcp:35:lfs.0 00000004:00010000:2.0:1788528454.194444:0:6512:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c7df7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcde expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788528454.195124:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788528454.195413:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:2.0:1788528454.196749:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00010000:00010000:2.0:1788528454.196800:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b400/0x892c60dda91c7e0c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.196820:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c7d9c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcb4 expref: 27 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.196829:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b400/0x892c60dda91c7e0c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.196880:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c7d9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcb4 expref: 27 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.196896:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c7d9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcb4 expref: 27 pid: 6509 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528454.196911:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6512:1875407735486336:192.168.203.38@tcp:104: 00000100:00100000:2.0:1788528454.197012:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d93a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788528454.205409:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6512:1875407735486336:192.168.203.38@tcp:104: 00010000:00010000:2.0:1788528454.205440:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b400/0x892c60dda91c7e0c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528454.210959:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528454.211195:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719665408 00000100:00100000:2.0:1788528454.211205:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719665408 00010000:00010000:2.0:1788528454.211245:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c7d9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcb4 expref: 28 pid: 6509 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528454.211290:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:2.0:1788528454.211300:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+28:2404:x1875407719665408:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528454.211317:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528454.211324:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c7d9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcb4 expref: 28 pid: 6509 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.211337:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c7d9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcb4 expref: 28 pid: 6509 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.211907:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c7d9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcb4 expref: 28 pid: 6509 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.211925:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bec00) 00010000:00010000:2.0:1788528454.211931:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b400/0x892c60dda91c7e0c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.211940:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b400/0x892c60dda91c7e0c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.211947:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b400/0x892c60dda91c7e0c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.211970:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788528454.212094:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b400/0x892c60dda91c7e0c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.212102:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b400/0x892c60dda91c7e0c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788528454.212231:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000001:00080000:0.0:1788528454.212345:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1788528454.212446:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30adf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6512:1875407735486464:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788528454.212495:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528454.212527:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3eef780 going to sleep for 11 seconds 00000100:00100000:2.0:1788528454.212675:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+29:2404:x1875407719665408:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 1374us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528454.212685:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:3.0:1788528454.213282:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735486464 00000100:00100000:3.0:1788528454.213291:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735486464 00000100:00100000:3.0:1788528454.213358:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788528454.213379:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6512:x1875407735486464:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788528454.213475:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6512:x1875407735486464:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 109us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528454.213482:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:0.0:1788528454.215845:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788528454.215912:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30adf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6512:1875407735486464:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788528454.216118:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00000100:00100000:0.0:1788528454.216206:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc30adf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6512:1875407735486592:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788528454.216266:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528454.216303:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3eefb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788528454.216492:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735486592 00000100:00100000:2.0:1788528454.216499:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735486592 00000100:00100000:2.0:1788528454.216578:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788528454.216589:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6512:x1875407735486592:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788528454.216734:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6512:x1875407735486592:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 147us (468us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788528454.216742:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788528454.221450:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc30adf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6512:1875407735486592:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788528454.221539:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1788528454.221619:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b400/0x892c60dda91c7e0c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.221631:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b400/0x892c60dda91c7e0c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.221638:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b400/0x892c60dda91c7e0c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.221644:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3b400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528454.221797:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b400/0x892c60dda91c7e0c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.221806:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b400/0x892c60dda91c7e0c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.221834:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bec00) 00010000:00010000:0.0:1788528454.221837:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788528454.221842:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b400/0x892c60dda91c7e0c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.221848:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b400/0x892c60dda91c7e0c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788528454.221961:0:6512:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788528454.222022:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788528454.222044:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 323439489722ns, next at 324439486882ns, rc = 0 00000001:00080000:0.0:1788528454.222051:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967327 00010000:00010000:0.0:1788528454.222081:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bec00) 00010000:00010000:0.0:1788528454.222084:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788528454.222091:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c7df7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcde expref: 31 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528454.222194:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+30:11153:x1875407719665280:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 27814us (28137us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788528454.222203:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 8 00000020:00080000:0.0:1788528454.222208:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788528454.227593:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528454.227772:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719665536 00000100:00100000:0.0:1788528454.227783:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719665536 00000100:00100000:0.0:1788528454.227841:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:0.0:1788528454.227851:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+30:11153:x1875407719665536:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1788528454.227874:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528454.227895:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c7e13 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfce5 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.227979:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c7e13 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfce5 expref: 31 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.227994:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c7e13 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfce5 expref: 31 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.228013:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:0.0:1788528454.228016:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788528454.228020:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031600, rc 0) 00000100:00100000:0.0:1788528454.228085:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+31:11153:x1875407719665536:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 235us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528454.228092:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:3.0:1788528454.237342:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528454.237502:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719665792 00000100:00100000:1.0:1788528454.237511:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719665792 00000100:00100000:1.0:1788528454.237609:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:1.0:1788528454.237837:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e14c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+31:11153:x1875407719665792:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:1.0:1788528454.238129:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e14c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+32:11153:x1875407719665792:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 297us (794us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1788528454.238138:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:1.0:1788528454.370741:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528454.371151:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719666048 00000100:00100000:0.0:1788528454.371172:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719666048 00000100:00100000:0.0:1788528454.371243:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 55 00000100:00100000:0.0:1788528454.371255:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+32:11163:x1875407719666048:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1788528454.371287:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528454.371316:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c7e1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfcec expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788528454.371438:0:13480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788528454.371613:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c7e1a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcec expref: 34 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.371631:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90d5d08500) 00010000:00010000:0.0:1788528454.371635:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788528454.371658:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c7e1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcec expref: 34 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.371675:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031a00, rc 0) 00000100:00100000:0.0:1788528454.371751:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+33:11163:x1875407719666048:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 498us (1025us total) trans 4294967330 rc 301/301 00000100:00100000:0.0:1788528454.371759:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 55 00000100:00100000:3.0:1788528454.382628:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528454.382785:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719666176 00000100:00100000:1.0:1788528454.382798:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719666176 00000100:00100000:1.0:1788528454.382875:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:1.0:1788528454.382886:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+33:11163:x1875407719666176:12345-192.168.203.38@tcp:34:lfs.0 00010000:00010000:1.0:1788528454.382987:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c7e28 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.383009:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c7e28 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.383023:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c7e28 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.383064:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c7e2f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.383073:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c7e2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.383080:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c7e2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.383189:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17000/0x892c60dda91c7e36 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.383198:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17000/0x892c60dda91c7e36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.383205:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17000/0x892c60dda91c7e36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788528454.383260:0:6508:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17000/0x892c60dda91c7e36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.383274:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c7e28 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.383281:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c7e28 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.383289:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c7e28 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.383295:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528454.383300:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c7e28 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.383315:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c7e28 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.383329:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:1.0:1788528454.383332:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528454.383338:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c7e28 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.383345:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c7e28 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.383360:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c7e2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.383367:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c7e2f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.383373:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c7e2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.383379:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17c00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528454.383381:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c7e2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.383386:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c7e2f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.383393:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a90c87be100) 00010000:00010000:1.0:1788528454.383395:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528454.383398:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c7e2f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.383413:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c7e2f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.383422:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17000/0x892c60dda91c7e36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.383429:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17000/0x892c60dda91c7e36 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.383436:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17000/0x892c60dda91c7e36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.383440:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528454.383442:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17000/0x892c60dda91c7e36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.383448:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17000/0x892c60dda91c7e36 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.383455:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:1.0:1788528454.383457:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528454.383460:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17000/0x892c60dda91c7e36 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.383466:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17000/0x892c60dda91c7e36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528454.383611:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+33:11163:x1875407719666176:12345-192.168.203.38@tcp:34:lfs.0 Request processed in 725us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528454.383620:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:3.0:1788528454.386864:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528454.386970:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719666432 00000100:00100000:0.0:1788528454.386984:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719666432 00000100:00100000:0.0:1788528454.387055:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:0.0:1788528454.387065:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+33:11163:x1875407719666432:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:0.0:1788528454.387352:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+34:11163:x1875407719666432:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 287us (500us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1788528454.387367:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:2.0:1788528454.443943:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528454.444038:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719666688 00000100:00100000:0.0:1788528454.444054:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719666688 00000100:00100000:0.0:1788528454.444123:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:0.0:1788528454.444133:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc36f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+34:11166:x1875407719666688:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1788528454.444176:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528454.444202:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c7e3d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfcf3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.444325:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c7e44 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.444343:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c7e44 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.444375:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c7e44 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.444389:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c7e4b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.444397:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c7e4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.444403:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c7e4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.444530:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7e52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.444539:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7e52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.444546:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7e52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788528454.444599:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788528454.444692:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c7e44 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.444700:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c7e44 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.444709:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c7e44 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.444715:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528454.444725:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c7e44 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.444734:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c7e44 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.444749:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:0.0:1788528454.444753:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528454.444758:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c7e44 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.444765:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c7e44 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.444779:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c7e4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.444786:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c7e4b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.444792:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c7e4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.444796:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031e00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528454.444799:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c7e4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.444806:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c7e4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.444811:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a90c87be100) 00010000:00010000:0.0:1788528454.444813:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528454.444821:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c7e4b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.444826:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c7e4b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.444869:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c7e3d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcf3 expref: 37 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.444884:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7e52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcf3 expref: 36 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.444892:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:0.0:1788528454.444894:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788528454.444897:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0030200, rc 0) 00000100:00100000:0.0:1788528454.444972:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc36f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+36:11166:x1875407719666688:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 840us (1043us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788528454.444979:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:3.0:1788528454.451449:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528454.451963:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719666816 00000100:00100000:0.0:1788528454.451977:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719666816 00000100:00100000:0.0:1788528454.452112:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:0.0:1788528454.452125:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+36:11166:x1875407719666816:12345-192.168.203.38@tcp:54:lfs.0 00010000:00010000:0.0:1788528454.452221:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c7e60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.452243:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c7e60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.452257:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c7e60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.452323:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c7e60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.452331:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c7e60 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.452339:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c7e60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.452347:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031a00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528454.452365:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c7e60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.452374:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c7e60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.452390:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:0.0:1788528454.452393:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788528454.452399:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c7e60 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.452406:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c7e60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528454.452498:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+36:11166:x1875407719666816:12345-192.168.203.38@tcp:54:lfs.0 Request processed in 375us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528454.452507:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:3.0:1788528454.457934:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528454.459154:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719667072 00000100:00100000:0.0:1788528454.459170:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719667072 00000100:00100000:0.0:1788528454.459290:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:0.0:1788528454.459321:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+36:11166:x1875407719667072:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:0.0:1788528454.459635:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+37:11166:x1875407719667072:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 316us (1713us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788528454.459645:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:2.0:1788528454.749995:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528454.751855:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719667328 00000100:00100000:0.0:1788528454.751874:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719667328 00000100:00100000:0.0:1788528454.751971:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:0.0:1788528454.751982:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc36f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+37:11197:x1875407719667328:12345-192.168.203.38@tcp:101:cat.0 00010000:00010000:0.0:1788528454.752014:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528454.752056:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c7e67 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfcfa expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.752190:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c7e6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.752209:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c7e6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.752222:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c7e6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788528454.752235:0:8449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788528454.752391:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c7e67 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcfa expref: 40 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.752412:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c7e6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcfa expref: 39 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.752444:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:0.0:1788528454.752448:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788528454.752452:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031e00, rc 0) 00000100:00100000:0.0:1788528454.752549:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc36f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+39:11197:x1875407719667328:12345-192.168.203.38@tcp:101:cat.0 Request processed in 568us (2568us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1788528454.752611:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:3.0:1788528454.757307:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528454.757399:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719667456 00000100:00100000:1.0:1788528454.757412:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719667456 00000100:00100000:1.0:1788528454.757540:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:1.0:1788528454.757584:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90efa86050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+39:2403:x1875407719667456:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788528454.757606:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528454.757641:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c7e6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcfa expref: 39 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.757666:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:1.0:1788528454.757672:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528454.757741:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90efa86050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+38:2403:x1875407719667456:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 191us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528454.757749:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:3.0:1788528454.758711:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528454.758774:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719667712 00000100:00100000:3.0:1788528454.758784:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719667712 00000100:00100000:3.0:1788528454.758830:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:3.0:1788528454.758838:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+38:11197:x1875407719667712:12345-192.168.203.38@tcp:35:cat.0 00000100:00100000:3.0:1788528454.759142:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+39:11197:x1875407719667712:12345-192.168.203.38@tcp:35:cat.0 Request processed in 303us (435us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1788528454.759160:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12 00010000:00010000:1.0:1788528454.782834:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528454.830700:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528454.832200:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719667968 00000100:00100000:2.0:1788528454.832246:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719667968 00000100:00100000:2.0:1788528454.832422:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:2.0:1788528454.832436:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+39:11203:x1875407719667968:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1788528454.832470:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528454.832475:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788528454.832514:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7dd4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcd0 expref: 39 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.832540:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:2.0:1788528454.832547:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788528454.832682:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c7e7c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfd01 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.832828:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7e83 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.832844:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7e52 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcf3 expref: 39 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.832866:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7e83 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.832910:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7e52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcf3 expref: 39 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.832924:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7e52 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcf3 expref: 39 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528454.832941:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6509:1875407735486720:192.168.203.38@tcp:104: 00000100:00100000:2.0:1788528454.833102:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d93a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788528454.841642:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6509:1875407735486720:192.168.203.38@tcp:104: 00000100:00100000:2.0:1788528454.841670:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00010000:00010000:0.0:1788528454.841685:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7e83 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528454.841823:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719668096 00000100:00100000:1.0:1788528454.841834:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719668096 00010000:00010000:1.0:1788528454.841888:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7e52 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcf3 expref: 40 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528454.841933:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 61 00000100:00100000:1.0:1788528454.841945:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc36f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+40:2403:x1875407719668096:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788528454.841964:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528454.841971:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7e52 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcf3 expref: 40 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.841985:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7e52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcf3 expref: 40 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.842047:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7e52 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcf3 expref: 40 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.842066:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:1.0:1788528454.842071:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7e83 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.842083:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7e83 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.842091:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7e83 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528454.842124:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528454.842191:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc36f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+39:2403:x1875407719668096:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 248us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528454.842199:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 61 00010000:00010000:2.0:1788528454.842672:0:6509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7e83 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.842682:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7e83 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528454.842706:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788528454.842910:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c7e7c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd01 expref: 40 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.842930:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7e83 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd01 expref: 39 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528454.842938:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:2.0:1788528454.842942:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788528454.842944:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3a400, rc 0) 00000100:00100000:2.0:1788528454.842987:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+39:11203:x1875407719667968:12345-192.168.203.38@tcp:101:dd.0 Request processed in 10555us (12303us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1788528454.842995:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:2.0:1788528454.849468:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528454.849616:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719668224 00000100:00100000:0.0:1788528454.849629:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719668224 00000100:00100000:0.0:1788528454.849712:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 61 00000100:00100000:0.0:1788528454.849726:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc36f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+39:11203:x1875407719668224:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:0.0:1788528454.849759:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528454.849789:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7e91 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfd08 expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.849833:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c7e98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.849850:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c7e98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.849864:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c7e98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.850055:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c7e91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd08 expref: 41 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.850079:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c7e98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd08 expref: 40 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528454.850107:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:0.0:1788528454.850110:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788528454.850115:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031400, rc 0) 00000100:00100000:0.0:1788528454.850186:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc36f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+40:11203:x1875407719668224:12345-192.168.203.38@tcp:101:dd.0 Request processed in 463us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528454.850195:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 61 00000100:00100000:0.0:1788528454.855710:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528454.855754:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528454.855774:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528454.855897:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719668480 00000100:00100000:3.0:1788528454.855910:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719668480 00000100:00100000:3.0:1788528454.855992:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719668736 00000100:00100000:3.0:1788528454.855996:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719668736 00000100:00100000:3.0:1788528454.856043:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719668992 00000100:00100000:3.0:1788528454.856046:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719668992 00000100:00100000:3.0:1788528454.856068:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 268 00000100:00100000:3.0:1788528454.856079:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2404:x1875407719668736:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528454.856176:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2404:x1875407719668736:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 98us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528454.856185:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 268 00000100:00100000:3.0:1788528454.856209:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 269 00000100:00100000:3.0:1788528454.856216:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2404:x1875407719668992:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528454.856242:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2404:x1875407719668992:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 26us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528454.856248:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 269 00000100:00100000:3.0:1788528454.856262:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 62 00000100:00100000:3.0:1788528454.856269:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+40:11203:x1875407719668480:12345-192.168.203.38@tcp:36:dd.0 00010000:00010000:3.0:1788528454.856582:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c7e9f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528454.856604:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c7e9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528454.856618:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c7e9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788528454.856673:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1788528454.856700:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b95c212 reply state 00000000a63a114a transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c7e9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528454.856728:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c7e9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528454.856737:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:3.0:1788528454.856740:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788528454.856745:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788528454.856817:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+43:11203:x1875407719668480:12345-192.168.203.38@tcp:36:dd.0 Request processed in 547us (1122us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1788528454.856826:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 62 00000020:00080000:3.0:1788528454.856831:0:6509:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1788528454.857569:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788528454.859344:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528454.859399:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528454.859487:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719668864 00000100:00100000:3.0:1788528454.859499:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719668864 00000100:00100000:3.0:1788528454.859619:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 270 00000100:00100000:3.0:1788528454.859633:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2404:x1875407719668864:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528454.859719:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2404:x1875407719668864:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 90us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528454.859727:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 270 00000100:00080000:0.0:1788528454.859808:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788528454.860303:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719668608 00000100:00100000:2.0:1788528454.860311:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719668608 00000100:00100000:2.0:1788528454.860362:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 405 00000100:00100000:2.0:1788528454.860371:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2404:x1875407719668608:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528454.860429:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2404:x1875407719668608:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 59us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528454.860457:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 405 00000100:00100000:1.0:1788528455.196735:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528455.196917:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719669120 00000100:00100000:2.0:1788528455.196931:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719669120 00000100:00100000:2.0:1788528455.197020:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:2.0:1788528455.197041:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+43:11217:x1875407719669120:12345-192.168.203.38@tcp:101:stat.0 00010000:00010000:2.0:1788528455.197076:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528455.197114:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7ea6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfd0f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.197207:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7ead lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.197227:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7ead lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.197240:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7ead lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.197253:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c7eb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.197261:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c7eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.197268:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c7eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.197363:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c7ebb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.197395:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7e83 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd01 expref: 44 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.197405:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c7ebb lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.197450:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7e83 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd01 expref: 44 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.197467:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7e83 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd01 expref: 44 pid: 6509 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528455.197484:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6510:1875407735486848:192.168.203.38@tcp:104: 00000100:00100000:2.0:1788528455.197655:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d93540 going to sleep for 11 seconds 00000100:00080000:0.0:1788528455.197813:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788528455.202414:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528455.202613:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719669376 00000100:00100000:0.0:1788528455.202627:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719669376 00000100:00100000:0.0:1788528455.202707:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:0.0:1788528455.202719:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+45:6169:x1875407719669376:12345-192.168.203.38@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788528455.203285:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+46:6169:x1875407719669376:12345-192.168.203.38@tcp:35:ldlm_bl.0 Request processed in 567us (885us total) trans 4294967339 rc 0/0 00000100:00100000:0.0:1788528455.203296:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:2.0:1788528455.204112:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6510:1875407735486848:192.168.203.38@tcp:104: 00010000:00010000:2.0:1788528455.204159:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c7ebb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528455.206889:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528455.207073:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719669504 00000100:00100000:2.0:1788528455.207086:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719669504 00010000:00010000:2.0:1788528455.207357:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7e83 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd01 expref: 46 pid: 6509 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528455.207414:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 62 00000100:00100000:2.0:1788528455.207427:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+46:2404:x1875407719669504:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528455.207445:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528455.207471:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7e83 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd01 expref: 46 pid: 6509 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.207488:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7e83 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd01 expref: 46 pid: 6509 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.207516:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7e83 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd01 expref: 46 pid: 6509 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.207537:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:2.0:1788528455.207542:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c7ebb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.207612:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c7ebb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.207622:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c7ebb lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.207665:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528455.207806:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+45:2404:x1875407719669504:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 381us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528455.207815:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 62 00010000:00010000:1.0:1788528455.208076:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c7ebb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.208087:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c7ebb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528455.208184:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788528455.208189:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788528455.208245:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c7ebb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.208276:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c7ebb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.208288:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7ead lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.208296:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7ead lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.208304:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7ead lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.208311:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3ba00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528455.208315:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7ead lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.208324:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7ead lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.208335:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:1.0:1788528455.208339:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528455.208343:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7ead lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.208350:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7ead lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.208365:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c7eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.208372:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c7eb4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.208383:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c7eb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.208389:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528455.208392:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c7eb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.208398:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c7eb4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.208407:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a90c87be100) 00010000:00010000:1.0:1788528455.208409:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528455.208412:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c7eb4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.208417:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c7eb4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.208460:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7ea6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd0f expref: 45 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.208477:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c7ebb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd0f expref: 44 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.208485:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:1.0:1788528455.208487:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788528455.208490:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3a200, rc 0) 00000100:00100000:1.0:1788528455.208531:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+44:11217:x1875407719669120:12345-192.168.203.38@tcp:101:stat.0 Request processed in 11494us (11810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528455.208548:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:1.0:1788528455.281412:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528455.281598:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719669760 00000100:00100000:0.0:1788528455.281628:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719669760 00000100:00100000:0.0:1788528455.281710:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:0.0:1788528455.281720:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+44:11223:x1875407719669760:12345-192.168.203.38@tcp:36:truncate.0 00010000:00010000:0.0:1788528455.281797:0:13480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528455.281831:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c7ebb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd0f expref: 44 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528455.281853:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:0.0:1788528455.281859:0:13480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788528455.282082:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7ec2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528455.282099:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7ec2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528455.282110:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7ec2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788528455.282160:0:13480:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967340 00000004:00010000:0.0:1788528455.282184:0:13480:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dbe3e03f reply state 0000000053e51803 transno 4294967341 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7ec2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528455.282196:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7ec2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528455.282203:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:0.0:1788528455.282205:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788528455.282208:0:13480:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788528455.282638:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+46:11223:x1875407719669760:12345-192.168.203.38@tcp:36:truncate.0 Request processed in 917us (1240us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1788528455.282646:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 64 00000020:00080000:0.0:1788528455.282661:0:13480:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788528455.436321:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528455.436503:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719669888 00000100:00100000:1.0:1788528455.436516:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719669888 00000100:00100000:1.0:1788528455.436639:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 65 00000100:00100000:1.0:1788528455.436651:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+46:11237:x1875407719669888:12345-192.168.203.38@tcp:101:stat.0 00010000:00010000:1.0:1788528455.436685:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528455.436711:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c7ec9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfd16 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.436795:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7ed0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.436814:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7ed0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.436827:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7ed0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.436839:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c7ed7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.436846:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c7ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.436852:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c7ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.436938:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c7ede lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.436964:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c7ede lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.436973:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c7ede lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528455.437036:0:8449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788528455.437041:0:8449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788528455.437066:0:8449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c7ede lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.437080:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c7ede lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.437089:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7ed0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.437095:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7ed0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.437102:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7ed0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.437108:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528455.437112:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7ed0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.437120:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7ed0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.437134:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:1.0:1788528455.437153:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528455.437161:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7ed0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.437167:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7ed0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.437183:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c7ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.437190:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c7ed7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.437195:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c7ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.437200:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17e00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528455.437203:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c7ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.437208:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c7ed7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.437216:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a90c87be100) 00010000:00010000:1.0:1788528455.437219:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528455.437221:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c7ed7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.437226:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c7ed7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.437256:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c7ec9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd16 expref: 48 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.437284:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c7ede lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd16 expref: 47 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.437291:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:1.0:1788528455.437294:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788528455.437297:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e17200, rc 0) 00000100:00100000:1.0:1788528455.437376:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+47:11237:x1875407719669888:12345-192.168.203.38@tcp:101:stat.0 Request processed in 726us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528455.437385:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 65 00000100:00100000:3.0:1788528455.514287:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528455.514541:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719670144 00000100:00100000:1.0:1788528455.514594:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719670144 00000100:00100000:1.0:1788528455.514674:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 66 00000100:00100000:1.0:1788528455.514686:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+47:11247:x1875407719670144:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1788528455.514714:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528455.514742:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c7ee5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfd1d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528455.514882:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788528455.515258:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c7ee5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd1d expref: 49 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.515277:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90d5d08500) 00010000:00010000:1.0:1788528455.515281:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788528455.515288:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c7ee5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd1d expref: 49 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.515332:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e16800, rc 0) 00000100:00100000:1.0:1788528455.515727:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+48:11247:x1875407719670144:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 1040us (1453us total) trans 4294967342 rc 301/301 00000100:00100000:1.0:1788528455.515737:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 66 00000100:00100000:1.0:1788528455.522833:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528455.523016:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719670400 00000100:00100000:0.0:1788528455.523305:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719670400 00000100:00100000:0.0:1788528455.525013:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:0.0:1788528455.525063:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+48:11247:x1875407719670400:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:0.0:1788528455.525428:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+49:11247:x1875407719670400:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 389us (2610us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788528455.525437:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:0.0:1788528455.580983:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528455.581099:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719670656 00000100:00100000:2.0:1788528455.581112:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719670656 00000100:00100000:2.0:1788528455.581255:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 67 00000100:00100000:2.0:1788528455.581269:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+49:11253:x1875407719670656:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:2.0:1788528455.581303:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528455.581333:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7ef3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfd24 expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.581795:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7efa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.581816:0:13480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c7ede lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd16 expref: 50 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.581826:0:13480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7efa lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.581870:0:13480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c7ede lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd16 expref: 50 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.581887:0:13480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c7ede lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd16 expref: 50 pid: 8449 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528455.581903:0:13480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13480:1875407735486976:192.168.203.38@tcp:104: 00000100:00100000:2.0:1788528455.582079:0:13480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d93540 going to sleep for 11 seconds 00000100:00100000:1.0:1788528455.586541:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528455.586752:0:13480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13480:1875407735486976:192.168.203.38@tcp:104: 00010000:00010000:2.0:1788528455.586782:0:13480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7efa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528455.586963:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719670784 00000100:00100000:3.0:1788528455.586971:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719670784 00010000:00010000:3.0:1788528455.587013:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c7ede lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd16 expref: 51 pid: 8449 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528455.587160:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:3.0:1788528455.587200:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+51:2404:x1875407719670784:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788528455.587219:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528455.587228:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c7ede lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd16 expref: 51 pid: 8449 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528455.587242:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c7ede lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd16 expref: 51 pid: 8449 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528455.587269:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c7ede lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd16 expref: 51 pid: 8449 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528455.587290:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:3.0:1788528455.587295:0:6493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7efa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528455.587306:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7efa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528455.587315:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7efa lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528455.587347:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528455.587425:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+50:2404:x1875407719670784:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 228us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528455.587434:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 63 00010000:00010000:2.0:1788528455.588610:0:13480:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7efa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.588625:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7efa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528455.588652:0:13480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788528455.588854:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7ef3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd24 expref: 51 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.588876:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7efa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd24 expref: 50 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.588886:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:2.0:1788528455.588889:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788528455.588893:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3be00, rc 0) 00000100:00100000:2.0:1788528455.588965:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+50:11253:x1875407719670656:12345-192.168.203.38@tcp:101:bash.0 Request processed in 7699us (7996us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1788528455.588974:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 67 00000100:00100000:1.0:1788528455.591790:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528455.591859:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719671040 00000100:00100000:0.0:1788528455.591872:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719671040 00000100:00100000:3.0:1788528455.591967:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 68 00000100:00100000:3.0:1788528455.591984:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+50:11253:x1875407719671040:12345-192.168.203.38@tcp:36:bash.0 00010000:00010000:3.0:1788528455.592372:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c7f08 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528455.592406:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c7f08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528455.592419:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c7f08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788528455.592467:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967345 00000004:00010000:3.0:1788528455.592487:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3c81299 reply state 00000000b3a04fea transno 4294967346 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c7f08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528455.592497:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c7f08 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528455.592503:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:3.0:1788528455.592506:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788528455.592508:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788528455.592641:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+53:11253:x1875407719671040:12345-192.168.203.38@tcp:36:bash.0 Request processed in 663us (861us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788528455.592646:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 68 00000020:00080000:3.0:1788528455.592651:0:6509:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788528455.599810:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528455.599878:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719671168 00000100:00100000:2.0:1788528455.599939:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719671168 00000100:00100000:2.0:1788528455.600034:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 69 00000100:00100000:2.0:1788528455.600047:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+53:11253:x1875407719671168:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:2.0:1788528455.600080:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528455.600106:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7f0f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfd2b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.600542:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c7f16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.600671:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7efa lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd24 expref: 54 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.600683:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c7f16 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.600751:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7efa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd24 expref: 54 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.600767:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7efa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd24 expref: 54 pid: 13480 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528455.600783:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc36f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6510:1875407735487104:192.168.203.38@tcp:104: 00000100:00100000:2.0:1788528455.600910:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d93540 going to sleep for 11 seconds 00000100:00100000:1.0:1788528455.603935:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc36f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6510:1875407735487104:192.168.203.38@tcp:104: 00000100:00100000:0.0:1788528455.603935:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00010000:00010000:1.0:1788528455.603979:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c7f16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528455.604043:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719671296 00000100:00100000:2.0:1788528455.604056:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719671296 00010000:00010000:2.0:1788528455.604102:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7efa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd24 expref: 55 pid: 13480 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528455.604202:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:2.0:1788528455.604214:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+55:2404:x1875407719671296:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528455.604233:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528455.604247:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7efa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd24 expref: 55 pid: 13480 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.604261:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7efa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd24 expref: 55 pid: 13480 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.604290:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7efa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd24 expref: 55 pid: 13480 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.604306:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:2.0:1788528455.604324:0:10330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c7f16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.604332:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c7f16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.604339:0:10330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c7f16 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.604361:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528455.604434:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+54:2404:x1875407719671296:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 221us (508us total) trans 0 rc 0/0 00010000:00010000:1.0:1788528455.604442:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c7f16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528455.604443:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 64 00010000:00010000:1.0:1788528455.604450:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c7f16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528455.604521:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788528455.604527:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788528455.604587:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c7f16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.604626:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c7f0f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd2b expref: 54 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.604642:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c7f16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd2b expref: 53 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.604659:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:1.0:1788528455.604662:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788528455.604664:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3a200, rc 0) 00000100:00100000:1.0:1788528455.604693:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+53:11253:x1875407719671168:12345-192.168.203.38@tcp:101:bash.0 Request processed in 4649us (4896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528455.604699:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 69 00000100:00100000:1.0:1788528455.607317:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528455.607465:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719671552 00000100:00100000:0.0:1788528455.607476:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719671552 00000100:00100000:0.0:1788528455.607536:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:0.0:1788528455.607719:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e14850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+53:11253:x1875407719671552:12345-192.168.203.38@tcp:35:bash.0 00000100:00100000:0.0:1788528455.608047:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e14850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+54:11253:x1875407719671552:12345-192.168.203.38@tcp:35:bash.0 Request processed in 500us (738us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1788528455.608057:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:3.0:1788528455.659349:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528455.659936:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719671808 00000100:00100000:2.0:1788528455.659951:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719671808 00000100:00100000:2.0:1788528455.660041:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 70 00000100:00100000:2.0:1788528455.660055:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+54:11263:x1875407719671808:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1788528455.660089:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528455.660118:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7f1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfd32 expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528455.660263:0:13480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788528455.660393:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7f1d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd32 expref: 56 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.660412:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90d5d08500) 00010000:00010000:2.0:1788528455.660416:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788528455.660423:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7f1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd32 expref: 56 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.660465:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3be00, rc 0) 00000100:00100000:2.0:1788528455.660624:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+55:11263:x1875407719671808:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 503us (1222us total) trans 4294967348 rc 301/301 00000100:00100000:2.0:1788528455.660632:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 70 00000100:00100000:3.0:1788528455.670946:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528455.671088:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719671936 00000100:00100000:2.0:1788528455.671101:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719671936 00000100:00100000:2.0:1788528455.671189:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 71 00000100:00100000:2.0:1788528455.671202:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+55:11263:x1875407719671936:12345-192.168.203.38@tcp:34:lfs.0 00010000:00010000:2.0:1788528455.671311:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7f2b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.671340:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7f2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.671354:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7f2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.671368:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7f32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.671377:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7f32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.671384:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7f32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.671480:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c7f39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.671513:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c7f39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.671521:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c7f39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788528455.671636:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c7f39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.671652:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7f2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.671659:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7f2b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.671667:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7f2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.671673:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3be00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528455.671678:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7f2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.671687:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7f2b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.671701:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:2.0:1788528455.671704:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528455.671710:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7f2b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.671716:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7f2b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.671737:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7f32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.671743:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7f32 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.671749:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7f32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.671754:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528455.671757:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7f32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.671764:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7f32 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.671772:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a90c87be100) 00010000:00010000:2.0:1788528455.671774:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528455.671777:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7f32 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.671783:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7f32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.671792:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c7f39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.671798:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c7f39 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.671804:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c7f39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.671815:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528455.671818:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c7f39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.671824:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c7f39 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.671833:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:2.0:1788528455.671835:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528455.671838:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c7f39 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.671843:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c7f39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528455.671937:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+55:11263:x1875407719671936:12345-192.168.203.38@tcp:34:lfs.0 Request processed in 736us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528455.671945:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 71 00000100:00100000:1.0:1788528455.680422:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528455.680605:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719672192 00000100:00100000:3.0:1788528455.680619:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719672192 00000100:00100000:3.0:1788528455.680680:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:3.0:1788528455.680693:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+55:11263:x1875407719672192:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:3.0:1788528455.681266:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+56:11263:x1875407719672192:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 572us (857us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788528455.681277:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:3.0:1788528455.720128:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528455.720267:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719672448 00000100:00100000:1.0:1788528455.720282:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719672448 00000100:00100000:1.0:1788528455.720372:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 72 00000100:00100000:1.0:1788528455.720393:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+56:11266:x1875407719672448:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1788528455.720435:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528455.720463:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c7f40 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfd39 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.720611:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c7f47 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.720630:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c7f47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.720643:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c7f47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.720657:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c7f4e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.720689:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c7f4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.720697:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c7f4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.720828:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c7f55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.720840:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c7f55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.720847:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c7f55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528455.720859:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788528455.720957:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c7f47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.720965:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c7f47 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.720972:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c7f47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.720979:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528455.720984:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c7f47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.720993:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c7f47 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.721017:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:1.0:1788528455.721031:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528455.721037:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c7f47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.721045:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c7f47 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.721061:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c7f4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.721067:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c7f4e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.721073:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c7f4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.721078:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528455.721082:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c7f4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.721089:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c7f4e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.721097:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a90c87be100) 00010000:00010000:1.0:1788528455.721099:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528455.721103:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c7f4e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.721109:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c7f4e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.721163:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c7f40 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd39 expref: 59 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.721178:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c7f55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd39 expref: 58 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.721186:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:1.0:1788528455.721189:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788528455.721191:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e16e00, rc 0) 00000100:00100000:1.0:1788528455.721276:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+58:11266:x1875407719672448:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 894us (1162us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788528455.721285:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 72 00000100:00100000:0.0:1788528455.727242:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528455.727362:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528455.727449:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719672576 00000100:00100000:1.0:1788528455.727463:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719672576 00000100:00100000:2.0:1788528455.727511:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719672704 00000100:00100000:2.0:1788528455.727516:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719672704 00000100:00100000:1.0:1788528455.727580:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 73 00000100:00100000:1.0:1788528455.727592:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+59:11266:x1875407719672576:12345-192.168.203.38@tcp:54:lfs.0 00000100:00100000:2.0:1788528455.727632:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:2.0:1788528455.727640:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+59:2404:x1875407719672704:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528455.727653:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528455.727677:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c7f63 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.727682:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c7f55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd39 expref: 59 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.727698:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c7f63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.727710:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:1.0:1788528455.727710:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c7f63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.727717:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788528455.727755:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c7f63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.727770:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c7f63 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.727776:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c7f63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.727782:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17a00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528455.727788:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c7f63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528455.727795:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+58:2404:x1875407719672704:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 156us (433us total) trans 0 rc 0/0 00010000:00010000:1.0:1788528455.727797:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c7f63 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528455.727804:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 2 00010000:00010000:1.0:1788528455.727806:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:1.0:1788528455.727809:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788528455.727812:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c7f63 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528455.727818:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c7f63 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528455.727858:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+57:11266:x1875407719672576:12345-192.168.203.38@tcp:54:lfs.0 Request processed in 268us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528455.727866:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 73 00000100:00100000:1.0:1788528455.730126:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528455.730171:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719672960 00000100:00100000:0.0:1788528455.730189:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719672960 00000100:00100000:0.0:1788528455.730258:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:0.0:1788528455.730269:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+57:11266:x1875407719672960:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:0.0:1788528455.731469:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+58:11266:x1875407719672960:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 1194us (1349us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1788528455.731504:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 17 00010000:00010000:2.0:1788528455.807063:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528455.821837:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528455.822330:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719673216 00000100:00100000:1.0:1788528455.822345:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719673216 00000100:00100000:2.0:1788528455.822482:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 74 00000100:00100000:2.0:1788528455.822498:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc36f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+58:11284:x1875407719673216:12345-192.168.203.38@tcp:101:cat.0 00010000:00010000:2.0:1788528455.822532:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528455.822581:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c7f6a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfd40 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.822735:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7f71 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.822756:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7f71 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.822771:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7f71 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528455.822785:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788528455.823051:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c7f6a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd40 expref: 61 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.823074:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7f71 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd40 expref: 60 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.823085:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:2.0:1788528455.823089:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788528455.823113:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3a800, rc 0) 00000100:00100000:2.0:1788528455.823201:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc36f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+60:11284:x1875407719673216:12345-192.168.203.38@tcp:101:cat.0 Request processed in 707us (1378us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788528455.823209:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 74 00000100:00100000:0.0:1788528455.855200:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528455.855277:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719673344 00000100:00100000:2.0:1788528455.855290:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719673344 00000100:00100000:2.0:1788528455.855379:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 75 00000100:00100000:2.0:1788528455.855392:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+60:11285:x1875407719673344:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1788528455.855423:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528455.855449:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c7f7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfd47 expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.855599:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7f86 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.855616:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7f86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.855629:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7f86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528455.855685:0:13480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788528455.855689:0:13480:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788528455.855712:0:13480:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7f86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.855742:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c7f7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd47 expref: 62 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.855762:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7f86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd47 expref: 61 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.855779:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:2.0:1788528455.855782:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788528455.855788:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3be00, rc 0) 00000100:00100000:2.0:1788528455.855870:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+61:11285:x1875407719673344:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 481us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528455.855878:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 75 00000100:00100000:1.0:1788528455.868275:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528455.868588:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719673728 00000100:00100000:3.0:1788528455.868597:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719673728 00000100:00100000:3.0:1788528455.868659:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:3.0:1788528455.868670:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+61:11285:x1875407719673728:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:3.0:1788528455.868961:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+62:11285:x1875407719673728:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 293us (694us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788528455.868969:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:0.0:1788528455.870809:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788528455.870831:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c96c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735487232:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788528455.870883:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528455.870944:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735487232 00000100:00100000:0.0:1788528455.870951:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735487232 00000100:00100000:0.0:1788528455.870999:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788528455.871007:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c96cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735487232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788528455.871045:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528455.871084:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c96cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735487232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528455.871090:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:0.0:1788528455.871111:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788528455.871149:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c96c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735487232:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788528455.874248:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735487488:0@lo:400:kworker.0 00000100:00100000:1.0:1788528455.874325:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528455.874357:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735488000:0@lo:400:kworker.0 00000100:00100000:1.0:1788528455.874378:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528455.874393:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735488512:0@lo:400:kworker.0 00000100:00100000:1.0:1788528455.874412:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528455.874441:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788528455.874447:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735487360:0@lo:400:kworker.0 00000100:00100000:1.0:1788528455.874489:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528455.874508:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735487872:0@lo:400:kworker.0 00000100:00100000:1.0:1788528455.874530:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528455.874548:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735488384:0@lo:400:kworker.0 00000100:00100000:1.0:1788528455.874605:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528455.874635:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735487872 00000100:00100000:1.0:1788528455.874642:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735487872 00000100:00100000:1.0:1788528455.874685:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788528455.874693:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735487872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528455.874753:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735487872:12345-0@lo:400:kworker.0 Request processed in 60us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528455.874759:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788528455.874803:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735487872:0@lo:400:kworker.0 00000100:00100000:1.0:1788528455.874824:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735487488 00000100:00100000:1.0:1788528455.874828:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735487488 00000100:00100000:1.0:1788528455.874852:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735488000 00000100:00100000:1.0:1788528455.874855:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735488000 00000100:00100000:1.0:1788528455.874877:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735488512 00000100:00100000:1.0:1788528455.874879:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735488512 00000100:00100000:1.0:1788528455.874905:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788528455.874910:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735487488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528455.874945:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735487488:12345-0@lo:400:kworker.0 Request processed in 35us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528455.874953:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788528455.874966:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788528455.874972:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735488000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528455.874999:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735488000:12345-0@lo:400:kworker.0 Request processed in 27us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528455.875005:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788528455.875016:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788528455.875032:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735488512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528455.875058:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735488512:12345-0@lo:400:kworker.0 Request processed in 37us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528455.875063:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788528455.875087:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735487488:0@lo:400:kworker.0 00000100:00100000:1.0:1788528455.875097:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735488000:0@lo:400:kworker.0 00000100:00100000:1.0:1788528455.875104:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735488512:0@lo:400:kworker.0 00000100:00100000:2.0:1788528455.875641:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735487360 00000100:00100000:2.0:1788528455.875646:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735487360 00000100:00100000:2.0:1788528455.875678:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1788528455.875685:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+27:3638:x1875407735487360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528455.875722:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+27:3638:x1875407735487360:12345-0@lo:400:kworker.0 Request processed in 37us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528455.875728:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1788528455.876453:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735487744:0@lo:400:kworker.0 00000100:00100000:3.0:1788528455.876494:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528455.876535:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735488256:0@lo:400:kworker.0 00000100:00100000:3.0:1788528455.876598:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528455.876616:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735488768:0@lo:400:kworker.0 00000100:00100000:3.0:1788528455.876637:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528455.876657:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788528455.876663:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735487616:0@lo:400:kworker.0 00000100:00100000:3.0:1788528455.876685:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528455.876702:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1875407735488128:0@lo:400:kworker.0 00000100:00100000:3.0:1788528455.876721:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528455.876737:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735488640:0@lo:400:kworker.0 00000100:00100000:3.0:1788528455.876755:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528455.876799:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735488384 00000100:00100000:3.0:1788528455.876804:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735488384 00000100:00100000:3.0:1788528455.876838:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735488256 00000100:00100000:3.0:1788528455.876841:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735488256 00000100:00100000:3.0:1788528455.876858:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735488768 00000100:00100000:3.0:1788528455.876869:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735488768 00000100:00100000:3.0:1788528455.876889:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788528455.876895:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3638:x1875407735488384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528455.876936:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3638:x1875407735488384:12345-0@lo:400:kworker.0 Request processed in 41us (2331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528455.876942:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788528455.876958:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788528455.876963:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735488256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528455.876994:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735488256:12345-0@lo:400:kworker.0 Request processed in 31us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528455.876999:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788528455.877009:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788528455.877015:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735488768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528455.877051:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735488768:12345-0@lo:400:kworker.0 Request processed in 37us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528455.877056:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788528455.877074:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735487616 00000100:00100000:3.0:1788528455.877077:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735487616 00000100:00100000:3.0:1788528455.877101:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788528455.877106:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735487616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528455.877148:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735487616:12345-0@lo:400:kworker.0 Request processed in 41us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528455.877153:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788528455.877185:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735487616:0@lo:400:kworker.0 00000100:00100000:3.0:1788528455.877197:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735488256:0@lo:400:kworker.0 00000100:00100000:3.0:1788528455.877216:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735488768:0@lo:400:kworker.0 00000100:00100000:3.0:1788528455.877243:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735487744 00000100:00100000:3.0:1788528455.877247:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735487744 00000100:00100000:3.0:1788528455.877267:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735488128 00000100:00100000:3.0:1788528455.877269:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735488128 00000100:00100000:3.0:1788528455.877286:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735488640 00000100:00100000:3.0:1788528455.877289:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735488640 00000100:00100000:3.0:1788528455.877301:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788528455.877307:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735487744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528455.877340:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735487744:12345-0@lo:400:kworker.0 Request processed in 32us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528455.877347:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788528455.877359:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788528455.877364:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875407735488128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528455.877388:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875407735488128:12345-0@lo:400:kworker.0 Request processed in 24us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528455.877392:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788528455.877404:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788528455.877410:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735488640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528455.877448:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735488640:12345-0@lo:400:kworker.0 Request processed in 39us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528455.877454:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00010000:00080000:3.0:1788528455.877480:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa69c00 x1875407735488128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528455.877490:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1875407735488128:0@lo:400:kworker.0 00010000:00080000:3.0:1788528455.877512:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa69180 x1875407735488640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528455.877519:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735488640:0@lo:400:kworker.0 00000100:00100000:3.0:1788528455.877528:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735487744:0@lo:400:kworker.0 00000100:00100000:0.0:1788528455.878478:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735488896:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788528455.878528:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528455.878595:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788528455.878602:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735489024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788528455.878627:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788528455.878669:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788528455.878674:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788528455.878676:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788528455.878679:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788528455.878693:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735488896 00000100:00100000:0.0:1788528455.878700:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735488896 00000100:00100000:0.0:1788528455.878759:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788528455.878767:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c96c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735488896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788528455.878806:0:9268:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1788528455.878845:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c96c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735488896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528455.878851:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788528455.878891:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735488896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528455.879134:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735489024 00000100:00100000:2.0:1788528455.879139:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735489024 00000100:00100000:2.0:1788528455.879185:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788528455.879192:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c96cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735489024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788528455.879205:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528455.879238:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c96cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735489024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528455.879245:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788528455.879420:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735489024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788528455.880585:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735487360:0@lo:400:kworker.0 00000100:00100000:1.0:1788528455.880608:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735488384:0@lo:400:kworker.0 00000100:00100000:1.0:1788528455.882634:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528455.882739:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719673856 00000100:00100000:3.0:1788528455.882749:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719673856 00000100:00100000:3.0:1788528455.882805:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:3.0:1788528455.882813:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+62:11285:x1875407719673856:12345-192.168.203.38@tcp:103:lfs.0 00010000:00010000:3.0:1788528455.882828:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788528455.882863:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c7f16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd2b expref: 62 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528455.882887:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c7f71 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd40 expref: 61 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528455.882900:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c7e13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfce5 expref: 60 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528455.882910:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:3.0:1788528455.882915:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528455.883152:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+59:11285:x1875407719673856:12345-192.168.203.38@tcp:103:lfs.0 Request processed in 337us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528455.883160:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:1.0:1788528455.888372:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528455.888447:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719673984 00000100:00100000:3.0:1788528455.888475:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719673984 00000100:00100000:3.0:1788528455.888595:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 76 00000100:00100000:3.0:1788528455.888605:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+59:11285:x1875407719673984:12345-192.168.203.38@tcp:58:lfs.0 00010000:00010000:3.0:1788528455.888725:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c7f8d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528455.888741:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c7f8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528455.888753:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c7f8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788528455.889628:0:6509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788528455.889759:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788528455.889834:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788528455.890400:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+59:11285:x1875407719673984:12345-192.168.203.38@tcp:58:lfs.0 Request processed in 1788us (2029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528455.890411:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 76 00000100:00100000:1.0:1788528455.932077:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528455.932208:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719674112 00000100:00100000:2.0:1788528455.932218:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719674112 00000100:00100000:2.0:1788528455.932285:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:2.0:1788528455.932295:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+59:11287:x1875407719674112:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1788528455.932325:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528455.932347:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c7f94 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfd4e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.932414:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7f9b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.932429:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7f9b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.932439:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7f9b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.932450:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c7fa2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.932456:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c7fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.932463:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c7fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.932548:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c7fa9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.932594:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c7fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.932601:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c7fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528455.932643:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788528455.932653:0:6508:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788528455.932675:0:6508:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c7fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.932688:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c7fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.932695:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7f9b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.932701:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7f9b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.932708:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7f9b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.932713:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3ba00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528455.932718:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7f9b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.932726:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7f9b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.932747:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:2.0:1788528455.932750:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528455.932755:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7f9b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.932762:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c7f9b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.932774:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c7fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.932791:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c7fa2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.932797:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c7fa2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.932802:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528455.932805:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c7fa2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.932811:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c7fa2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.932819:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a90c87be100) 00010000:00010000:2.0:1788528455.932821:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528455.932825:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c7fa2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.932831:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c7fa2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.932858:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c7f94 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd4e expref: 61 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.932871:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c7fa9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd4e expref: 60 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528455.932880:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:2.0:1788528455.932882:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788528455.932891:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3b600, rc 0) 00000100:00100000:2.0:1788528455.932998:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+60:11287:x1875407719674112:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 703us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528455.933006:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 77 00000040:00080000:3.0:1788528456.319745:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788528456.319753:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788528456.319797:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788528456.319809:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788528456.320337:0:13786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1875407735489152:192.168.203.38@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788528456.320442:0:13786:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc267fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528456.326178:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528456.326218:0:13786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1875407735489152:192.168.203.38@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788528456.326265:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719674240 00000100:00100000:2.0:1788528456.326272:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719674240 00000100:00100000:2.0:1788528456.326317:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 78 00000100:00100000:2.0:1788528456.326326:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+60:11298:x1875407719674240:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788528456.326356:0:8449:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788528456.326468:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+60:11298:x1875407719674240:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 Request processed in 142us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528456.326476:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 78 00000100:00100000:1.0:1788528456.331259:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528456.331451:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719674368 00000100:00100000:3.0:1788528456.331461:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719674368 00000100:00100000:3.0:1788528456.331538:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 79 00000100:00100000:3.0:1788528456.331548:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+60:11298:x1875407719674368:12345-192.168.203.38@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788528456.331681:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c7fb0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.331698:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c7fb0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.331711:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c7fb0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.331774:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c7fb7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.331783:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c7fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.331789:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c7fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.331815:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c7fbe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.331824:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c7fbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.331829:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c7fbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528456.331879:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788528456.331884:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788528456.331900:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c7fbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.331912:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c7fb0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.331925:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c7fb0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.331931:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c7fb0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.331937:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3429200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528456.331942:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c7fb0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.331950:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c7fb0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.331963:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a8fc2721c00) 00010000:00010000:3.0:1788528456.331966:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528456.331970:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c7fb0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.331976:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c7fb0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.331989:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c7fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.331994:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c7fb7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.332000:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c7fb7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.332004:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528456.332011:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c7fb7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.332026:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c7fb7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.332035:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8a90d5d08600) 00010000:00010000:3.0:1788528456.332038:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528456.332041:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c7fb7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.332046:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c7fb7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.332062:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c7fbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.332069:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c7fbe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.332074:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c7fbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.332079:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3429000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528456.332082:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c7fbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.332087:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c7fbe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.332093:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:3.0:1788528456.332095:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528456.332104:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c7fbe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.332110:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c7fbe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528456.332198:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+60:11298:x1875407719674368:12345-192.168.203.38@tcp:34:lhsmtool_posix.0 Request processed in 651us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528456.332206:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 79 00000100:00100000:1.0:1788528456.334790:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528456.334926:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719674624 00000100:00100000:3.0:1788528456.334936:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719674624 00000100:00100000:3.0:1788528456.334992:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 80 00000100:00100000:3.0:1788528456.335002:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+60:11298:x1875407719674624:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788528456.335031:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528456.335052:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c7fc5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfd55 expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.335157:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c7fcc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.335171:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c7fcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.335192:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c7fcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528456.335201:0:13480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788528456.335276:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c7fcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.335282:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c7fcc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.335299:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c7fcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.335305:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528456.335309:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c7fcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.335315:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c7fcc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.335326:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:3.0:1788528456.335329:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788528456.335333:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c7fcc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.335338:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c7fcc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.335375:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c7fc5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd55 expref: 62 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.335385:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a8fc2721c00) 00010000:00010000:3.0:1788528456.335387:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788528456.335391:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c7fc5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd55 expref: 62 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.335400:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3429400, rc 0) 00000100:00100000:3.0:1788528456.335457:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+61:11298:x1875407719674624:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 457us (675us total) trans 4294967354 rc 301/301 00000100:00100000:3.0:1788528456.335474:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 80 00000100:00100000:3.0:1788528456.337320:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528456.338198:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719674752 00000100:00100000:0.0:1788528456.338209:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719674752 00000100:00100000:0.0:1788528456.338269:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 81 00000100:00100000:0.0:1788528456.338279:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+61:11298:x1875407719674752:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788528456.338312:0:6510:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788528456.338436:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+61:11298:x1875407719674752:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 Request processed in 158us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528456.338444:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 81 00000100:00100000:1.0:1788528456.359743:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528456.360084:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719675008 00000100:00100000:2.0:1788528456.360095:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719675008 00000100:00100000:2.0:1788528456.360159:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 82 00000100:00100000:2.0:1788528456.360169:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+61:11298:x1875407719675008:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788528456.360198:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528456.360201:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788528456.360227:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c7f86 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd47 expref: 61 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528456.360246:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:2.0:1788528456.360252:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788528456.360265:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b400/0x892c60dda91c7fda lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfd5c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788528456.360828:0:6508:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788528456.360981:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3bc00/0x892c60dda91c7fe1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528456.360994:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3bc00/0x892c60dda91c7fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528456.361004:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3bc00/0x892c60dda91c7fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528456.361067:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b400/0x892c60dda91c7fda lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd5c expref: 63 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528456.361081:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3bc00/0x892c60dda91c7fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd5c expref: 62 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528456.361088:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a8fc3770c00) 00010000:00010000:2.0:1788528456.361092:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788528456.361094:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3bc00, rc 0) 00000100:00100000:2.0:1788528456.361162:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+62:11298:x1875407719675008:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 994us (1427us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1788528456.361169:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 82 00000100:00100000:2.0:1788528456.369337:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528456.377401:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719675264 00000100:00100000:3.0:1788528456.377417:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719675264 00000100:00100000:1.0:1788528456.380841:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 83 00000100:00100000:1.0:1788528456.380856:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+62:11298:x1875407719675264:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788528456.380920:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528456.380949:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3bc00/0x892c60dda91c7fe1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd5c expref: 62 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.380967:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a8fc3770c00) 00010000:00010000:1.0:1788528456.380978:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788528456.381005:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c7fef lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.381028:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c7fef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.381040:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c7fef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.381057:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7ff6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x8fee9f02 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.381065:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7ff6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x8fee9f02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.381072:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7ff6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x8fee9f02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.381128:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c7fef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.381136:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c7fef lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.381142:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c7fef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.381148:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528456.381153:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c7fef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.381160:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c7fef lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.381169:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:1.0:1788528456.381172:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528456.381188:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c7fef lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.381194:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c7fef lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.381203:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7ff6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x8fee9f02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.381209:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7ff6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8fee9f02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.381214:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7ff6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8fee9f02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.381226:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528456.381229:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7ff6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8fee9f02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.381235:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7ff6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8fee9f02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.381243:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x8fee9f02 (ffff8a90c96f2a00) 00010000:00010000:1.0:1788528456.381245:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528456.381248:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7ff6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x8fee9f02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.381254:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c7ff6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x8fee9f02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528456.381341:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+61:11298:x1875407719675264:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 486us (12010us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788528456.381349:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 83 00000100:00100000:1.0:1788528456.389332:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528456.389602:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719675392 00000100:00100000:3.0:1788528456.389619:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719675392 00000100:00100000:3.0:1788528456.389704:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 84 00000100:00100000:3.0:1788528456.389716:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+61:11298:x1875407719675392:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788528456.389743:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528456.389777:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c7ffd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfd63 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.389823:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8004 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.389840:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8004 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.389855:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8004 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.390002:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c7ffd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd63 expref: 63 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.390037:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8004 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd63 expref: 62 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.390047:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a90d5d08600) 00010000:00010000:3.0:1788528456.390059:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788528456.390064:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3428200, rc 0) 00000100:00100000:3.0:1788528456.390160:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+62:11298:x1875407719675392:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 444us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528456.390168:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 84 00000100:00100000:2.0:1788528456.397386:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528456.397483:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719675648 00000100:00100000:3.0:1788528456.397501:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719675648 00000100:00100000:0.0:1788528456.397707:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 85 00000100:00100000:0.0:1788528456.397725:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+62:11298:x1875407719675648:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788528456.397842:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c800b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528456.397863:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c800b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528456.397876:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c800b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788528456.398170:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1788528456.398182:0:6508:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 325615627539ns, next at 326615624748ns, rc = 0 00000004:00010000:0.0:1788528456.398243:0:6508:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003793b783 reply state 00000000ebd3aeaa transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c800b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528456.398258:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c800b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528456.398265:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a90d5d08600) 00010000:00010000:0.0:1788528456.398268:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788528456.398273:0:6508:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788528456.399037:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+64:11298:x1875407719675648:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 1310us (1652us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1788528456.399049:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 85 00000100:00100000:3.0:1788528456.402911:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528456.403099:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719675776 00000100:00100000:3.0:1788528456.403111:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719675776 00000100:00100000:3.0:1788528456.403346:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 86 00000100:00100000:3.0:1788528456.403358:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+64:11298:x1875407719675776:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788528456.403505:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528456.403533:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c8012 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfd6a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.403818:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c8012 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd6a expref: 65 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.403838:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c8012 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd6a expref: 65 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.403869:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a90d5d08600) 00010000:00010000:3.0:1788528456.403873:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788528456.403992:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3429400, rc 0) 00000100:00100000:3.0:1788528456.404875:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+65:11298:x1875407719675776:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 1513us (1984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528456.404998:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 86 00000100:00100000:2.0:1788528456.410901:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528456.411199:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719675904 00000100:00100000:0.0:1788528456.411217:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719675904 00000100:00100000:0.0:1788528456.411289:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 32 00000100:00100000:0.0:1788528456.411301:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2402:x1875407719675904:12345-192.168.203.38@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1788528456.411348:0:8725:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from 80304108-f3b9-46ea-888c-b2a7ec20e3e2@192.168.203.38@tcp t0 exp 0000000000000000 cur 325 last 0 00000020:00000080:0.0:1788528456.411526:0:8725:0:(genops.c:1385:class_connect()) connect: client 80304108-f3b9-46ea-888c-b2a7ec20e3e2, cookie 0x892c60dda91c8019 00002000:00100000:0.0:1788528456.411541:0:8725:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 80304108-f3b9-46ea-888c-b2a7ec20e3e2/ffff8a90d0051000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788528456.411593:0:8725:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788528456.411704:0:8725:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788528456.411746:0:8725:0:(import.c:65:import_set_state_nolock()) ffff8a90d0054000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788528456.412063:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2402:x1875407719675904:12345-192.168.203.38@tcp:8:lhsmtool_posix.0 Request processed in 759us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528456.412093:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 32 00000100:00100000:1.0:1788528456.419104:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528456.419213:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719676032 00000100:00100000:3.0:1788528456.419483:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719676032 00000100:00100000:3.0:1788528456.419689:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:3.0:1788528456.419702:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:0:x1875407719676032:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788528456.420231:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788528456.422975:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:2.0:1788528456.422998:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 80304108-f3b9-46ea-888c-b2a7ec20e3e2 00000100:00100000:3.0:1788528456.423214:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:0:x1875407719676032:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 Request processed in 3506us (4117us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788528456.423360:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:2.0:1788528456.430075:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528456.430284:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719676288 00000100:00100000:3.0:1788528456.430297:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719676288 00000100:00100000:3.0:1788528456.430377:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:3.0:1788528456.430388:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+65:11298:x1875407719676288:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788528456.431306:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+66:11298:x1875407719676288:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 912us (1238us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1788528456.431318:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:2.0:1788528456.442941:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528456.443307:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719676544 00000100:00100000:0.0:1788528456.443324:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719676544 00000100:00100000:0.0:1788528456.443765:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 87 00000100:00100000:0.0:1788528456.443779:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+66:11298:x1875407719676544:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788528456.444014:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+66:11298:x1875407719676544:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 238us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528456.449739:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 87 00000100:00100000:1.0:1788528456.451218:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528456.451377:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719676672 00000100:00100000:0.0:1788528456.451390:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719676672 00000100:00100000:0.0:1788528456.451531:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 88 00000100:00100000:0.0:1788528456.451542:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+66:11298:x1875407719676672:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788528456.451771:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528456.451801:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8020 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfd71 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528456.451890:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c8027 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528456.451909:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c8027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528456.451923:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c8027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788528456.452060:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788528456.452085:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c8027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528456.452138:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8020 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd71 expref: 68 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528456.452157:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c8027 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd71 expref: 67 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528456.452167:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a90d5d08600) 00010000:00010000:0.0:1788528456.452170:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788528456.452175:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031a00, rc 0) 00000100:00100000:0.0:1788528456.452338:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+67:11298:x1875407719676672:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 797us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528456.452346:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 88 00000100:00100000:1.0:1788528456.456803:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528456.456980:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719676800 00000100:00100000:3.0:1788528456.456993:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719676800 00000100:00100000:3.0:1788528456.457089:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 34 00000100:00100000:3.0:1788528456.457103:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2404:x1875407719676800:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788528456.457127:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528456.457168:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049e57467/0x892c60dda91c802e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfd78 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788528456.457202:0:8421:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ac748, blocks: 0x0 00010000:00010000:3.0:1788528456.457226:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=325s v=(0 0) 00010000:00010000:3.0:1788528456.457232:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528456.457245:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049e57467/0x892c60dda91c802e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd78 expref: 6 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.457284:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049e57467/0x892c60dda91c802e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd78 expref: 6 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.457302:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3429000, rc 0) 00000100:00100000:3.0:1788528456.457378:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2404:x1875407719676800:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 278us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528456.457388:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 34 00000100:00100000:2.0:1788528456.470732:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528456.470791:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719677056 00000100:00100000:2.0:1788528456.470804:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719677056 00000100:00100000:2.0:1788528456.470876:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 89 00000100:00100000:2.0:1788528456.470899:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+67:11298:x1875407719677056:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788528456.472518:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+67:11298:x1875407719677056:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 1613us (1792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528456.472532:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 89 00000100:00100000:1.0:1788528456.482633:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528456.483663:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719677184 00000100:00100000:2.0:1788528456.483680:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719677184 00000100:00100000:2.0:1788528456.483761:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 35 00000100:00100000:2.0:1788528456.483773:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:11298:x1875407719677184:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788528456.483798:0:8422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528456.483824:0:8422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ea6a60c/0x892c60dda91c8035 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfd7f expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528456.483869:0:8422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049e57467/0x892c60dda91c802e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd78 expref: 7 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528456.483880:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528456.483884:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528456.483890:0:8422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ea6a60c/0x892c60dda91c8035 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd7f expref: 7 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528456.484216:0:8422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049e57467/0x892c60dda91c802e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd78 expref: 7 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528456.484252:0:8422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049e57467/0x892c60dda91c802e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd78 expref: 7 pid: 8421 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528456.484269:0:8422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8422:1875407735489280:192.168.203.38@tcp:104: 00000100:00100000:2.0:1788528456.484462:0:8422:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d93cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528456.497905:0:8422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8422:1875407735489280:192.168.203.38@tcp:104: 00010000:00010000:1.0:1788528456.498265:0:8422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000ea6a60c/0x892c60dda91c8035 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd7f expref: 7 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.498311:0:8422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3a800, rc 0) 00000100:00100000:1.0:1788528456.498392:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:11298:x1875407719677184:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 14619us (15778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528456.498403:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 35 00000100:00100000:1.0:1788528456.498671:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528456.502217:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719677312 00000100:00100000:2.0:1788528456.502237:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719677312 00010000:00010000:2.0:1788528456.502306:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049e57467/0x892c60dda91c802e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd78 expref: 7 pid: 8421 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528456.502373:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 65 00000100:00100000:2.0:1788528456.502393:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90efa87050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2403:x1875407719677312:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528456.502415:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528456.502445:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049e57467/0x892c60dda91c802e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd78 expref: 7 pid: 8421 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528456.502463:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049e57467/0x892c60dda91c802e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd78 expref: 7 pid: 8421 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528456.502494:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049e57467/0x892c60dda91c802e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd78 expref: 7 pid: 8421 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528456.502514:0:10330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528456.502572:0:10330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528456.502584:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000ea6a60c/0x892c60dda91c8035 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd7f expref: 6 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528456.502596:0:10330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ea6a60c/0x892c60dda91c8035 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd7f expref: 6 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528456.502647:0:10330:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000ea6a60c/0x892c60dda91c8035 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd7f expref: 6 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528456.502665:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10330:1875407735489408:192.168.203.38@tcp:105: 00000100:00100000:2.0:1788528456.503421:0:10330:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d93cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528456.506261:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10330:1875407735489408:192.168.203.38@tcp:105: 00010000:00010000:2.0:1788528456.506299:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528456.506393:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90efa87050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2403:x1875407719677312:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 4001us (7722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528456.506407:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 65 00000100:00100000:2.0:1788528456.507103:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528456.507264:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719677440 00000100:00100000:0.0:1788528456.507275:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719677440 00002000:00100000:0.0:1788528456.507330:0:8428:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8a90f6ef7100 x1875407719677440/t0(0) o4->80304108-f3b9-46ea-888c-b2a7ec20e3e2@192.168.203.38@tcp:662/0 lens 504/0 e 0 to 0 dl 1788528467 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788528456.507343:0:8428:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a90f6ef7100 with x1875407719677440 ext(0->8) 00002000:00010000:0.0:1788528456.507349:0:8428:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a90f6ef7100 00000100:00100000:0.0:1788528456.507382:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:0.0:1788528456.507391:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2404:x1875407719677440:12345-192.168.203.38@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788528456.508444:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:2404:x1875407719677440:12345-192.168.203.38@tcp:4:lhsmtool_posix.0 Request processed in 1044us (1335us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788528456.508456:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 0 00002000:00100000:0.0:1788528456.508468:0:8428:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8a90f6ef7100 x1875407719677440/t4294967303(0) o4->80304108-f3b9-46ea-888c-b2a7ec20e3e2@192.168.203.38@tcp:662/0 lens 504/448 e 0 to 0 dl 1788528467 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788528456.508492:0:8428:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a90f6ef7100 with x1875407719677440 ext(0->8) 00002000:00010000:0.0:1788528456.508499:0:8428:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a90f6ef7100 00000100:00100000:2.0:1788528456.511700:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528456.512052:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719677568 00000100:00100000:3.0:1788528456.512067:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719677568 00000100:00100000:3.0:1788528456.512631:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 90 00000100:00100000:3.0:1788528456.512647:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+67:11298:x1875407719677568:12345-192.168.203.38@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788528456.514715:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967357 is committed 00000004:00080000:1.0:1788528456.514739:0:6487:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:3.0:1788528456.514763:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c7d4f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.514780:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c7d4f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.514789:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c7d4f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.514796:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031c00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528456.514803:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c7d4f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.514812:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c7d4f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788528456.514842:0:6487:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:3.0:1788528456.514848:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8a90c87be200) 00010000:00010000:3.0:1788528456.514854:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528456.514861:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c7d4f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.514868:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c7d4f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788528456.514870:0:6487:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a8fc3eef780 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788528456.514878:0:6487:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a90f6ed6d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a8fc3eefa80 00000020:00080000:1.0:1788528456.514882:0:6487:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a90f6ed6f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a8fc3dc4000 00000100:00100000:1.0:1788528456.514993:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c96c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735489536:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788528456.515028:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c7d56 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515037:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c7d56 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515042:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c7d56 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515048:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528456.515051:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c7d56 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515055:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c7d56 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515063:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:3.0:1788528456.515065:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528456.515067:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c7d56 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515071:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c7d56 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515095:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c7d95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528456.515100:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788528456.515105:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c7d95 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515111:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c7d95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515114:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030a00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528456.515116:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c7d95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515119:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c7d95 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515125:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a90c87be100) 00010000:00010000:3.0:1788528456.515127:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528456.515129:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c7d95 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515133:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c7d95 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515151:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c7e9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515156:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c7e9f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515161:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c7e9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515174:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428e00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528456.515178:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c7e9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515185:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c7e9f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515194:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:3.0:1788528456.515196:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528456.515198:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c7e9f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515202:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c7e9f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515212:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7ec2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515216:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7ec2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515219:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7ec2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515222:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528456.515224:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7ec2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515227:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7ec2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515240:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:3.0:1788528456.515241:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528456.515243:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7ec2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515247:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c7ec2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515259:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c7f08 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515265:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c7f08 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515271:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c7f08 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515277:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528456.515279:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c7f08 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515286:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c7f08 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515293:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:3.0:1788528456.515296:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528456.515299:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c7f08 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515305:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c7f08 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515339:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c800b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515346:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c800b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515352:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c800b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515358:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528456.515362:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c800b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515368:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c800b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515379:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a90d5d08600) 00010000:00010000:3.0:1788528456.515381:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788528456.515384:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c800b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.515390:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c800b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788528456.515411:0:6540:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:1.0:1788528456.515706:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788528456.515717:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735489664:0@lo:2:osp-syn-1-0.0 00000020:00080000:3.0:1788528456.515901:0:6540:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788528456.515925:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528456.516078:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735489536 00000100:00100000:2.0:1788528456.516088:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735489536 00000100:00100000:3.0:1788528456.516124:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+14:11298:x1875407719677568:12345-192.168.203.38@tcp:44:lhsmtool_posix.0 Request processed in 3478us (4433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528456.516136:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 90 00000100:00100000:2.0:1788528456.516158:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735489664 00000100:00100000:2.0:1788528456.516163:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735489664 00000100:00100000:2.0:1788528456.516194:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788528456.516220:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1875407735489536:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788528456.516255:0:8421:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:2.0:1788528456.516294:0:8421:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9ac746, atime: 0x6a9ac746, ctime: 0x6a9ac746, blocks: 0x8 00010000:00010000:2.0:1788528456.516312:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d910469/0x892c60dda91c803c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528456.516332:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=325s v=(0 0) 00010000:00010000:2.0:1788528456.516337:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528456.516345:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d910469/0x892c60dda91c803c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528456.516376:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d910469/0x892c60dda91c803c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528456.516397:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d910469/0x892c60dda91c803c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528456.516406:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d910469/0x892c60dda91c803c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528456.516431:0:8421:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788528456.516455:0:8438:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528456.516469:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d910469/0x892c60dda91c803c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.516478:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a400 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528456.516482:0:8438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d910469/0x892c60dda91c803c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528456.516613:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3639:x1875407735489536:12345-0@lo:6:osp-syn-0-0.0 Request processed in 398us (1514us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788528456.516621:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788528456.516640:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788528456.516648:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735489664:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1788528456.516686:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a90c96c9880/2, rc 0, transno 4294967302 00000100:00100000:0.0:1788528456.516695:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c96c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735489536:0@lo:6:osp-syn-0-0.0 00002000:00010000:2.0:1788528456.516747:0:8421:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788528456.516751:0:8421:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788528456 00002000:00010000:2.0:1788528456.516757:0:8421:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:3.0:1788528456.516761:0:8438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d910469/0x892c60dda91c803c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788528456.516772:0:8421:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788528456 -> 1788528456 00010000:00010000:3.0:1788528456.516779:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d910469/0x892c60dda91c803c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788528456.516782:0:8421:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788528456.516794:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d910469/0x892c60dda91c803c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.516814:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528456.516817:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528456.516820:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528456.516824:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1875407735489664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 175us (898us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788528456.516834:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:0.0:1788528456.516844:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a90f6ef5880/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788528456.516851:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735489664:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1788528456.516859:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788528456.519120:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528456.519214:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719677696 00000100:00100000:0.0:1788528456.519227:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719677696 00000100:00100000:0.0:1788528456.519295:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 38 00000100:00100000:0.0:1788528456.519307:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:2403:x1875407719677696:12345-192.168.203.38@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788528456.521005:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1788528456.521031:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:2.0:1788528456.521207:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2403:x1875407719677696:12345-192.168.203.38@tcp:16:lhsmtool_posix.0 Request processed in 1896us (2095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528456.521219:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 38 00000100:00100000:2.0:1788528456.524223:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528456.524368:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719677952 00000100:00100000:3.0:1788528456.524482:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719677952 00000100:00100000:1.0:1788528456.529002:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 91 00000100:00100000:1.0:1788528456.529045:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+14:11298:x1875407719677952:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788528456.529504:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528456.529543:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c8027 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd71 expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.529630:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a90d5d08600) 00010000:00010000:1.0:1788528456.529645:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788528456.529690:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c8043 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.529708:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c8043 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.529721:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c8043 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788528456.529886:0:8449:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c9c966f1 reply state 000000005389f25a transno 4294967358 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c8043 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.529901:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c8043 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.529909:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a90d5d08600) 00010000:00010000:1.0:1788528456.529912:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788528456.529916:0:8449:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788528456.530215:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+15:11298:x1875407719677952:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 1196us (6013us total) trans 4294967358 rc 0/0 00000100:00100000:1.0:1788528456.530225:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 91 00000100:00100000:3.0:1788528456.533493:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528456.533574:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719678080 00000100:00100000:1.0:1788528456.533587:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719678080 00000100:00100000:1.0:1788528456.533660:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:1.0:1788528456.533674:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2403:x1875407719678080:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788528456.533911:0:8423:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788528456.533916:0:8423:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788528456 -> 1788528455 00002000:00010000:1.0:1788528456.533918:0:8423:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788528454 00002000:00010000:1.0:1788528456.533921:0:8423:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788528456 -> 1788528455 00002000:00010000:1.0:1788528456.533931:0:8423:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788528456.534239:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2403:x1875407719678080:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 Request processed in 565us (757us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788528456.534249:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:2.0:1788528456.536964:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528456.537075:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719678336 00000100:00100000:3.0:1788528456.537088:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719678336 00000100:00100000:3.0:1788528456.537164:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 92 00000100:00100000:3.0:1788528456.537175:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+15:11298:x1875407719678336:12345-192.168.203.38@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788528456.537267:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c804a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.537306:0:13480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8004 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd63 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.537318:0:13480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c804a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.537531:0:13480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8004 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd63 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.537548:0:13480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8004 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd63 expref: 15 pid: 6509 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528456.537703:0:13480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13480:1875407735489792:192.168.203.38@tcp:104: 00000100:00100000:3.0:1788528456.537844:0:13480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc267f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788528456.539811:0:13480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13480:1875407735489792:192.168.203.38@tcp:104: 00010000:00010000:2.0:1788528456.539847:0:13480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c804a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528456.541192:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528456.541691:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719678464 00000100:00100000:3.0:1788528456.541704:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719678464 00010000:00010000:3.0:1788528456.541753:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8004 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd63 expref: 16 pid: 6509 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528456.541805:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 66 00000100:00100000:3.0:1788528456.541821:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+16:2404:x1875407719678464:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788528456.541838:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528456.541847:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8004 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd63 expref: 16 pid: 6509 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.541861:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8004 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd63 expref: 16 pid: 6509 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.541898:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8004 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd63 expref: 16 pid: 6509 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.541916:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a90d5d08600) 00010000:00010000:3.0:1788528456.541922:0:8441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c804a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.541934:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c804a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.541944:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c804a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.541981:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788528456.542056:0:13480:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c804a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528456.542061:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+15:2404:x1875407719678464:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 241us (875us total) trans 0 rc 0/0 00010000:00010000:1.0:1788528456.542075:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c804a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528456.542079:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 66 00010000:00010000:1.0:1788528456.542138:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c804a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.542147:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c804a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.542156:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c804a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.542162:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528456.542168:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c804a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.542178:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c804a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.542190:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a90d5d08600) 00010000:00010000:1.0:1788528456.542194:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788528456.542207:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c804a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.542215:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c804a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528456.542293:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+14:11298:x1875407719678336:12345-192.168.203.38@tcp:55:lhsmtool_posix.0 Request processed in 5119us (5342us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788528456.542303:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 92 00000100:00100000:2.0:1788528456.544768:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528456.544919:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719678592 00000100:00100000:3.0:1788528456.544932:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719678592 00000100:00100000:3.0:1788528456.545006:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:3.0:1788528456.545029:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2403:x1875407719678592:12345-192.168.203.38@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788528456.545088:0:8422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000069e4eb91/0x892c60dda91c8051 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.545114:0:8422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000ea6a60c/0x892c60dda91c8035 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd7f expref: 7 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.545149:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528456.545154:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788528456.545161:0:8422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069e4eb91/0x892c60dda91c8051 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.545210:0:8422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000ea6a60c/0x892c60dda91c8035 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd7f expref: 7 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.545229:0:8422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000ea6a60c/0x892c60dda91c8035 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd7f expref: 7 pid: 8422 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528456.545248:0:8422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8422:1875407735489920:192.168.203.38@tcp:104: 00000100:00100000:3.0:1788528456.547114:0:8422:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc267f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528456.554287:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528456.554335:0:8422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8422:1875407735489920:192.168.203.38@tcp:104: 00010000:00010000:2.0:1788528456.554372:0:8422:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069e4eb91/0x892c60dda91c8051 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528456.554445:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719678720 00000100:00100000:1.0:1788528456.554454:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719678720 00010000:00010000:1.0:1788528456.554503:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000ea6a60c/0x892c60dda91c8035 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd7f expref: 8 pid: 8422 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528456.554551:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 67 00000100:00100000:1.0:1788528456.554579:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:2404:x1875407719678720:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788528456.554598:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528456.554625:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000ea6a60c/0x892c60dda91c8035 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd7f expref: 8 pid: 8422 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.554640:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000ea6a60c/0x892c60dda91c8035 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd7f expref: 8 pid: 8422 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.554670:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ea6a60c/0x892c60dda91c8035 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd7f expref: 8 pid: 8422 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.554689:0:6493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788528456.554694:0:6493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788528456.554701:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069e4eb91/0x892c60dda91c8051 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.554724:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069e4eb91/0x892c60dda91c8051 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.554760:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788528456.554801:0:8422:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069e4eb91/0x892c60dda91c8051 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.554813:0:8422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069e4eb91/0x892c60dda91c8051 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528456.554834:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2404:x1875407719678720:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 255us (568us total) trans 0 rc 0/0 00010000:00010000:3.0:1788528456.554838:0:8422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000069e4eb91/0x892c60dda91c8051 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528456.554845:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 67 00010000:00010000:3.0:1788528456.554854:0:8422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069e4eb91/0x892c60dda91c8051 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.554888:0:8422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069e4eb91/0x892c60dda91c8051 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.554897:0:8422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428e00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528456.554902:0:8422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069e4eb91/0x892c60dda91c8051 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.554913:0:8422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069e4eb91/0x892c60dda91c8051 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.554926:0:8422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069e4eb91/0x892c60dda91c8051 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.554933:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069e4eb91/0x892c60dda91c8051 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528456.554993:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2403:x1875407719678592:12345-192.168.203.38@tcp:1:lhsmtool_posix.0 Request processed in 9976us (10238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528456.555001:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:2.0:1788528456.561227:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528456.561537:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719678976 00000100:00100000:3.0:1788528456.561587:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719678976 00000100:00100000:3.0:1788528456.561658:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 93 00000100:00100000:3.0:1788528456.561670:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+14:11298:x1875407719678976:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788528456.561786:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8058 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.561825:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c7e98 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd08 expref: 14 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.561836:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8058 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.561894:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c7e98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd08 expref: 14 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.561910:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c7e98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd08 expref: 14 pid: 13480 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528456.561927:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6510:1875407735490048:192.168.203.38@tcp:104: 00000100:00100000:3.0:1788528456.562044:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc267f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528456.568470:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6510:1875407735490048:192.168.203.38@tcp:104: 00000100:00100000:2.0:1788528456.568471:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00010000:00010000:0.0:1788528456.568510:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8058 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528456.568673:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719679104 00000100:00100000:3.0:1788528456.568682:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719679104 00010000:00010000:3.0:1788528456.568727:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c7e98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd08 expref: 15 pid: 13480 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528456.568771:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 68 00000100:00100000:3.0:1788528456.568780:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+15:2403:x1875407719679104:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788528456.568800:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528456.568807:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c7e98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd08 expref: 15 pid: 13480 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.568818:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c7e98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd08 expref: 15 pid: 13480 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.568858:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c7e98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd08 expref: 15 pid: 13480 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.568878:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:3.0:1788528456.568884:0:10330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8058 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.568896:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8058 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.568904:0:10330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8058 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.568936:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528456.569000:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+14:2403:x1875407719679104:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 219us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528456.569008:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 68 00010000:00010000:2.0:1788528456.569278:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8058 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528456.569288:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8058 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528456.569595:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c805f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528456.569611:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c8012 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd6a expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528456.569621:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c805f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528456.569657:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c8012 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd6a expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528456.569673:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c8012 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd6a expref: 15 pid: 6510 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528456.569689:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6510:1875407735490176:192.168.203.38@tcp:104: 00000100:00100000:2.0:1788528456.569765:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695780 going to sleep for 11 seconds 00000100:00100000:3.0:1788528456.575839:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528456.575973:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6510:1875407735490176:192.168.203.38@tcp:104: 00010000:00010000:2.0:1788528456.576013:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c805f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528456.576127:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719679232 00000100:00100000:0.0:1788528456.576136:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719679232 00010000:00010000:0.0:1788528456.576186:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c8012 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd6a expref: 15 pid: 6510 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528456.576240:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 69 00000100:00100000:0.0:1788528456.576250:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+15:2404:x1875407719679232:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788528456.576268:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528456.576293:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c8012 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd6a expref: 15 pid: 6510 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528456.576306:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c8012 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd6a expref: 15 pid: 6510 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528456.576335:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c8012 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd6a expref: 15 pid: 6510 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528456.576353:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a90d5d08600) 00010000:00010000:0.0:1788528456.576358:0:8441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c805f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528456.576368:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c805f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528456.576377:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c805f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528456.576400:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528456.576467:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+14:2404:x1875407719679232:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 217us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528456.576476:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 69 00010000:00010000:2.0:1788528456.576834:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c805f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528456.576844:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c805f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788528456.576993:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1788528456.577174:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000001:00080000:2.0:1788528456.577227:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1788528456.577322:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6510:1875407735490304:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788528456.577389:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528456.577431:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c82bda80 going to sleep for 11 seconds 00000100:00100000:0.0:1788528456.577966:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735490304 00000100:00100000:0.0:1788528456.577978:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735490304 00000100:00100000:0.0:1788528456.578053:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788528456.578066:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6510:x1875407735490304:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788528456.578204:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6510:x1875407735490304:12345-0@lo:1000:mdt00_002.0 Request processed in 133us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528456.578224:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788528456.578449:0:6510:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788528456.578457:0:6510:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a90f6ef5880, transno 4294967304 00000100:00100000:2.0:1788528456.578480:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6510:1875407735490304:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788528456.578690:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00000100:00100000:2.0:1788528456.578765:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6510:1875407735490432:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788528456.578811:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528456.578841:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695900 going to sleep for 11 seconds 00000100:00100000:0.0:1788528456.579444:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735490432 00000100:00100000:0.0:1788528456.579462:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735490432 00000100:00100000:0.0:1788528456.579522:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788528456.579533:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6510:x1875407735490432:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788528456.579719:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6510:x1875407735490432:12345-0@lo:1000:mdt00_002.0 Request processed in 186us (906us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788528456.579727:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788528456.582688:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6510:1875407735490432:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788528456.582773:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c805f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.582786:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c805f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.582793:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c805f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.582800:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528456.582816:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c805f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.582827:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c805f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.582847:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a90d5d08600) 00010000:00010000:3.0:1788528456.582852:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788528456.582859:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c805f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.582866:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c805f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.582905:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c7f8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.582912:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c7f8d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.582918:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c7f8d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.582923:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428c00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528456.582926:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c7f8d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.582933:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c7f8d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.582944:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:3.0:1788528456.582946:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788528456.582956:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c7f8d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.582963:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c7f8d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.582993:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8066 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.583011:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c7fa9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd4e expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.583042:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8066 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.583093:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c7fa9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd4e expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.583288:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c7fa9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd4e expref: 17 pid: 6508 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528456.583307:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6510:1875407735490560:192.168.203.38@tcp:104: 00000100:00100000:3.0:1788528456.583425:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc267f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788528456.588861:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6510:1875407735490560:192.168.203.38@tcp:104: 00010000:00010000:1.0:1788528456.588900:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8066 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528456.591512:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528456.591870:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719679360 00000100:00100000:1.0:1788528456.591884:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719679360 00010000:00010000:1.0:1788528456.591936:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c7fa9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd4e expref: 18 pid: 6508 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528456.591985:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 70 00000100:00100000:1.0:1788528456.591998:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+18:2404:x1875407719679360:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788528456.592026:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528456.592035:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c7fa9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd4e expref: 18 pid: 6508 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.592051:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c7fa9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd4e expref: 18 pid: 6508 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.592081:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c7fa9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd4e expref: 18 pid: 6508 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.592110:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:1.0:1788528456.592116:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8066 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.592128:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8066 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.592137:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8066 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.592179:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788528456.592231:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8066 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.592242:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8066 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.592258:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8066 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528456.592261:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+17:2404:x1875407719679360:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 264us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528456.592271:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 70 00010000:00010000:3.0:1788528456.592286:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8066 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.592539:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8066 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.592549:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428e00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528456.592600:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8066 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.592612:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8066 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.592626:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:3.0:1788528456.592629:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528456.592635:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8066 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.592642:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8066 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.592656:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8058 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.592662:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8058 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.592669:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8058 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.592675:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528456.592684:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8058 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.592692:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8058 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.592702:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a90c87bed00) 00010000:00010000:3.0:1788528456.592704:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788528456.592708:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8058 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528456.592714:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8058 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788528456.593323:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788528456.593332:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788528456.593357:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788528456.593367:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788528456.594587:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+16:11298:x1875407719678976:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 32907us (33363us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1788528456.594603:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 93 00000020:00080000:3.0:1788528456.594612:0:6510:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788528456.605589:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528456.605805:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719679616 00000100:00100000:1.0:1788528456.605818:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719679616 00000100:00100000:1.0:1788528456.605895:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:1.0:1788528456.605907:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+16:11298:x1875407719679616:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788528456.606452:0:6511:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788528456.606494:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967364 00010000:00010000:1.0:1788528456.606537:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c806d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.606582:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c806d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.606598:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c806d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.606621:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c806d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.606629:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c806d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.606635:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c806d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528456.606658:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788528456.606681:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528456.606700:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c806d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528456.606709:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16200 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528456.606714:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c806d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528456.606724:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c806d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528456.606741:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a90d5d08600) 00010000:00010000:0.0:1788528456.606745:0:8440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788528456.606751:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c806d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528456.606759:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c806d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528456.606774:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+18:11298:x1875407719679616:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 866us (1197us total) trans 4294967365 rc 0/0 00010000:00010000:0.0:1788528456.606785:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528456.606786:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 20 00010000:00010000:0.0:1788528456.606789:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528456.606792:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788528456.606794:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788528456.831994:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528456.895851:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788528456.895875:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735490688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788528456.895943:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528456.896051:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735490688 00000100:00100000:1.0:1788528456.896060:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735490688 00000100:00100000:1.0:1788528456.896108:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788528456.896119:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735490688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788528456.896150:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788528456.896194:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735490688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528456.896200:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788528456.896245:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735490688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788528456.900439:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788528456.900464:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735490816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788528456.900533:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788528456.906901:0:14197:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788528456.906911:0:14197:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788528456.906947:0:14197:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788528456.906956:0:14197:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788528456.907143:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735490816 00000100:00100000:2.0:1788528456.907152:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735490816 00000100:00100000:2.0:1788528456.907218:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788528456.907229:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1875407735490816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788528456.907254:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788528456.907332:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1875407735490816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (6798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528456.907340:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788528456.907503:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735490816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788528457.010723:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528457.010807:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719679872 00000100:00100000:2.0:1788528457.010818:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719679872 00000100:00100000:2.0:1788528457.010901:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 94 00000100:00100000:2.0:1788528457.010913:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c96c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+18:11308:x1875407719679872:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1788528457.010938:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528457.010959:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3bc00/0x892c60dda91c8074 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfd86 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.011100:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b400/0x892c60dda91c807b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.011115:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b400/0x892c60dda91c807b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.011126:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b400/0x892c60dda91c807b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788528457.011217:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1788528457.011244:0:8449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788528457.011369:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3bc00/0x892c60dda91c8074 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd86 expref: 21 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.011387:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b400/0x892c60dda91c807b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd86 expref: 20 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.011396:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:2.0:1788528457.011398:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788528457.011402:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3b400, rc 0) 00000100:00100000:2.0:1788528457.011458:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c96c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+20:11308:x1875407719679872:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 549us (909us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788528457.011465:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 94 00000100:00100000:0.0:1788528457.014911:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528457.014981:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719680000 00000100:00100000:2.0:1788528457.014991:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719680000 00000100:00100000:2.0:1788528457.015060:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 95 00000100:00100000:2.0:1788528457.015070:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c96ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+20:11308:x1875407719680000:12345-192.168.203.38@tcp:34:lfs.0 00010000:00010000:2.0:1788528457.015161:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8089 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.015190:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8089 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.015202:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8089 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.015219:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c8090 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.015226:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c8090 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.015232:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c8090 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.015309:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8097 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.015316:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.015322:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788528457.015380:0:13480:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.015392:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8089 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.015399:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8089 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.015416:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8089 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.015422:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3be00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528457.015426:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8089 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.015435:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8089 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.015446:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:2.0:1788528457.015450:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528457.015455:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8089 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.015461:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8089 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.015475:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c8090 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.015481:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c8090 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.015487:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c8090 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.015492:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3b600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528457.015495:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c8090 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.015510:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c8090 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.015518:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a8fc3770400) 00010000:00010000:2.0:1788528457.015520:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528457.015523:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c8090 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.015528:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c8090 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.015543:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.015549:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8097 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.015813:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8097 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.015818:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528457.015822:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8097 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.015829:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8097 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.015837:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a8fc3770b00) 00010000:00010000:2.0:1788528457.015839:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528457.015842:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8097 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.015860:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8097 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528457.015945:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c96ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+20:11308:x1875407719680000:12345-192.168.203.38@tcp:34:lfs.0 Request processed in 874us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528457.015955:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 95 00000100:00100000:3.0:1788528457.069164:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528457.070392:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719680256 00000100:00100000:2.0:1788528457.070405:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719680256 00000100:00100000:2.0:1788528457.070469:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 96 00000100:00100000:2.0:1788528457.070479:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+20:11311:x1875407719680256:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1788528457.070503:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528457.070527:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c809e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfd8d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.072007:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c80a5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.072173:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c80a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.072188:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c80a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.072206:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c80ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.072214:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c80ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.072232:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c80ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.072339:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3bc00/0x892c60dda91c80b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.072348:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3bc00/0x892c60dda91c80b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.072355:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3bc00/0x892c60dda91c80b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528457.072366:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788528457.072437:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c80a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.072445:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c80a5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.072452:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c80a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.072458:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3b600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528457.072463:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c80a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.072471:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c80a5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.072482:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:2.0:1788528457.072486:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528457.072497:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c80a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.072504:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c80a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.072515:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c80ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.072521:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c80ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.072527:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c80ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.072535:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3be00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528457.072538:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c80ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.072543:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c80ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.072550:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a8fc3770b00) 00010000:00010000:2.0:1788528457.072568:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528457.072572:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c80ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.072577:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c80ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.072633:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c809e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd8d expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.073236:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3bc00/0x892c60dda91c80b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd8d expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.073246:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a8fc3770400) 00010000:00010000:2.0:1788528457.073249:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788528457.073251:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3bc00, rc 0) 00000100:00100000:2.0:1788528457.073327:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+22:11311:x1875407719680256:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 2847us (4171us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1788528457.073337:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 96 00000100:00100000:3.0:1788528457.078516:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528457.079672:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719680384 00000100:00100000:0.0:1788528457.079683:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719680384 00000100:00100000:0.0:1788528457.079820:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 97 00000100:00100000:0.0:1788528457.079832:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+22:11311:x1875407719680384:12345-192.168.203.38@tcp:54:lfs.0 00010000:00010000:0.0:1788528457.079905:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c80c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528457.079922:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c80c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528457.079932:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c80c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528457.079969:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c80c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528457.079977:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c80c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528457.079984:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c80c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528457.079990:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031e00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528457.079995:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c80c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528457.080028:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c80c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528457.080041:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a8fc3770400) 00010000:00010000:0.0:1788528457.080044:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788528457.080049:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c80c1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528457.080056:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c80c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528457.080447:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+22:11311:x1875407719680384:12345-192.168.203.38@tcp:54:lfs.0 Request processed in 615us (1940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528457.080455:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 97 00000100:00100000:0.0:1788528457.086729:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528457.086817:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719680640 00000100:00100000:3.0:1788528457.086827:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719680640 00000100:00100000:3.0:1788528457.086977:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:3.0:1788528457.086988:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e17850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+22:11311:x1875407719680640:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:3.0:1788528457.087348:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e17850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+23:11311:x1875407719680640:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 360us (628us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1788528457.087357:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:0.0:1788528457.134688:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528457.134763:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719680896 00000100:00100000:2.0:1788528457.134775:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719680896 00000100:00100000:2.0:1788528457.134837:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 98 00000100:00100000:2.0:1788528457.134848:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c96c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+23:10836:x1875407719680896:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:2.0:1788528457.134872:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528457.134892:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c80c8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfd94 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.135801:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c80cf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.135820:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3bc00/0x892c60dda91c80b3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd8d expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.135829:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c80cf lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.135869:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3bc00/0x892c60dda91c80b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd8d expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.135901:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3bc00/0x892c60dda91c80b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd8d expref: 24 pid: 6510 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528457.135917:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6508:1875407735490944:192.168.203.38@tcp:104: 00000100:00100000:3.0:1788528457.136612:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d93b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788528457.145678:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528457.145835:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719681024 00000100:00100000:2.0:1788528457.145845:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719681024 00010000:00010000:2.0:1788528457.145885:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3bc00/0x892c60dda91c80b3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd8d expref: 25 pid: 6510 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528457.145930:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 71 00000100:00100000:2.0:1788528457.145940:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+25:2404:x1875407719681024:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528457.145954:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528457.145961:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3bc00/0x892c60dda91c80b3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd8d expref: 25 pid: 6510 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.145973:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3bc00/0x892c60dda91c80b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd8d expref: 25 pid: 6510 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.145994:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a8fc3770400) 00010000:00010000:2.0:1788528457.145999:0:10330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c80cf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.146008:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c80cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.146026:0:10330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c80cf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.146069:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528457.146130:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+25:2404:x1875407719681024:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 191us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528457.146137:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 71 00010000:00010000:0.0:1788528457.146841:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3bc00/0x892c60dda91c80b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd8d expref: 24 pid: 6510 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528457.146859:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6508:1875407735490944:192.168.203.38@tcp:104: 00010000:00010000:0.0:1788528457.146879:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c80cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528457.146888:0:6508:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c80cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528457.146894:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c80cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788528457.146925:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788528457.147136:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c80c8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd94 expref: 25 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528457.147160:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c80cf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd94 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528457.147167:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a8fc3770400) 00010000:00010000:0.0:1788528457.147170:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788528457.147173:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3be00, rc 0) 00000100:00100000:0.0:1788528457.147218:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c96c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+24:10836:x1875407719680896:12345-192.168.203.38@tcp:101:bash.0 Request processed in 12372us (12540us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1788528457.147226:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 98 00000100:00100000:3.0:1788528457.152765:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528457.152915:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719681152 00000100:00100000:2.0:1788528457.152925:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719681152 00000100:00100000:2.0:1788528457.153054:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 99 00000100:00100000:2.0:1788528457.153065:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+24:10836:x1875407719681152:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:2.0:1788528457.153088:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528457.153108:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c80dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfd9b expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.153153:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c80e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.153167:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c80e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.153178:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c80e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.153290:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c80dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd9b expref: 26 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.153306:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c80e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd9b expref: 25 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.153315:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a8fc3770400) 00010000:00010000:2.0:1788528457.153323:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788528457.153327:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3a600, rc 0) 00000100:00100000:2.0:1788528457.153782:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+25:10836:x1875407719681152:12345-192.168.203.38@tcp:101:bash.0 Request processed in 717us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528457.153789:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 99 00000100:00100000:0.0:1788528457.156700:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528457.157225:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719681408 00000100:00100000:1.0:1788528457.157234:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719681408 00000100:00100000:1.0:1788528457.157297:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 100 00000100:00100000:1.0:1788528457.157307:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c96c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+25:10836:x1875407719681408:12345-192.168.203.38@tcp:36:bash.0 00010000:00010000:1.0:1788528457.157520:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c80eb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528457.157536:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c80eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528457.157546:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c80eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788528457.157607:0:13480:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000004:00010000:1.0:1788528457.157631:0:13480:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005dff5e22 reply state 000000009381322d transno 4294967371 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c80eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528457.157643:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c80eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528457.157650:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a8fc3770400) 00010000:00010000:1.0:1788528457.157653:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788528457.157657:0:13480:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788528457.157733:0:13480:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967371 00000100:00100000:1.0:1788528457.157830:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c96c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+29:10836:x1875407719681408:12345-192.168.203.38@tcp:36:bash.0 Request processed in 524us (1137us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1788528457.157847:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 100 00000020:00080000:1.0:1788528457.157852:0:13480:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788528457.164198:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528457.164274:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719681536 00000100:00100000:0.0:1788528457.164284:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719681536 00000100:00100000:0.0:1788528457.164342:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 101 00000100:00100000:0.0:1788528457.164353:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+29:10836:x1875407719681536:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:0.0:1788528457.164374:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528457.164394:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c80f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfda2 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528457.164451:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c80f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfda2 expref: 30 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528457.164464:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c80f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfda2 expref: 30 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528457.164497:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a8fc3770400) 00010000:00010000:0.0:1788528457.164500:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788528457.164504:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031a00, rc 0) 00000100:00100000:0.0:1788528457.164589:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+30:10836:x1875407719681536:12345-192.168.203.38@tcp:101:bash.0 Request processed in 238us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528457.164596:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 101 00000100:00100000:3.0:1788528457.167127:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528457.167451:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719681664 00000100:00100000:1.0:1788528457.167464:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719681664 00000100:00100000:1.0:1788528457.167548:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:1.0:1788528457.167588:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:10836:x1875407719681664:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:1.0:1788528457.167605:0:8725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528457.167625:0:8725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003f3db7e/0x892c60dda91c80f9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfda9 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788528457.167649:0:8725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9ac747, atime: 0x6a9ac746, ctime: 0x6a9ac747, blocks: 0x8 00010000:00010000:1.0:1788528457.167671:0:8725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=326s v=(0 0) 00010000:00010000:1.0:1788528457.167675:0:8725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788528457.167683:0:8725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003f3db7e/0x892c60dda91c80f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfda9 expref: 7 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528457.167701:0:8725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000003f3db7e/0x892c60dda91c80f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfda9 expref: 7 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528457.167713:0:8725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e17000, rc 0) 00000100:00100000:1.0:1788528457.167773:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:10836:x1875407719681664:12345-192.168.203.38@tcp:101:bash.0 Request processed in 189us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528457.167780:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:3.0:1788528457.169860:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528457.169967:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719681792 00000100:00100000:0.0:1788528457.169977:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719681792 00002000:00010000:0.0:1788528457.170023:0:8426:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:0.0:1788528457.170028:0:8426:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a90fab2d500 with x1875407719681792 ext(0->18446744073709551615) 00002000:00010000:0.0:1788528457.170039:0:8426:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a90fab2d500. 00000100:00100000:0.0:1788528457.170073:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:0.0:1788528457.170083:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fab2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2406:x1875407719681792:12345-192.168.203.38@tcp:10:bash.0 00002000:00010000:0.0:1788528457.170347:0:8426:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788528457.170350:0:8426:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788528455 -> 1788528457 00002000:00010000:0.0:1788528457.170353:0:8426:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1788528454 -> 1788528454 00002000:00010000:0.0:1788528457.170356:0:8426:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788528455 -> 1788528457 00002000:00010000:0.0:1788528457.170358:0:8426:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1788528457.170414:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fab2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:2406:x1875407719681792:12345-192.168.203.38@tcp:10:bash.0 Request processed in 331us (558us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788528457.170422:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1 00002000:00010000:0.0:1788528457.170426:0:8426:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:0.0:1788528457.170428:0:8426:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a90fab2d500 with x1875407719681792 ext(0->18446744073709551615) 00002000:00010000:0.0:1788528457.170433:0:8426:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a90fab2d500. 00000100:00100000:0.0:1788528457.282204:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528457.282294:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719681920 00000100:00100000:2.0:1788528457.282304:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719681920 00000100:00100000:2.0:1788528457.282373:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 102 00000100:00100000:2.0:1788528457.282383:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c96c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+30:11325:x1875407719681920:12345-192.168.203.38@tcp:34:lfs.0 00010000:00010000:2.0:1788528457.282457:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c8100 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.282475:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c8100 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.282487:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c8100 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.282503:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8107 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.282511:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8107 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.282517:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8107 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.283008:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c810e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.283030:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c810e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.283053:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c810e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788528457.283103:0:8449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c810e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.283115:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c8100 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.283121:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c8100 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.283127:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c8100 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.283278:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528457.283284:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c8100 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.283292:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c8100 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.283303:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:2.0:1788528457.283306:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528457.283310:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c8100 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.283317:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c8100 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.283329:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8107 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.283342:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8107 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.283348:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8107 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.283353:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528457.283356:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8107 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.283363:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8107 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.283371:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a8fc3770b00) 00010000:00010000:2.0:1788528457.283374:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528457.283377:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8107 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.283383:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8107 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.283398:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c810e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.283404:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c810e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.283410:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c810e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.283415:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528457.283424:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c810e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.283431:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c810e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.283439:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a8fc3770400) 00010000:00010000:2.0:1788528457.283441:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528457.283445:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c810e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.283451:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c810e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528457.283622:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c96c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+30:11325:x1875407719681920:12345-192.168.203.38@tcp:34:lfs.0 Request processed in 1239us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528457.283629:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 102 00000100:00100000:0.0:1788528457.333463:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528457.333585:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719682176 00000100:00100000:3.0:1788528457.333668:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719682176 00000100:00100000:3.0:1788528457.333725:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 103 00000100:00100000:3.0:1788528457.333737:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c96c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+30:11328:x1875407719682176:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1788528457.333757:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528457.333780:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8115 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfdb0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.333852:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c811c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.333867:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c811c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.333879:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c811c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.333895:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8123 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.333902:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8123 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.334002:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8123 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.334126:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c812a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.334414:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c812a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.334424:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c812a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528457.334435:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788528457.334514:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c811c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.334521:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c811c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.334527:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c811c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.334532:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428e00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528457.334536:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c811c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.334542:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c811c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.337129:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:3.0:1788528457.337199:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528457.337224:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c811c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.337234:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c811c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.337256:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8123 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.337263:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8123 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.337269:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8123 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.337273:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428c00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528457.337277:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8123 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.337283:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8123 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.337296:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a8fc1fa8200) 00010000:00010000:3.0:1788528457.337298:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528457.337301:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8123 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.337306:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8123 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.337797:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8115 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdb0 expref: 33 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.337815:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c812a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdb0 expref: 32 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.337823:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a8fc3770400) 00010000:00010000:2.0:1788528457.337826:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788528457.337828:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3428000, rc 0) 00000100:00100000:2.0:1788528457.338080:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c96c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+32:11328:x1875407719682176:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 4344us (4624us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1788528457.338089:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 103 00000100:00100000:0.0:1788528457.346865:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528457.347204:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719682304 00000100:00100000:1.0:1788528457.347227:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719682304 00000100:00100000:1.0:1788528457.347332:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 104 00000100:00100000:1.0:1788528457.347343:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c96c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+32:11328:x1875407719682304:12345-192.168.203.38@tcp:54:lfs.0 00010000:00010000:1.0:1788528457.347419:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c8138 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528457.347436:0:13480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c80cf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd94 expref: 32 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528457.347446:0:13480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c8138 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528457.347485:0:13480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c80cf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd94 expref: 32 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528457.347499:0:13480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c80cf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd94 expref: 32 pid: 6508 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528457.347514:0:13480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37aca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13480:1875407735491072:192.168.203.38@tcp:104: 00000100:00100000:1.0:1788528457.347780:0:13480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1fd6600 going to sleep for 11 seconds 00000100:00100000:0.0:1788528457.355457:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528457.355539:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719682560 00000100:00100000:2.0:1788528457.355588:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719682560 00000100:00100000:2.0:1788528457.355647:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:2.0:1788528457.355657:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c96caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+33:6170:x1875407719682560:12345-192.168.203.38@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788528457.355947:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c96caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+34:6170:x1875407719682560:12345-192.168.203.38@tcp:35:ldlm_bl.0 Request processed in 291us (499us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788528457.355955:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:1.0:1788528457.356738:0:13480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37aca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13480:1875407735491072:192.168.203.38@tcp:104: 00010000:00010000:1.0:1788528457.356763:0:13480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c8138 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528457.359003:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528457.359084:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719682688 00000100:00100000:3.0:1788528457.359094:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719682688 00010000:00010000:3.0:1788528457.359130:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c80cf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd94 expref: 34 pid: 6508 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528457.359186:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 72 00000100:00100000:3.0:1788528457.359195:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90efa86c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+34:2404:x1875407719682688:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788528457.359210:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528457.359217:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c80cf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd94 expref: 34 pid: 6508 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.359228:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c80cf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd94 expref: 34 pid: 6508 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.359251:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c80cf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd94 expref: 34 pid: 6508 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.359267:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a8fc3770400) 00010000:00010000:3.0:1788528457.359272:0:6493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c8138 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.359282:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c8138 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.359289:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c8138 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.359320:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528457.359372:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90efa86c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+33:2404:x1875407719682688:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 177us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528457.359379:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 72 00010000:00010000:1.0:1788528457.359866:0:13480:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c8138 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528457.359875:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c8138 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528457.359925:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c8138 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528457.359932:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c8138 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528457.359939:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c8138 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528457.359945:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17e00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528457.359950:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c8138 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528457.359957:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c8138 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528457.359968:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a8fc3770400) 00010000:00010000:1.0:1788528457.359971:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788528457.359974:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c8138 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528457.359980:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c8138 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528457.360043:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c96c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+32:11328:x1875407719682304:12345-192.168.203.38@tcp:54:lfs.0 Request processed in 12701us (13187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528457.360052:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 104 00000100:00100000:2.0:1788528457.364222:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528457.364341:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719682944 00000100:00100000:0.0:1788528457.364352:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719682944 00000100:00100000:0.0:1788528457.364408:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:0.0:1788528457.364418:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+32:11328:x1875407719682944:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:0.0:1788528457.364676:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+33:11328:x1875407719682944:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 259us (463us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788528457.364684:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:0.0:1788528457.532619:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528457.532795:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719683200 00000100:00100000:2.0:1788528457.532805:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719683200 00000100:00100000:2.0:1788528457.532868:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 105 00000100:00100000:2.0:1788528457.532878:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c96cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+33:11339:x1875407719683200:12345-192.168.203.38@tcp:101:cat.0 00010000:00010000:2.0:1788528457.532901:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528457.532922:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c813f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfdb7 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.532996:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8146 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.533021:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8146 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.533031:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8146 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.533062:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c814d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.533069:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c814d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.533091:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c814d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.533197:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c8154 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.533208:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c8154 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.533216:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c8154 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528457.533238:0:8449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788528457.533312:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8146 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.533320:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8146 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.533327:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8146 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.533333:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3be00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528457.533337:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8146 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.533344:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8146 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.533356:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:2.0:1788528457.533360:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528457.533371:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8146 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.533378:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8146 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.533391:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c814d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.533397:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c814d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.533402:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c814d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.533407:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528457.533410:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c814d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.533416:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c814d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.533425:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a8fc3770b00) 00010000:00010000:2.0:1788528457.533427:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528457.533430:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c814d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.533436:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c814d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.533482:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c813f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdb7 expref: 36 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.533506:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c8154 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdb7 expref: 35 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.533512:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a8fc3770400) 00010000:00010000:2.0:1788528457.533515:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788528457.533517:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3a400, rc 0) 00000100:00100000:2.0:1788528457.533981:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c96cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+35:11339:x1875407719683200:12345-192.168.203.38@tcp:101:cat.0 Request processed in 1102us (1371us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788528457.533990:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 105 00000100:00100000:2.0:1788528457.542659:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528457.542786:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719683456 00000100:00100000:0.0:1788528457.542797:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719683456 00000100:00100000:0.0:1788528457.542854:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:0.0:1788528457.542864:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+35:11339:x1875407719683456:12345-192.168.203.38@tcp:35:cat.0 00000100:00100000:0.0:1788528457.543154:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+36:11339:x1875407719683456:12345-192.168.203.38@tcp:35:cat.0 Request processed in 289us (504us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788528457.543162:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:3.0:1788528457.583731:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528457.583851:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719683712 00000100:00100000:2.0:1788528457.583861:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719683712 00000100:00100000:2.0:1788528457.583935:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 106 00000100:00100000:2.0:1788528457.583945:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+36:11340:x1875407719683712:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1788528457.584024:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1788528457.584051:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c80f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfda2 expref: 36 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584073:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c8154 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdb7 expref: 35 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584085:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c812a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdb0 expref: 34 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584097:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c80e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd9b expref: 33 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584113:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a8fc3770400) 00010000:00010000:2.0:1788528457.584119:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788528457.584150:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c8162 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584163:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c8162 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584172:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c8162 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584185:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8169 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584192:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8169 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584198:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8169 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584266:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8170 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584273:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8170 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584280:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8170 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788528457.584492:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1788528457.584501:0:6509:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 326801946837ns, next at 327801944472ns, rc = 0 00010000:00010000:2.0:1788528457.584599:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8177 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584608:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8177 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584617:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8177 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584624:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8177 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584630:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8177 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584636:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8177 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584663:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788528457.584682:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8170 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584688:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8170 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584694:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8170 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584699:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3be00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528457.584703:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8170 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584711:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8170 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584729:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a8fc3770400) 00010000:00010000:2.0:1788528457.584732:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788528457.584736:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8170 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584743:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8170 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584759:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c8162 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584766:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c8162 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584771:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c8162 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584776:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528457.584779:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c8162 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584784:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c8162 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584791:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:2.0:1788528457.584794:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528457.584797:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c8162 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584802:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c8162 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788528457.584821:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056711984 reply state 000000008e410653 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8169 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584832:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8169 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.584838:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a8fc3770b00) 00010000:00010000:2.0:1788528457.584840:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788528457.584843:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788528457.584921:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+34:11340:x1875407719683712:12345-192.168.203.38@tcp:36:rm.0 Request processed in 976us (1197us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788528457.584930:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 106 00010000:00010000:3.0:1788528457.585394:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528457.585402:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8177 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.585410:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a000 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528457.585413:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8177 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.585421:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8177 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.585433:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a8fc3770400) 00010000:00010000:3.0:1788528457.585435:0:8439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788528457.585438:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8177 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.585444:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8177 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.585455:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528457.585457:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528457.585458:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528457.646994:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528457.647101:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719683968 00000100:00100000:2.0:1788528457.647112:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719683968 00000100:00100000:2.0:1788528457.647228:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 107 00000100:00100000:2.0:1788528457.647238:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+34:11346:x1875407719683968:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:2.0:1788528457.647263:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528457.647283:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c817e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfdbe expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.647397:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8185 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.647415:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8185 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.647429:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8185 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.647461:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c818c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.647468:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c818c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.647476:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c818c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788528457.647854:0:13480:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1788528457.647997:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c8193 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.648018:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c8193 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.648027:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c8193 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.648061:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8185 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.648068:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8185 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.648076:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8185 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.648084:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3be00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528457.648088:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8185 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.648107:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8185 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.648121:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:2.0:1788528457.648124:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528457.648129:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8185 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.648136:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8185 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788528457.648149:0:13480:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003fcd8b1c reply state 000000005c885236 transno 4294967379 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c818c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.648162:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c818c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.648168:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a8fc3770b00) 00010000:00010000:2.0:1788528457.648171:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788528457.648174:0:13480:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788528457.648205:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c817e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdbe expref: 37 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.648219:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c8193 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdbe expref: 36 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.648227:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770e00) 00010000:00010000:2.0:1788528457.648228:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788528457.648231:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3a400, rc 0) 00000100:00100000:2.0:1788528457.648315:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+37:11346:x1875407719683968:12345-192.168.203.38@tcp:101:bash.0 Request processed in 1078us (1331us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788528457.648323:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 107 00000100:00100000:1.0:1788528457.653381:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528457.653594:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719684096 00000100:00100000:2.0:1788528457.653603:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719684096 00000100:00100000:2.0:1788528457.653722:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 42 00000100:00100000:2.0:1788528457.653733:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2403:x1875407719684096:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:2.0:1788528457.653749:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528457.653768:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092d51e51/0x892c60dda91c81a1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfdc5 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788528457.653794:0:8421:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528457.653816:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=326s v=(0 0) 00010000:00010000:2.0:1788528457.653820:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528457.653829:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092d51e51/0x892c60dda91c81a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdc5 expref: 8 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.653849:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000092d51e51/0x892c60dda91c81a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdc5 expref: 8 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.653864:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3bc00, rc 0) 00000100:00100000:2.0:1788528457.653918:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:2403:x1875407719684096:12345-192.168.203.38@tcp:101:bash.0 Request processed in 186us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528457.653926:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 42 00000100:00080000:3.0:1788528457.657846:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788528457.666766:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528457.666868:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719684224 00000100:00100000:2.0:1788528457.666878:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719684224 00000100:00100000:2.0:1788528457.666954:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:2.0:1788528457.666965:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:11346:x1875407719684224:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:2.0:1788528457.666985:0:8423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528457.667002:0:8423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ea6a60c/0x892c60dda91c81a8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfdcc expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.667042:0:8423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000092d51e51/0x892c60dda91c81a1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdc5 expref: 9 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.667052:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528457.667057:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528457.667062:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ea6a60c/0x892c60dda91c81a8 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdcc expref: 9 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.667097:0:8423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000092d51e51/0x892c60dda91c81a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdc5 expref: 9 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.667112:0:8423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000092d51e51/0x892c60dda91c81a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdc5 expref: 9 pid: 8421 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528457.667126:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8423:1875407735491200:192.168.203.38@tcp:104: 00000100:00100000:2.0:1788528457.667688:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ef8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788528457.677218:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8423:1875407735491200:192.168.203.38@tcp:104: 00010000:00010000:2.0:1788528457.677257:0:8423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000ea6a60c/0x892c60dda91c81a8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdcc expref: 9 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.677300:0:8423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3a800, rc 0) 00000100:00100000:1.0:1788528457.677304:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528457.677369:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+9:11346:x1875407719684224:12345-192.168.203.38@tcp:101:bash.0 Request processed in 10405us (10611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528457.677381:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:3.0:1788528457.677614:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719684352 00000100:00100000:3.0:1788528457.677622:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719684352 00010000:00010000:3.0:1788528457.677654:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000092d51e51/0x892c60dda91c81a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdc5 expref: 9 pid: 8421 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528457.677691:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 73 00000100:00100000:3.0:1788528457.677701:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+9:2403:x1875407719684352:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788528457.677722:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528457.677744:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000092d51e51/0x892c60dda91c81a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdc5 expref: 9 pid: 8421 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.677757:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000092d51e51/0x892c60dda91c81a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdc5 expref: 9 pid: 8421 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.677780:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092d51e51/0x892c60dda91c81a1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdc5 expref: 9 pid: 8421 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.677795:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528457.677799:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528457.677807:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000ea6a60c/0x892c60dda91c81a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdcc expref: 8 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.677818:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ea6a60c/0x892c60dda91c81a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdcc expref: 8 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.677851:0:6495:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000ea6a60c/0x892c60dda91c81a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdcc expref: 8 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528457.677865:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6495:1875407735491328:192.168.203.38@tcp:105: 00000100:00100000:3.0:1788528457.677917:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc267f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528457.693769:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528457.693860:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6495:1875407735491328:192.168.203.38@tcp:105: 00010000:00010000:3.0:1788528457.693884:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528457.693955:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:2403:x1875407719684352:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 16255us (16650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528457.693967:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 73 00000100:00100000:0.0:1788528457.694222:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719684608 00000100:00100000:0.0:1788528457.694229:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719684608 00000100:00100000:0.0:1788528457.694271:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:0.0:1788528457.694280:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+37:11346:x1875407719684608:12345-192.168.203.38@tcp:35:bash.0 00000100:00100000:0.0:1788528457.695168:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+38:11346:x1875407719684608:12345-192.168.203.38@tcp:35:bash.0 Request processed in 886us (1404us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1788528457.695178:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 25 00010000:00010000:2.0:1788528457.857659:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528457.897842:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528457.898101:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719684736 00000100:00100000:0.0:1788528457.898111:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719684736 00000100:00100000:0.0:1788528457.898184:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 108 00000100:00100000:0.0:1788528457.898193:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+38:11362:x1875407719684736:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1788528457.898225:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528457.898246:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c81af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfdd3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528457.898316:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c81b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528457.898332:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c81b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528457.898343:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c81b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788528457.898389:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788528457.898394:0:6508:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788528457.898413:0:6508:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c81b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528457.898439:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c81af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdd3 expref: 40 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528457.898471:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c81b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdd3 expref: 39 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528457.898479:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:0.0:1788528457.898482:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788528457.898500:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0030200, rc 0) 00000100:00100000:0.0:1788528457.898987:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+39:11362:x1875407719684736:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 432us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528457.899018:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 108 00000100:00100000:0.0:1788528457.914409:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528457.916769:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719684992 00000100:00100000:3.0:1788528457.916784:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719684992 00000100:00100000:3.0:1788528457.916917:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 109 00000100:00100000:3.0:1788528457.916927:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c96c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+39:11362:x1875407719684992:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1788528457.916960:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528457.916981:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c81bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfdda expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.917149:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c81c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.917164:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c81c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.917177:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c81c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528457.917187:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788528457.917302:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c81bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdda expref: 42 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.917321:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c81c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdda expref: 41 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.917330:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770e00) 00010000:00010000:3.0:1788528457.917333:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788528457.917344:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3428e00, rc 0) 00000100:00100000:3.0:1788528457.917415:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c96c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+41:11362:x1875407719684992:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 488us (3015us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1788528457.917422:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 109 00000100:00100000:1.0:1788528457.918863:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735491456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788528457.918924:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528457.919023:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735491456 00000100:00100000:1.0:1788528457.919029:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735491456 00000100:00100000:1.0:1788528457.919069:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788528457.919077:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735491456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788528457.919115:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:1.0:1788528457.919171:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735491456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528457.919178:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788528457.919234:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735491456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788528457.932921:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528457.932980:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528457.933034:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719685376 00000100:00100000:1.0:1788528457.933044:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719685376 00000100:00100000:1.0:1788528457.933101:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:1.0:1788528457.933112:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+41:2403:x1875407719685376:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788528457.933128:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528457.933153:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c81c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdda expref: 41 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528457.933172:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770e00) 00010000:00010000:1.0:1788528457.933177:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528457.933228:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+40:2403:x1875407719685376:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 117us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528457.933245:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:3.0:1788528457.933374:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719685248 00000100:00100000:3.0:1788528457.933379:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719685248 00000100:00100000:3.0:1788528457.933419:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 110 00000100:00100000:3.0:1788528457.933428:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+40:11362:x1875407719685248:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1788528457.933448:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528457.933464:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c81d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfde1 expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.933650:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c81d9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.933663:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c81d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.933673:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c81d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528457.933683:0:13480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788528457.933784:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c81d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfde1 expref: 43 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.933800:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c81d9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfde1 expref: 42 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528457.933807:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770e00) 00010000:00010000:3.0:1788528457.933816:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788528457.933819:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3429e00, rc 0) 00000100:00100000:3.0:1788528457.933849:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+42:11362:x1875407719685248:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 422us (939us total) trans 4294967382 rc 0/0 00000100:00100000:3.0:1788528457.933855:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 110 00000100:00100000:1.0:1788528457.964093:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528457.964271:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719685504 00000100:00100000:2.0:1788528457.964281:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719685504 00000100:00100000:2.0:1788528457.964342:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:2.0:1788528457.964353:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:2406:x1875407719685504:12345-192.168.203.38@tcp:1:lfs.0 00010000:00010000:2.0:1788528457.964400:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c07d1be/0x892c60dda91c81e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.964421:0:8421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000ea6a60c/0x892c60dda91c81a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdcc expref: 8 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.964429:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788528457.964433:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788528457.964437:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c07d1be/0x892c60dda91c81e7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.964483:0:8421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000ea6a60c/0x892c60dda91c81a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdcc expref: 8 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.964496:0:8421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000ea6a60c/0x892c60dda91c81a8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdcc expref: 8 pid: 8423 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528457.964533:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8421:1875407735491584:192.168.203.38@tcp:104: 00000100:00100000:2.0:1788528457.964843:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ef8900 going to sleep for 11 seconds 00000100:00100000:1.0:1788528457.971980:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528457.972265:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719685632 00000100:00100000:0.0:1788528457.972275:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719685632 00002000:00100000:0.0:1788528457.972327:0:8428:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8a8fc37ac700 x1875407719685632/t0(0) o4->80304108-f3b9-46ea-888c-b2a7ec20e3e2@192.168.203.38@tcp:663/0 lens 504/0 e 0 to 0 dl 1788528468 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788528457.972338:0:8428:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a8fc37ac700 with x1875407719685632 ext(0->8) 00010000:00010000:0.0:1788528457.972348:0:8428:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000ea6a60c/0x892c60dda91c81a8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdcc expref: 9 pid: 8423 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528457.972365:0:8428:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000ea6a60c/0x892c60dda91c81a8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdcc expref: 9 pid: 8423 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788528457.972373:0:8428:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a8fc37ac700 00000100:00100000:0.0:1788528457.972411:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:0.0:1788528457.972421:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+9:2403:x1875407719685632:12345-192.168.203.38@tcp:4:lfs.0 00000100:00100000:2.0:1788528457.974847:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8421:1875407735491584:192.168.203.38@tcp:104: 00010000:00010000:2.0:1788528457.974874:0:8421:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000c07d1be/0x892c60dda91c81e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528457.980124:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+11:2403:x1875407719685632:12345-192.168.203.38@tcp:4:lfs.0 Request processed in 7694us (8142us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788528457.980152:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1 00002000:00100000:1.0:1788528457.980165:0:8428:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8a8fc37ac700 x1875407719685632/t4294967303(0) o4->80304108-f3b9-46ea-888c-b2a7ec20e3e2@192.168.203.38@tcp:663/0 lens 504/448 e 0 to 0 dl 1788528468 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788528457.980175:0:8428:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a8fc37ac700 with x1875407719685632 ext(0->8) 00010000:00010000:1.0:1788528457.980187:0:8428:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000ea6a60c/0x892c60dda91c81a8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdcc expref: 11 pid: 8423 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528457.980207:0:8428:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000ea6a60c/0x892c60dda91c81a8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdcc expref: 11 pid: 8423 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788528457.980215:0:8428:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a8fc37ac700 00000100:00100000:1.0:1788528457.993752:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528457.993902:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719685760 00000100:00100000:0.0:1788528457.993912:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719685760 00010000:00010000:0.0:1788528457.993954:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000ea6a60c/0x892c60dda91c81a8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdcc expref: 11 pid: 8423 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528457.994021:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 74 00000100:00100000:0.0:1788528457.994031:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+11:2405:x1875407719685760:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788528457.994062:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788528457.994081:0:6494:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788528457.994083:0:6494:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788528457 00002000:00010000:0.0:1788528457.994094:0:6494:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788528458 00002000:00010000:0.0:1788528457.994096:0:6494:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788528457 00002000:00010000:0.0:1788528457.994098:0:6494:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788528457.994106:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000ea6a60c/0x892c60dda91c81a8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdcc expref: 11 pid: 8423 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528457.994120:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000ea6a60c/0x892c60dda91c81a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdcc expref: 11 pid: 8423 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528457.994393:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ea6a60c/0x892c60dda91c81a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdcc expref: 11 pid: 8423 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528457.994412:0:6494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788528457.994416:0:6494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788528457.994422:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c07d1be/0x892c60dda91c81e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528457.994432:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c07d1be/0x892c60dda91c81e7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528457.994475:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528457.994532:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+10:2405:x1875407719685760:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 502us (789us total) trans 0 rc 0/0 00010000:00010000:2.0:1788528457.994636:0:8421:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000c07d1be/0x892c60dda91c81e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.994647:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c07d1be/0x892c60dda91c81e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.994668:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c07d1be/0x892c60dda91c81e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.994676:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c07d1be/0x892c60dda91c81e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.994682:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c07d1be/0x892c60dda91c81e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.994689:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3be00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528457.994693:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c07d1be/0x892c60dda91c81e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.994716:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c07d1be/0x892c60dda91c81e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.994729:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c07d1be/0x892c60dda91c81e7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528457.994737:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c07d1be/0x892c60dda91c81e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528457.994786:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+10:2406:x1875407719685504:12345-192.168.203.38@tcp:1:lfs.0 Request processed in 30435us (31350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528457.994795:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:0.0:1788528457.994880:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 74 00000100:00100000:0.0:1788528457.999431:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528458.000294:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719686016 00000100:00100000:3.0:1788528458.000307:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719686016 00000100:00100000:3.0:1788528458.000373:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:3.0:1788528458.000384:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e15c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+42:11362:x1875407719686016:12345-192.168.203.38@tcp:35:lfs.0 00000004:00010000:3.0:1788528458.000461:0:6512:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c81d9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfde1 expref: 42 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788528458.000700:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1788528458.000737:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:3.0:1788528458.001082:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00010000:00010000:3.0:1788528458.001132:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c81ee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.001148:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c8193 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdbe expref: 46 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.001157:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c81ee lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.001191:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c8193 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdbe expref: 46 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.001206:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c8193 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdbe expref: 46 pid: 13480 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528458.001235:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6512:1875407735491712:192.168.203.38@tcp:104: 00000100:00100000:3.0:1788528458.001314:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6fa2480 going to sleep for 11 seconds 00000100:00100000:1.0:1788528458.012809:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528458.012909:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719686144 00000100:00100000:0.0:1788528458.012919:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719686144 00010000:00010000:0.0:1788528458.012958:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c8193 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdbe expref: 47 pid: 13480 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528458.013017:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 75 00000100:00100000:0.0:1788528458.013028:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+47:2403:x1875407719686144:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788528458.013042:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528458.013050:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c8193 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdbe expref: 47 pid: 13480 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.013065:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c8193 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdbe expref: 47 pid: 13480 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.013097:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770e00) 00010000:00010000:0.0:1788528458.013102:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c81ee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.013111:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c81ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.013119:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c81ee lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.013138:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528458.013195:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+47:2403:x1875407719686144:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 169us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528458.013203:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 75 00010000:00010000:3.0:1788528458.013781:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c8193 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdbe expref: 46 pid: 13480 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528458.013799:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6512:1875407735491712:192.168.203.38@tcp:104: 00010000:00010000:3.0:1788528458.013820:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c81ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.013828:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c81ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.013833:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c81ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788528458.013936:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000001:00080000:3.0:1788528458.014081:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1788528458.014177:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6512:1875407735491840:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788528458.014227:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528458.014267:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d82cec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788528458.014590:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735491840 00000100:00100000:2.0:1788528458.014597:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735491840 00000100:00100000:2.0:1788528458.014651:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788528458.014660:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6512:x1875407735491840:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788528458.014741:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6512:x1875407735491840:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 83us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528458.014748:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788528458.015377:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6512:1875407735491840:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788528458.015495:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00000100:00100000:0.0:1788528458.015551:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c96ca680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6512:1875407735491968:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788528458.015622:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528458.015642:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c81fee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788528458.015653:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735491968 00000100:00100000:1.0:1788528458.015658:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735491968 00000100:00100000:1.0:1788528458.015701:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788528458.015709:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c96cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6512:x1875407735491968:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1788528458.015718:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788528458.015818:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c96cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6512:x1875407735491968:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 110us (194us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788528458.015825:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788528458.015863:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c96ca680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6512:1875407735491968:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788528458.015899:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1788528458.015929:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c81ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.015939:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c81ee lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.015952:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c81ee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.015958:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3429200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528458.015962:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c81ee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.015969:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c81ee lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.015982:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770e00) 00010000:00010000:3.0:1788528458.015985:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788528458.015990:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c81ee lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.015996:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c81ee lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788528458.016467:0:6512:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788528458.016531:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1788528458.016543:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 327233988588ns, next at 328233986204ns, rc = 0 00000001:00080000:3.0:1788528458.016550:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967390 00010000:00010000:3.0:1788528458.016690:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770e00) 00010000:00010000:3.0:1788528458.016694:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788528458.016701:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c81d9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfde1 expref: 50 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528458.016978:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e15c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+49:11362:x1875407719686016:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 16595us (17556us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1788528458.017000:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 26 00000020:00080000:3.0:1788528458.017012:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788528458.032157:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528458.032216:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719686272 00000100:00100000:2.0:1788528458.032227:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719686272 00000100:00100000:2.0:1788528458.032356:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 111 00000100:00100000:2.0:1788528458.032367:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+49:11362:x1875407719686272:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1788528458.032391:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528458.032428:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c81f5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfde8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.032714:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c81f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfde8 expref: 50 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.032730:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c81f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfde8 expref: 50 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.032752:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:2.0:1788528458.032755:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788528458.032758:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3b600, rc 0) 00000100:00100000:2.0:1788528458.032823:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+50:11362:x1875407719686272:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 459us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528458.032829:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 111 00000100:00100000:1.0:1788528458.042917:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528458.043096:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719686528 00000100:00100000:0.0:1788528458.043107:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719686528 00000100:00100000:0.0:1788528458.043172:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:3.0:1788528458.043178:0:6512:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:0.0:1788528458.043183:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+50:11362:x1875407719686528:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:3.0:1788528458.043188:0:6512:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:0.0:1788528458.043612:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+51:11362:x1875407719686528:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 428us (702us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788528458.043621:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:0.0:1788528458.207376:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528458.207765:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719686656 00000100:00100000:3.0:1788528458.207775:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719686656 00000100:00100000:3.0:1788528458.207847:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 112 00000100:00100000:3.0:1788528458.207858:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c96c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+51:11372:x1875407719686656:12345-192.168.203.38@tcp:34:lfs.0 00010000:00010000:3.0:1788528458.207935:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c81fc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.207952:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c81fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.207964:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c81fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.207976:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c8203 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.207983:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c8203 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.208003:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c8203 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.208349:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c820a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.208359:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c820a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.208381:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c820a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788528458.208429:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c820a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.208442:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c81fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.208449:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c81fc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.208456:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c81fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.208461:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3429e00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528458.208465:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c81fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.208472:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c81fc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.208484:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:3.0:1788528458.208487:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528458.208492:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c81fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.208497:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c81fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.208511:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c8203 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.208523:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c8203 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.208529:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c8203 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.208534:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3429200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528458.208537:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c8203 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.208543:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c8203 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.208551:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a8fc3770b00) 00010000:00010000:3.0:1788528458.209166:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528458.209172:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c8203 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.209180:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c8203 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.209193:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c820a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.209199:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c820a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.209205:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c820a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.209210:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428c00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528458.209220:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c820a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.209227:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c820a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.209237:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:3.0:1788528458.209240:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528458.209242:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c820a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.209248:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c820a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528458.209372:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c96c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+51:11372:x1875407719686656:12345-192.168.203.38@tcp:34:lfs.0 Request processed in 1514us (2004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528458.209382:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 112 00000100:00100000:0.0:1788528458.297349:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528458.297471:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719686912 00000100:00100000:1.0:1788528458.297481:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719686912 00000100:00100000:1.0:1788528458.297542:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 113 00000100:00100000:1.0:1788528458.297584:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c96cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+51:11375:x1875407719686912:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1788528458.297605:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528458.297627:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8211 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfdef expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.297702:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8218 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.297716:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8218 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.297727:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8218 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.297739:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c821f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.297747:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c821f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.297754:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c821f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.297858:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c8226 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.297867:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c8226 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.297888:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c8226 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528458.297898:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788528458.297973:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8218 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.297981:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8218 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.297988:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8218 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.297994:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528458.297998:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8218 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.298022:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8218 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.298034:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:1.0:1788528458.298037:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528458.298041:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8218 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.298046:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8218 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.298059:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c821f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.298064:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c821f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.298088:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c821f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.298094:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528458.298097:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c821f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.298104:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c821f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.298112:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a8fc3770b00) 00010000:00010000:1.0:1788528458.298115:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528458.298118:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c821f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.298124:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c821f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.298177:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8211 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdef expref: 54 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.298190:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c8226 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdef expref: 53 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.298198:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:1.0:1788528458.298200:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788528458.298203:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e16800, rc 0) 00000100:00100000:1.0:1788528458.298269:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c96cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+53:11375:x1875407719686912:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 718us (929us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1788528458.298285:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 113 00000100:00100000:1.0:1788528458.302642:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528458.302941:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719687040 00000100:00100000:0.0:1788528458.302952:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719687040 00000100:00100000:0.0:1788528458.303021:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 114 00000100:00100000:0.0:1788528458.303032:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+53:11375:x1875407719687040:12345-192.168.203.38@tcp:54:lfs.0 00010000:00010000:0.0:1788528458.303109:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8234 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.303130:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8234 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.303143:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8234 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.303186:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8234 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.303206:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8234 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.303212:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8234 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.303218:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031e00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528458.303222:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8234 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.303229:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8234 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.303241:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:0.0:1788528458.303244:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788528458.303249:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8234 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.303255:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8234 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528458.303330:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+53:11375:x1875407719687040:12345-192.168.203.38@tcp:54:lfs.0 Request processed in 299us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528458.303338:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 114 00000100:00100000:2.0:1788528458.312462:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528458.312548:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719687296 00000100:00100000:0.0:1788528458.312587:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719687296 00000100:00100000:0.0:1788528458.312645:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:0.0:1788528458.312655:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+53:11375:x1875407719687296:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:0.0:1788528458.312890:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+54:11375:x1875407719687296:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 235us (450us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1788528458.312910:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:1.0:1788528458.433502:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528458.433782:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719687552 00000100:00100000:3.0:1788528458.433793:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719687552 00000100:00100000:3.0:1788528458.433854:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 115 00000100:00100000:3.0:1788528458.433864:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+54:11385:x1875407719687552:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:3.0:1788528458.433888:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528458.433891:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788528458.433917:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c81b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdd3 expref: 54 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.433937:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:3.0:1788528458.433953:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788528458.433969:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c823b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfdf6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.434094:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c8242 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.434109:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c8242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.434119:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c8242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528458.434142:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788528458.434247:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c823b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdf6 expref: 56 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.434262:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c8242 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdf6 expref: 55 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.434271:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:3.0:1788528458.434274:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788528458.434277:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3429200, rc 0) 00000100:00100000:3.0:1788528458.434340:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+55:11385:x1875407719687552:12345-192.168.203.38@tcp:101:bash.0 Request processed in 477us (846us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1788528458.434348:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 115 00000100:00100000:1.0:1788528458.439892:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528458.439936:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528458.440020:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719687808 00000100:00100000:3.0:1788528458.440030:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719687808 00000100:00100000:3.0:1788528458.440092:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:3.0:1788528458.440102:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+55:2405:x1875407719687808:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788528458.440117:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528458.440168:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c8242 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdf6 expref: 55 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.440185:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:3.0:1788528458.440190:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528458.440244:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+54:2405:x1875407719687808:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 144us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528458.440252:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:0.0:1788528458.440881:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719687680 00000100:00100000:0.0:1788528458.440889:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719687680 00000100:00100000:0.0:1788528458.440941:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 116 00000100:00100000:0.0:1788528458.440950:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+54:11385:x1875407719687680:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:0.0:1788528458.440968:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528458.440986:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8250 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfdfd expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.441028:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8257 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.441043:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8257 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.441053:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8257 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.441173:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8250 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdfd expref: 56 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.441190:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8257 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdfd expref: 55 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.441198:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:0.0:1788528458.441201:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788528458.441204:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031600, rc 0) 00000100:00100000:0.0:1788528458.441253:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+55:11385:x1875407719687680:12345-192.168.203.38@tcp:101:bash.0 Request processed in 304us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528458.441268:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 116 00000100:00100000:1.0:1788528458.444320:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528458.444392:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719688064 00000100:00100000:3.0:1788528458.444402:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719688064 00000100:00100000:3.0:1788528458.444463:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 117 00000100:00100000:3.0:1788528458.444473:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+55:11385:x1875407719688064:12345-192.168.203.38@tcp:36:bash.0 00010000:00010000:3.0:1788528458.444527:0:13480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528458.444585:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c8226 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdef expref: 55 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.444604:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:3.0:1788528458.444609:0:13480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788528458.444932:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c825e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.444948:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c825e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.444958:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c825e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788528458.444998:0:13480:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967396 00000004:00010000:3.0:1788528458.445032:0:13480:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2cdcfa4 reply state 000000004909c634 transno 4294967397 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c825e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.445058:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c825e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.445064:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:3.0:1788528458.445067:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788528458.445070:0:13480:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788528458.446700:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+57:11385:x1875407719688064:12345-192.168.203.38@tcp:36:bash.0 Request processed in 2217us (2379us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1788528458.446713:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 117 00000020:00080000:3.0:1788528458.446720:0:13480:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788528458.452287:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528458.452382:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719688192 00000100:00100000:1.0:1788528458.452392:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719688192 00000100:00100000:1.0:1788528458.452446:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 118 00000100:00100000:1.0:1788528458.452457:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+57:11385:x1875407719688192:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:1.0:1788528458.452480:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528458.452500:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c8265 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfe04 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.452652:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c826c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.452669:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c826c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.452679:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c826c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528458.452705:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788528458.452709:0:6508:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788528458.452726:0:6508:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c826c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.452750:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c8265 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe04 expref: 59 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.452774:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c826c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe04 expref: 58 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.452783:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:1.0:1788528458.452786:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788528458.452789:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e16600, rc 0) 00000100:00100000:1.0:1788528458.452835:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+58:11385:x1875407719688192:12345-192.168.203.38@tcp:101:bash.0 Request processed in 380us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528458.452842:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 118 00000100:00100000:1.0:1788528458.460884:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528458.461028:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719688448 00000100:00100000:3.0:1788528458.461037:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719688448 00000100:00100000:3.0:1788528458.461098:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 29 00000100:00100000:3.0:1788528458.461109:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+58:11385:x1875407719688448:12345-192.168.203.38@tcp:35:bash.0 00000100:00100000:3.0:1788528458.461325:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+59:11385:x1875407719688448:12345-192.168.203.38@tcp:35:bash.0 Request processed in 217us (459us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1788528458.461332:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 29 00000100:00100000:0.0:1788528458.568178:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528458.568322:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719688576 00000100:00100000:2.0:1788528458.568333:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719688576 00000100:00100000:2.0:1788528458.568393:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 119 00000100:00100000:2.0:1788528458.568403:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c96caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+59:11391:x1875407719688576:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1788528458.568426:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528458.568448:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c8273 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfe0b expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.568524:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3bc00/0x892c60dda91c827a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.568539:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3bc00/0x892c60dda91c827a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.568813:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3bc00/0x892c60dda91c827a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528458.568857:0:8449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788528458.568861:0:8449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788528458.568956:0:8449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3bc00/0x892c60dda91c827a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.568984:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c8273 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe0b expref: 61 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.569015:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3bc00/0x892c60dda91c827a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe0b expref: 60 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.569024:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:2.0:1788528458.569027:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788528458.569031:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3bc00, rc 0) 00000100:00100000:2.0:1788528458.569139:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c96caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+60:11391:x1875407719688576:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 736us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528458.569147:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 119 00000100:00100000:2.0:1788528458.580189:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528458.580547:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719688704 00000100:00100000:3.0:1788528458.580575:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719688704 00000100:00100000:3.0:1788528458.580855:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 120 00000100:00100000:3.0:1788528458.580867:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+60:11391:x1875407719688704:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1788528458.580890:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528458.580911:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c8281 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfe12 expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.580973:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c8288 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.581016:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c8288 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.581030:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c8288 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.581043:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c828f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.581051:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c828f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.581058:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c828f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.581213:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8296 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.581223:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8296 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.581231:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8296 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528458.581273:0:13480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788528458.581278:0:13480:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788528458.581298:0:13480:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8296 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.581311:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8296 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.581330:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c8288 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.581336:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c8288 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.581342:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c8288 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.581349:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3429e00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528458.581353:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c8288 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.581360:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c8288 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.581373:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:3.0:1788528458.581376:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528458.581381:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c8288 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.581386:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c8288 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.581398:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c828f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.581404:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c828f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.581409:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c828f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.581419:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528458.581423:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c828f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.581429:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c828f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.581437:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a8fc3770b00) 00010000:00010000:3.0:1788528458.581440:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528458.581443:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c828f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.581449:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c828f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.581649:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c8281 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe12 expref: 62 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.581665:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8296 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe12 expref: 61 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.581673:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:3.0:1788528458.581675:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788528458.581678:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3428e00, rc 0) 00000100:00100000:3.0:1788528458.581735:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+61:11391:x1875407719688704:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 870us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528458.581743:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 120 00000100:00100000:1.0:1788528458.586096:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528458.586343:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719688832 00000100:00100000:0.0:1788528458.586352:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719688832 00000100:00100000:0.0:1788528458.586449:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:0.0:1788528458.586577:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+61:2403:x1875407719688832:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788528458.586594:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528458.586676:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8296 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe12 expref: 61 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.586694:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:0.0:1788528458.586699:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528458.586757:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+60:2403:x1875407719688832:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 298us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528458.586766:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:0.0:1788528458.587538:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528458.593483:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719689088 00000100:00100000:2.0:1788528458.593501:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719689088 00000100:00100000:2.0:1788528458.593589:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 121 00000100:00100000:2.0:1788528458.593599:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+60:11391:x1875407719689088:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1788528458.595981:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528458.596033:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c829d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfe19 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.596188:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c82a4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.596208:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c826c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe04 expref: 61 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.596217:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c82a4 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.596257:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c826c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe04 expref: 61 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.596274:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c826c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe04 expref: 61 pid: 6508 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528458.596288:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6509:1875407735492096:192.168.203.38@tcp:104: 00000100:00100000:2.0:1788528458.596382:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ef8900 going to sleep for 11 seconds 00000100:00100000:0.0:1788528458.600363:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6509:1875407735492096:192.168.203.38@tcp:104: 00010000:00010000:0.0:1788528458.600396:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c82a4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528458.600908:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528458.601604:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719689216 00000100:00100000:1.0:1788528458.601623:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719689216 00010000:00010000:1.0:1788528458.601672:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c826c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe04 expref: 62 pid: 6508 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528458.601827:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 76 00000100:00100000:1.0:1788528458.601837:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90efa85450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+62:2404:x1875407719689216:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788528458.601854:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528458.601861:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c826c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe04 expref: 62 pid: 6508 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.601885:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c826c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe04 expref: 62 pid: 6508 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.601911:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c826c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe04 expref: 62 pid: 6508 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.601946:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:1.0:1788528458.601951:0:8441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c82a4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.601959:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c82a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.601967:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c82a4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.601997:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528458.602064:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90efa85450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+61:2404:x1875407719689216:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 228us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528458.602072:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 76 00010000:00010000:2.0:1788528458.602169:0:6509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c82a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.602180:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c82a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528458.602199:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788528458.602345:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c829d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe19 expref: 62 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.602377:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c82a4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe19 expref: 61 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.602383:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:2.0:1788528458.602386:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788528458.602389:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3be00, rc 0) 00000100:00100000:2.0:1788528458.602413:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+61:11391:x1875407719689088:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 8817us (14878us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788528458.602420:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 121 00000100:00100000:3.0:1788528458.617317:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528458.617469:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719689472 00000100:00100000:2.0:1788528458.617479:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719689472 00000100:00100000:2.0:1788528458.617543:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:2.0:1788528458.617581:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+61:11391:x1875407719689472:12345-192.168.203.38@tcp:103:lfs.0 00010000:00010000:2.0:1788528458.617597:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528458.617633:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c81f5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfde8 expref: 61 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.617654:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:2.0:1788528458.617660:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528458.617712:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+60:11391:x1875407719689472:12345-192.168.203.38@tcp:103:lfs.0 Request processed in 161us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528458.617720:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:2.0:1788528458.622675:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528458.622795:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719689600 00000100:00100000:0.0:1788528458.622805:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719689600 00000100:00100000:0.0:1788528458.622859:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 122 00000100:00100000:0.0:1788528458.622879:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+60:11391:x1875407719689600:12345-192.168.203.38@tcp:58:lfs.0 00010000:00010000:0.0:1788528458.622987:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c82b2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.623027:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c82b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.623039:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c82b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788528458.623150:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1788528458.623223:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+60:11391:x1875407719689600:12345-192.168.203.38@tcp:58:lfs.0 Request processed in 354us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528458.623232:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 122 00000040:00080000:3.0:1788528458.623672:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788528458.623677:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788528458.623699:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1788528458.623705:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788528458.623807:0:13786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa6b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1875407735492224:192.168.203.38@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788528458.623857:0:13786:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc26950c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528458.628666:0:13786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa6b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1875407735492224:192.168.203.38@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788528458.634652:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528458.634882:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719689728 00000100:00100000:3.0:1788528458.634891:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719689728 00000100:00100000:3.0:1788528458.634957:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 123 00000100:00100000:3.0:1788528458.634966:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc36f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+60:11391:x1875407719689728:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1788528458.634987:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528458.635017:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c82b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfe20 expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.635070:0:13480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c82b2 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.635080:0:13480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c82b9 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe20 expref: 61 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.635098:0:13480:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c82b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.635109:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c82b9 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe20 expref: 61 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.635132:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:3.0:1788528458.635141:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788528458.635146:0:13480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c82b9 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe20 expref: 61 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.635154:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3429200, rc 0) 00000100:00100000:3.0:1788528458.635217:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc36f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+61:11391:x1875407719689728:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 252us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528458.635225:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 123 00000100:00100000:0.0:1788528458.645108:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528458.645294:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719689856 00000100:00100000:2.0:1788528458.645313:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719689856 00000100:00100000:2.0:1788528458.645372:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 124 00000100:00100000:2.0:1788528458.645381:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+61:11392:x1875407719689856:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788528458.645412:0:6509:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788528458.645532:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+61:11392:x1875407719689856:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 Request processed in 152us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528458.645540:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 124 00000100:00100000:1.0:1788528458.662798:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528458.663650:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719689984 00000100:00100000:2.0:1788528458.663661:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719689984 00000100:00100000:2.0:1788528458.663725:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 125 00000100:00100000:2.0:1788528458.663736:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+61:11392:x1875407719689984:12345-192.168.203.38@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788528458.663820:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c82c0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.663838:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c82c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.663848:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c82c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.663873:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c82c7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.663880:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c82c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.663887:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c82c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.663916:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c82ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.663943:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c82ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.663950:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c82ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528458.663998:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788528458.664013:0:6508:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788528458.664028:0:6508:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c82ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.664038:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c82c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.664045:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c82c0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.664052:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c82c0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.664058:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3b600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528458.664062:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c82c0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.664070:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c82c0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.664082:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a8fc2721c00) 00010000:00010000:2.0:1788528458.664085:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528458.664090:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c82c0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.664106:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c82c0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.664121:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c82c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.665065:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c82c7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.665072:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c82c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.665078:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528458.665081:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c82c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.665089:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c82c7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.665102:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8a8fc3770f00) 00010000:00010000:2.0:1788528458.665105:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528458.665109:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c82c7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.665116:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c82c7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.665282:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c82ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.665290:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c82ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.665308:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c82ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.665313:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3ba00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528458.665316:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c82ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.665322:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c82ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.665331:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:2.0:1788528458.665334:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528458.665337:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c82ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.665343:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c82ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528458.665439:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+61:11392:x1875407719689984:12345-192.168.203.38@tcp:34:lhsmtool_posix.0 Request processed in 1701us (2645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528458.665450:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 125 00000100:00100000:3.0:1788528458.676300:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528458.676431:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719690240 00000100:00100000:0.0:1788528458.676442:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719690240 00000100:00100000:0.0:1788528458.676500:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 126 00000100:00100000:0.0:1788528458.676511:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+61:11392:x1875407719690240:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788528458.676532:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528458.676586:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c82d5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfe27 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.676692:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c82dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.676708:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c82dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.676721:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c82dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788528458.676732:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788528458.676828:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c82dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.676837:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c82dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.676844:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c82dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.676850:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528458.676854:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c82dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.676862:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c82dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.676873:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:0.0:1788528458.676876:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788528458.676882:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c82dc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.676888:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c82dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.676940:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c82d5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe27 expref: 63 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.676950:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a8fc2721c00) 00010000:00010000:0.0:1788528458.676952:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788528458.676956:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c82d5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe27 expref: 63 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.676976:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0030a00, rc 0) 00000100:00100000:0.0:1788528458.677038:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+62:11392:x1875407719690240:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 528us (746us total) trans 4294967400 rc 301/301 00000100:00100000:0.0:1788528458.677045:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 126 00000100:00100000:0.0:1788528458.680603:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528458.680685:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719690368 00000100:00100000:1.0:1788528458.680695:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719690368 00000100:00100000:1.0:1788528458.680755:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 127 00000100:00100000:1.0:1788528458.680765:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+62:11392:x1875407719690368:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788528458.680797:0:8449:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788528458.680926:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+62:11392:x1875407719690368:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 Request processed in 161us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528458.680934:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 127 00000100:00100000:1.0:1788528458.685969:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528458.686405:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719690624 00000100:00100000:3.0:1788528458.686415:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719690624 00000100:00100000:3.0:1788528458.686476:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 128 00000100:00100000:3.0:1788528458.686486:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+62:11392:x1875407719690624:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788528458.686506:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528458.686510:0:13480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788528458.686535:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3bc00/0x892c60dda91c827a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe0b expref: 62 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.686594:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:3.0:1788528458.686600:0:13480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788528458.686616:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c82ea lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfe2e expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788528458.687321:0:13480:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1788528458.687459:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c82f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.687474:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c82f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.687497:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c82f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.687548:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c82ea lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe2e expref: 64 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.687590:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c82f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe2e expref: 63 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.687599:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a8fc1fa8200) 00010000:00010000:3.0:1788528458.687602:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788528458.687605:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3429e00, rc 0) 00000100:00100000:3.0:1788528458.687677:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+63:11392:x1875407719690624:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 1191us (1717us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1788528458.687685:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 128 00000100:00100000:0.0:1788528458.693125:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528458.693494:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719690880 00000100:00100000:2.0:1788528458.693504:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719690880 00000100:00100000:2.0:1788528458.693586:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 129 00000100:00100000:2.0:1788528458.693596:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+63:11392:x1875407719690880:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788528458.693655:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528458.693683:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c82f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe2e expref: 63 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.693720:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a8fc1fa8200) 00010000:00010000:2.0:1788528458.693732:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788528458.693754:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c82ff lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.693768:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c82ff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.693778:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c82ff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.693832:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8306 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xc71f409e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.693841:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8306 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc71f409e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.693848:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8306 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc71f409e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.693895:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c82ff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.693902:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c82ff lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.693923:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c82ff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.693930:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3ba00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528458.693934:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c82ff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.693949:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c82ff lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.693958:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:2.0:1788528458.693961:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528458.693965:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c82ff lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.693972:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c82ff lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.693982:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8306 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc71f409e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.693988:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8306 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc71f409e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.693995:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8306 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc71f409e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.694010:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528458.694014:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8306 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc71f409e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.694020:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8306 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc71f409e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.694026:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xc71f409e (ffff8a8fc3770f00) 00010000:00010000:2.0:1788528458.694029:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528458.694031:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8306 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xc71f409e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.694052:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8306 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xc71f409e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528458.694145:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+62:11392:x1875407719690880:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 550us (1029us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788528458.694152:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 129 00000100:00100000:0.0:1788528458.698218:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528458.698475:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719691008 00000100:00100000:3.0:1788528458.698486:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719691008 00000100:00100000:3.0:1788528458.698545:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 130 00000100:00100000:3.0:1788528458.698595:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+62:11392:x1875407719691008:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788528458.698615:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528458.698638:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c830d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfe35 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.698674:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8314 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.698687:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8314 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.698714:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8314 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.698825:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c830d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe35 expref: 64 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.698845:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8314 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe35 expref: 63 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.698854:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a8fc1fa8900) 00010000:00010000:3.0:1788528458.698857:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788528458.698861:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3428000, rc 0) 00000100:00100000:3.0:1788528458.699066:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+63:11392:x1875407719691008:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 510us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528458.699073:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 130 00000100:00100000:3.0:1788528458.703883:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528458.704088:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719691264 00000100:00100000:2.0:1788528458.704098:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719691264 00000100:00100000:2.0:1788528458.704167:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 131 00000100:00100000:2.0:1788528458.704187:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+63:11392:x1875407719691264:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788528458.704268:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c831b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.704287:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c831b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.704299:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c831b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788528458.704458:0:13480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1788528458.704468:0:13480:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 327921913771ns, next at 328921911276ns, rc = 0 00000004:00010000:2.0:1788528458.704518:0:13480:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000218955e5 reply state 000000008c972394 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c831b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.704531:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c831b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.704539:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a8fc1fa8900) 00010000:00010000:2.0:1788528458.704549:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788528458.704577:0:13480:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788528458.704683:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+65:11392:x1875407719691264:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 505us (819us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1788528458.704691:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 131 00000100:00100000:1.0:1788528458.714410:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528458.714746:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719691392 00000100:00100000:0.0:1788528458.714756:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719691392 00000100:00100000:0.0:1788528458.714817:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 132 00000100:00100000:0.0:1788528458.714826:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+65:11392:x1875407719691392:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788528458.714848:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528458.714882:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c8322 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfe3c expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.714951:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c8322 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe3c expref: 66 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.714967:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c8322 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe3c expref: 66 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.714987:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a8fc1fa8900) 00010000:00010000:0.0:1788528458.714990:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788528458.714995:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0030800, rc 0) 00000100:00100000:0.0:1788528458.715073:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+66:11392:x1875407719691392:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 248us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528458.715096:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 132 00000100:00100000:1.0:1788528458.718926:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528458.719081:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719691520 00000100:00100000:3.0:1788528458.719091:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719691520 00000100:00100000:3.0:1788528458.719181:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:3.0:1788528458.719192:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:2403:x1875407719691520:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788528458.719409:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+9:2403:x1875407719691520:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 Request processed in 218us (502us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788528458.719418:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00080000:2.0:1788528458.721773:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788528458.724514:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528458.726446:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719691776 00000100:00100000:2.0:1788528458.726461:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719691776 00000100:00100000:2.0:1788528458.726530:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:2.0:1788528458.726541:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+66:11392:x1875407719691776:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788528458.726782:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+67:11392:x1875407719691776:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 242us (2277us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1788528458.726789:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:0.0:1788528458.729594:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528458.729991:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719692032 00000100:00100000:3.0:1788528458.730010:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719692032 00000100:00100000:3.0:1788528458.730086:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 133 00000100:00100000:3.0:1788528458.730096:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+67:11392:x1875407719692032:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788528458.730315:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+67:11392:x1875407719692032:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 219us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528458.730324:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 133 00000100:00100000:1.0:1788528458.733741:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528458.733886:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719692160 00000100:00100000:3.0:1788528458.733896:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719692160 00000100:00100000:3.0:1788528458.733955:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 134 00000100:00100000:3.0:1788528458.733965:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+67:11392:x1875407719692160:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788528458.733987:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528458.734017:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c8329 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfe43 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.734101:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8330 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.734117:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8330 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.734140:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8330 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528458.734353:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788528458.734531:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8330 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.734580:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c8329 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe43 expref: 69 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.734614:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8330 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe43 expref: 68 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.734624:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a8fc1fa8900) 00010000:00010000:3.0:1788528458.734626:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788528458.734630:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3428200, rc 0) 00000100:00100000:3.0:1788528458.734691:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+68:11392:x1875407719692160:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 727us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528458.734699:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 134 00000100:00100000:1.0:1788528458.738196:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528458.738293:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719692288 00000100:00100000:0.0:1788528458.738304:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719692288 00000100:00100000:0.0:1788528458.738364:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 46 00000100:00100000:0.0:1788528458.738374:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+9:2404:x1875407719692288:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788528458.738392:0:8422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528458.738412:0:8422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3168ae5/0x892c60dda91c8337 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfe4a expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788528458.738439:0:8422:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ac74a, blocks: 0x0 00010000:00010000:0.0:1788528458.738457:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=327s v=(0 0) 00010000:00010000:0.0:1788528458.738462:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788528458.738470:0:8422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3168ae5/0x892c60dda91c8337 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe4a expref: 10 pid: 8422 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.738487:0:8422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b3168ae5/0x892c60dda91c8337 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe4a expref: 10 pid: 8422 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.738501:0:8422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0030a00, rc 0) 00000100:00100000:0.0:1788528458.738587:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+10:2404:x1875407719692288:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 214us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528458.738594:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 46 00000100:00100000:0.0:1788528458.743629:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528458.743715:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719692544 00000100:00100000:1.0:1788528458.743725:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719692544 00000100:00100000:1.0:1788528458.743786:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 135 00000100:00100000:1.0:1788528458.743797:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+68:11392:x1875407719692544:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788528458.743925:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+68:11392:x1875407719692544:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 129us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528458.743934:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 135 00000100:00100000:1.0:1788528458.750465:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528458.750767:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719692672 00000100:00100000:3.0:1788528458.750778:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719692672 00000100:00100000:3.0:1788528458.750833:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 47 00000100:00100000:3.0:1788528458.750843:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+10:11392:x1875407719692672:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788528458.750858:0:8725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528458.750885:0:8725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ddab49b/0x892c60dda91c833e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfe51 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.750923:0:8725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3168ae5/0x892c60dda91c8337 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe4a expref: 11 pid: 8422 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.750932:0:8725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528458.750937:0:8725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528458.750943:0:8725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ddab49b/0x892c60dda91c833e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe51 expref: 11 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.750997:0:8725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b3168ae5/0x892c60dda91c8337 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe4a expref: 11 pid: 8422 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.751021:0:8725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b3168ae5/0x892c60dda91c8337 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe4a expref: 11 pid: 8422 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528458.751034:0:8725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8725:1875407735492352:192.168.203.38@tcp:104: 00000100:00100000:3.0:1788528458.751176:0:8725:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695780 going to sleep for 11 seconds 00000100:00100000:1.0:1788528458.761800:0:8725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8725:1875407735492352:192.168.203.38@tcp:104: 00010000:00010000:1.0:1788528458.761838:0:8725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ddab49b/0x892c60dda91c833e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe51 expref: 11 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.761858:0:8725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3428600, rc 0) 00000100:00100000:1.0:1788528458.761938:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+11:11392:x1875407719692672:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 11094us (11480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528458.761947:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 47 00000100:00100000:0.0:1788528458.766760:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528458.766896:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719692800 00000100:00100000:1.0:1788528458.766906:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719692800 00010000:00010000:1.0:1788528458.766954:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b3168ae5/0x892c60dda91c8337 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe4a expref: 11 pid: 8422 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528458.766995:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:1.0:1788528458.767015:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+11:2403:x1875407719692800:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788528458.767029:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528458.767057:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b3168ae5/0x892c60dda91c8337 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe4a expref: 11 pid: 8422 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.767070:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b3168ae5/0x892c60dda91c8337 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe4a expref: 11 pid: 8422 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.767094:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3168ae5/0x892c60dda91c8337 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe4a expref: 11 pid: 8422 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.767111:0:6494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788528458.767116:0:6494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788528458.767135:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002ddab49b/0x892c60dda91c833e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe51 expref: 10 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.767146:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ddab49b/0x892c60dda91c833e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe51 expref: 10 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.767183:0:6494:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002ddab49b/0x892c60dda91c833e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe51 expref: 10 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528458.767197:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa67480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6494:1875407735492480:192.168.203.38@tcp:105: 00000100:00100000:1.0:1788528458.767267:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1fd6180 going to sleep for 11 seconds 00000100:00100000:1.0:1788528458.774287:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa67480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6494:1875407735492480:192.168.203.38@tcp:105: 00010000:00010000:1.0:1788528458.774316:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528458.774383:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+10:2403:x1875407719692800:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 7369us (7631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528458.774410:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:0.0:1788528458.774532:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528458.775423:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719692928 00000100:00100000:3.0:1788528458.775432:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719692928 00002000:00100000:3.0:1788528458.775476:0:8427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8a8fc44aca80 x1875407719692928/t0(0) o4->80304108-f3b9-46ea-888c-b2a7ec20e3e2@192.168.203.38@tcp:664/0 lens 504/0 e 0 to 0 dl 1788528469 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788528458.775487:0:8427:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a8fc44aca80 with x1875407719692928 ext(0->12) 00002000:00010000:3.0:1788528458.775491:0:8427:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a8fc44aca80 00000100:00100000:3.0:1788528458.775589:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:3.0:1788528458.775600:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+10:2403:x1875407719692928:12345-192.168.203.38@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788528458.777087:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+12:2403:x1875407719692928:12345-192.168.203.38@tcp:4:lhsmtool_posix.0 Request processed in 1483us (2549us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788528458.777099:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 2 00002000:00100000:3.0:1788528458.777111:0:8427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8a8fc44aca80 x1875407719692928/t4294967309(0) o4->80304108-f3b9-46ea-888c-b2a7ec20e3e2@192.168.203.38@tcp:664/0 lens 504/448 e 0 to 0 dl 1788528469 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788528458.777121:0:8427:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a8fc44aca80 with x1875407719692928 ext(0->12) 00002000:00010000:3.0:1788528458.777144:0:8427:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a8fc44aca80 00000100:00100000:0.0:1788528458.781805:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528458.781867:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719693056 00000100:00100000:2.0:1788528458.781875:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719693056 00000100:00100000:2.0:1788528458.781928:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 136 00000100:00100000:2.0:1788528458.781936:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+68:11392:x1875407719693056:12345-192.168.203.38@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788528458.790332:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967403 is committed 00000004:00080000:0.0:1788528458.790353:0:6487:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1788528458.790399:0:6487:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1788528458.790422:0:6487:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a90c81fe600 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788528458.790429:0:6487:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a90f6ed6b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a90c81fe6c0 00000020:00080000:0.0:1788528458.790433:0:6487:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a90f6ed6a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a90fa9a9800 00000004:00080000:0.0:1788528458.790462:0:6487:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788528458.790490:0:6487:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a90c82bd3c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788528458.790492:0:6487:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a90f58eae00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a90c82bda80 00000020:00080000:0.0:1788528458.790495:0:6487:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a90f58ea900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a90f6df3e00 00000020:00080000:0.0:1788528458.790505:0:6487:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:0.0:1788528458.790667:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+22:11392:x1875407719693056:12345-192.168.203.38@tcp:44:lhsmtool_posix.0 Request processed in 8728us (8868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528458.790677:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 136 00000100:00100000:1.0:1788528458.792148:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788528458.792167:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735492608:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788528458.792239:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528458.792287:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735492608 00000100:00100000:1.0:1788528458.792294:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735492608 00000100:00100000:1.0:1788528458.792340:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788528458.792348:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3639:x1875407735492608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788528458.792375:0:8422:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:1.0:1788528458.792406:0:8422:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9ac749, atime: 0x6a9ac74a, ctime: 0x6a9ac749, blocks: 0x8 00010000:00010000:1.0:1788528458.792414:0:8422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002184086d/0x892c60dda91c8345 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.792430:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=328s v=(0 0) 00010000:00010000:1.0:1788528458.792435:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788528458.792441:0:8422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002184086d/0x892c60dda91c8345 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.792457:0:8422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002184086d/0x892c60dda91c8345 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.792468:0:8422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002184086d/0x892c60dda91c8345 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.792476:0:8422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002184086d/0x892c60dda91c8345 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.792514:0:8422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788528458.792672:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3639:x1875407735492608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 324us (432us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788528458.792679:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:1.0:1788528458.792703:0:8438:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528458.792709:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002184086d/0x892c60dda91c8345 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.792717:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16600 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528458.792722:0:8438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002184086d/0x892c60dda91c8345 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.792732:0:8438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002184086d/0x892c60dda91c8345 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.792748:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002184086d/0x892c60dda91c8345 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.792757:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002184086d/0x892c60dda91c8345 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.792775:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528458.792777:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528458.792779:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788528458.792808:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a90ffa67480/2, rc 0, transno 4294967305 00000100:00100000:1.0:1788528458.792814:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735492608:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788528458.794044:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c8043 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794057:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c8043 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794063:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c8043 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794069:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16e00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528458.794073:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c8043 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794080:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c8043 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794097:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a90d5d08600) 00010000:00010000:3.0:1788528458.794101:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528458.794105:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c8043 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794112:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c8043 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794137:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c80eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794144:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c80eb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794150:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c80eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794171:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17c00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528458.794175:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c80eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794181:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c80eb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794190:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a8fc3770400) 00010000:00010000:3.0:1788528458.794192:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528458.794195:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c80eb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794201:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c80eb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794217:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8169 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794223:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8169 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794228:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8169 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794233:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528458.794235:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8169 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794242:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8169 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794261:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a8fc3770b00) 00010000:00010000:3.0:1788528458.794263:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528458.794266:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8169 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794272:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8169 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794284:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c818c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794296:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c818c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794302:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c818c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794306:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528458.794309:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c818c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794314:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c818c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794426:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a8fc3770b00) 00010000:00010000:3.0:1788528458.794429:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528458.794432:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c818c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794438:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c818c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794459:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c825e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794465:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c825e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794470:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c825e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794475:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428c00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528458.794478:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c825e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794484:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c825e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794498:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:3.0:1788528458.794500:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528458.794503:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c825e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794508:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c825e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794517:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c831b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794632:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c831b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794640:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c831b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794651:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528458.794654:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c831b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794660:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c831b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794678:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a8fc1fa8900) 00010000:00010000:3.0:1788528458.794680:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788528458.794683:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c831b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.794698:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c831b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788528458.794721:0:6540:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1788528458.794786:0:6540:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788528458.794996:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc374c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735492736:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788528458.795063:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528458.795107:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788528458.795113:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe6e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735492864:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788528458.795145:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528458.795169:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735492736 00000100:00100000:3.0:1788528458.795177:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735492864 00000100:00100000:3.0:1788528458.795184:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735492864 00000100:00100000:0.0:1788528458.795187:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735492736 00000100:00100000:0.0:1788528458.795232:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788528458.795242:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3637:x1875407735492736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788528458.795267:0:8725:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:0.0:1788528458.795289:0:8725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf8b8e97/0x892c60dda91c834c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.795307:0:8725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000003f3db7e/0x892c60dda91c80f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfda9 expref: 11 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.795329:0:8725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788528458.795333:0:8725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788528458.795338:0:8725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf8b8e97/0x892c60dda91c834c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.795367:0:8725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000003f3db7e/0x892c60dda91c80f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfda9 expref: 11 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.795382:0:8725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000003f3db7e/0x892c60dda91c80f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfda9 expref: 11 pid: 8725 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528458.795394:0:8725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8725:1875407735492992:192.168.203.38@tcp:104: 00000100:00100000:0.0:1788528458.795453:0:8725:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c81fe780 going to sleep for 11 seconds 00000100:00100000:3.0:1788528458.795465:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788528458.795477:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3637:x1875407735492864:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788528458.795605:0:8423:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788528458.795609:0:8423:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788528458 00002000:00010000:3.0:1788528458.795611:0:8423:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788528458.795612:0:8423:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788528458 -> 1788528458 00002000:00010000:3.0:1788528458.795614:0:8423:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788528458.795661:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3637:x1875407735492864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 186us (514us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788528458.795687:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:0.0:1788528458.795758:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a90fe6e5880/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788528458.795765:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe6e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735492864:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1788528458.795797:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788528458.805706:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528458.805753:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528458.805865:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719693312 00000100:00100000:2.0:1788528458.805875:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719693312 00000100:00100000:2.0:1788528458.805935:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:2.0:1788528458.805945:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+12:2405:x1875407719693312:12345-192.168.203.38@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788528458.806152:0:8725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8725:1875407735492992:192.168.203.38@tcp:104: 00010000:00010000:1.0:1788528458.806182:0:8725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bf8b8e97/0x892c60dda91c834c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528458.807970:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719693184 00000100:00100000:3.0:1788528458.807982:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719693184 00010000:00010000:3.0:1788528458.808027:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000003f3db7e/0x892c60dda91c80f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfda9 expref: 13 pid: 8725 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528458.808070:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 78 00000100:00100000:3.0:1788528458.808078:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+13:2404:x1875407719693184:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788528458.808092:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528458.808098:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000003f3db7e/0x892c60dda91c80f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfda9 expref: 13 pid: 8725 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.808111:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000003f3db7e/0x892c60dda91c80f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfda9 expref: 13 pid: 8725 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.808145:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003f3db7e/0x892c60dda91c80f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfda9 expref: 13 pid: 8725 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.808161:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788528458.808165:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788528458.808171:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf8b8e97/0x892c60dda91c834c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.808181:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf8b8e97/0x892c60dda91c834c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.808224:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528458.808285:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+12:2404:x1875407719693184:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 208us (2591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528458.808293:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 78 00010000:00010000:1.0:1788528458.808401:0:8725:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bf8b8e97/0x892c60dda91c834c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.808412:0:8725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf8b8e97/0x892c60dda91c834c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.808421:0:8725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf8b8e97/0x892c60dda91c834c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.808429:0:8725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf8b8e97/0x892c60dda91c834c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.808450:0:8725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788528458.808748:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528458.808755:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf8b8e97/0x892c60dda91c834c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.808762:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031e00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528458.808766:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf8b8e97/0x892c60dda91c834c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.808775:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf8b8e97/0x892c60dda91c834c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.808787:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf8b8e97/0x892c60dda91c834c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.808793:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf8b8e97/0x892c60dda91c834c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.808812:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528458.808814:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528458.808815:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528458.810997:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3637:x1875407735492736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15749us (15925us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788528458.811019:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:0.0:1788528458.811269:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a8fc374c700/2, rc 0, transno 4294967311 00000100:00100000:0.0:1788528458.811276:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc374c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735492736:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1788528458.813704:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1788528458.813719:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:3.0:1788528458.813888:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2405:x1875407719693312:12345-192.168.203.38@tcp:16:lhsmtool_posix.0 Request processed in 7941us (8129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528458.813994:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:0.0:1788528458.820881:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528458.821633:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719693568 00000100:00100000:3.0:1788528458.821643:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719693568 00000100:00100000:3.0:1788528458.821704:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 137 00000100:00100000:3.0:1788528458.821716:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+16:11392:x1875407719693568:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788528458.821766:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528458.821792:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8330 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe43 expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.821810:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a8fc1fa8900) 00010000:00010000:3.0:1788528458.821816:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788528458.821845:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8353 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.821860:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8353 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.821882:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8353 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788528458.822018:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b2dc9155 reply state 0000000079a619aa transno 4294967404 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8353 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.822032:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8353 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.822039:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a8fc1fa8900) 00010000:00010000:3.0:1788528458.822042:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788528458.822058:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788528458.822157:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+17:11392:x1875407719693568:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 443us (1295us total) trans 4294967404 rc 0/0 00000100:00100000:3.0:1788528458.822165:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 137 00000100:00100000:0.0:1788528458.828902:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528458.829265:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719693696 00000100:00100000:1.0:1788528458.829274:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719693696 00000100:00100000:1.0:1788528458.829332:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:1.0:1788528458.829343:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2405:x1875407719693696:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788528458.829480:0:8422:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788528458.829485:0:8422:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1788528458 -> 1788528458 00002000:00010000:1.0:1788528458.829487:0:8422:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788528458 00002000:00010000:1.0:1788528458.829490:0:8422:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788528458 -> 1788528458 00002000:00010000:1.0:1788528458.829492:0:8422:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788528458.829579:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2405:x1875407719693696:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 Request processed in 212us (661us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788528458.829587:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:0.0:1788528458.833595:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528458.833701:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719693952 00000100:00100000:3.0:1788528458.833711:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719693952 00000100:00100000:3.0:1788528458.833760:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 138 00000100:00100000:3.0:1788528458.833771:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+17:11392:x1875407719693952:12345-192.168.203.38@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788528458.833839:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c835a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.833855:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8314 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe35 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.833877:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c835a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.833914:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8314 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe35 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.833928:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8314 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe35 expref: 17 pid: 6508 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528458.833940:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6510:1875407735493120:192.168.203.38@tcp:104: 00000100:00100000:3.0:1788528458.834026:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d00eac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788528458.839857:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6510:1875407735493120:192.168.203.38@tcp:104: 00010000:00010000:3.0:1788528458.839902:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c835a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528458.846868:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528458.848594:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719694080 00000100:00100000:3.0:1788528458.848607:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719694080 00010000:00010000:2.0:1788528458.849367:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8314 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe35 expref: 18 pid: 6508 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528458.849441:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 79 00000100:00100000:2.0:1788528458.849453:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+18:2404:x1875407719694080:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528458.849478:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528458.849486:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8314 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe35 expref: 18 pid: 6508 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.849506:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8314 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe35 expref: 18 pid: 6508 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.849536:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8314 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe35 expref: 18 pid: 6508 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.849590:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a8fc1fa8900) 00010000:00010000:2.0:1788528458.849597:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c835a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.849606:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c835a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.849614:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c835a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.849652:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528458.849712:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+17:2404:x1875407719694080:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 261us (2854us total) trans 0 rc 0/0 00010000:00010000:1.0:1788528458.849712:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c835a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528458.849719:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 79 00010000:00010000:1.0:1788528458.849721:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c835a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.849761:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c835a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.849768:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c835a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.849774:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c835a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.849780:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3429400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528458.849784:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c835a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.849803:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c835a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.849813:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a8fc1fa8900) 00010000:00010000:1.0:1788528458.849816:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788528458.849820:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c835a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.849825:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c835a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528458.849866:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+16:11392:x1875407719693952:12345-192.168.203.38@tcp:55:lhsmtool_posix.0 Request processed in 16097us (16321us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788528458.849874:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 138 00000100:00100000:2.0:1788528458.859883:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528458.860269:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719694208 00000100:00100000:1.0:1788528458.860279:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719694208 00000100:00100000:1.0:1788528458.860337:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:1.0:1788528458.860347:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2405:x1875407719694208:12345-192.168.203.38@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788528458.860388:0:8725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ba08a800/0x892c60dda91c8361 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.860407:0:8725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ddab49b/0x892c60dda91c833e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe51 expref: 7 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.860415:0:8725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788528458.860419:0:8725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788528458.860423:0:8725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba08a800/0x892c60dda91c8361 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.860463:0:8725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ddab49b/0x892c60dda91c833e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe51 expref: 7 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.860477:0:8725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ddab49b/0x892c60dda91c833e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe51 expref: 7 pid: 8725 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528458.860492:0:8725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa65880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8725:1875407735493248:192.168.203.38@tcp:104: 00000100:00100000:1.0:1788528458.860598:0:8725:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1fd6600 going to sleep for 11 seconds 00000100:00100000:0.0:1788528458.869494:0:8725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa65880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8725:1875407735493248:192.168.203.38@tcp:104: 00010000:00010000:0.0:1788528458.869544:0:8725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ba08a800/0x892c60dda91c8361 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528458.870852:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528458.871338:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719694336 00000100:00100000:1.0:1788528458.871348:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719694336 00010000:00010000:1.0:1788528458.871391:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ddab49b/0x892c60dda91c833e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe51 expref: 8 pid: 8725 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528458.871434:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 80 00000100:00100000:1.0:1788528458.871444:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:2404:x1875407719694336:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788528458.871459:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528458.871481:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ddab49b/0x892c60dda91c833e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe51 expref: 8 pid: 8725 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.871495:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ddab49b/0x892c60dda91c833e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe51 expref: 8 pid: 8725 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.871517:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ddab49b/0x892c60dda91c833e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe51 expref: 8 pid: 8725 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.871599:0:6494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788528458.871605:0:6494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788528458.871612:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba08a800/0x892c60dda91c8361 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.871621:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba08a800/0x892c60dda91c8361 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.871645:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528458.871700:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2404:x1875407719694336:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 257us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528458.871707:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 80 00010000:00010000:0.0:1788528458.871772:0:8725:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ba08a800/0x892c60dda91c8361 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.871781:0:8725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba08a800/0x892c60dda91c8361 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.871801:0:8725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ba08a800/0x892c60dda91c8361 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.871809:0:8725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba08a800/0x892c60dda91c8361 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.871817:0:8725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba08a800/0x892c60dda91c8361 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.871824:0:8725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17a00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528458.871829:0:8725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba08a800/0x892c60dda91c8361 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.871838:0:8725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba08a800/0x892c60dda91c8361 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.871851:0:8725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba08a800/0x892c60dda91c8361 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.871865:0:8725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba08a800/0x892c60dda91c8361 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528458.871921:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2405:x1875407719694208:12345-192.168.203.38@tcp:1:lhsmtool_posix.0 Request processed in 11576us (12049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528458.871930:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:2.0:1788528458.877699:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00010000:00010000:1.0:1788528458.878880:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528458.878905:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719694592 00000100:00100000:0.0:1788528458.878915:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719694592 00000100:00100000:0.0:1788528458.878983:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 139 00000100:00100000:0.0:1788528458.879008:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+16:11392:x1875407719694592:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788528458.879089:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c8368 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.879105:0:13480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8257 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdfd expref: 16 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.879115:0:13480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c8368 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.879147:0:13480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8257 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdfd expref: 16 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.879166:0:13480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8257 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdfd expref: 16 pid: 8449 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528458.879180:0:13480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44af800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13480:1875407735493376:192.168.203.38@tcp:104: 00000100:00100000:0.0:1788528458.879271:0:13480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c81fe180 going to sleep for 11 seconds 00000100:00100000:1.0:1788528458.886774:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528458.887106:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719694720 00000100:00100000:2.0:1788528458.887117:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719694720 00010000:00010000:2.0:1788528458.887166:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8257 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdfd expref: 17 pid: 8449 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528458.887219:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 81 00000100:00100000:2.0:1788528458.887231:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+17:2404:x1875407719694720:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528458.887249:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528458.887256:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8257 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdfd expref: 17 pid: 8449 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.887270:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8257 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdfd expref: 17 pid: 8449 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.887295:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:2.0:1788528458.887302:0:10330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c82b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe20 expref: 17 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.887314:0:10330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c8368 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.887324:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c8368 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.887333:0:10330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c8368 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.887376:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528458.887439:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+17:2404:x1875407719694720:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 210us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528458.887447:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 81 00010000:00010000:0.0:1788528458.887529:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8257 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfdfd expref: 16 pid: 8449 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528458.887592:0:13480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44af800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13480:1875407735493376:192.168.203.38@tcp:104: 00010000:00010000:0.0:1788528458.887619:0:13480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c8368 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.887627:0:13480:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c8368 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.887633:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c8368 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.887813:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c836f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.887826:0:13480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c8322 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe3c expref: 16 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.887835:0:13480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c836f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.887860:0:13480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c8322 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe3c expref: 16 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.887873:0:13480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c8322 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe3c expref: 16 pid: 8449 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528458.887886:0:13480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44af800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13480:1875407735493504:192.168.203.38@tcp:104: 00000100:00100000:0.0:1788528458.887944:0:13480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c81fe0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528458.895141:0:13480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44af800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13480:1875407735493504:192.168.203.38@tcp:104: 00010000:00010000:0.0:1788528458.895173:0:13480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c836f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528458.895227:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528458.895316:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719694848 00000100:00100000:0.0:1788528458.895323:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719694848 00010000:00010000:0.0:1788528458.895358:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c8322 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe3c expref: 17 pid: 8449 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528458.895397:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 82 00000100:00100000:0.0:1788528458.895407:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90efa84c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+17:2403:x1875407719694848:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788528458.895421:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528458.895428:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c8322 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe3c expref: 17 pid: 8449 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.895442:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c8322 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe3c expref: 17 pid: 8449 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.895464:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c8322 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe3c expref: 17 pid: 8449 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.895478:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a8fc1fa8900) 00010000:00010000:0.0:1788528458.895483:0:6493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c836f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.895492:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c836f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.895515:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c836f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528458.895536:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528458.895613:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90efa84c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+16:2403:x1875407719694848:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 207us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528458.895620:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 82 00010000:00010000:2.0:1788528458.895721:0:13480:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c836f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.895729:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c836f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788528458.895839:0:13480:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1788528458.895950:0:13480:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000001:00080000:2.0:1788528458.895985:0:13480:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1788528458.896074:0:13480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13480:1875407735493632:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788528458.896119:0:13480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528458.896151:0:13480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ef8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528458.897207:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735493632 00000100:00100000:1.0:1788528458.897216:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735493632 00000100:00100000:1.0:1788528458.897272:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788528458.897281:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13480:x1875407735493632:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788528458.897448:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13480:x1875407735493632:12345-0@lo:1000:mdt00_004.0 Request processed in 168us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528458.897464:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788528458.897660:0:13480:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1788528458.897667:0:13480:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:2.0:1788528458.897688:0:13480:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a90fe6e5880, transno 4294967310 00000100:00100000:2.0:1788528458.897713:0:13480:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8a8fc374c700 x1875407735492736/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788528474 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528458.897725:0:13480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13480:1875407735493632:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1788528458.897859:0:13480:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00000100:00100000:2.0:1788528458.897917:0:13480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13480:1875407735493760:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788528458.897972:0:13480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528458.898007:0:13480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ef8540 going to sleep for 11 seconds 00000100:00100000:0.0:1788528458.898047:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735493760 00000100:00100000:0.0:1788528458.898052:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735493760 00000100:00100000:0.0:1788528458.898087:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788528458.898094:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:13480:x1875407735493760:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788528458.898216:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:13480:x1875407735493760:12345-0@lo:1000:mdt00_004.0 Request processed in 122us (243us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788528458.898223:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788528458.898331:0:13480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13480:1875407735493760:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1788528458.898371:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c836f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.898381:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c836f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.898388:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c836f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.898395:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031e00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528458.898400:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c836f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.898407:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c836f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.898422:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a8fc1fa8900) 00010000:00010000:2.0:1788528458.898425:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788528458.898430:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c836f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.898437:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c836f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.898459:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c82b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.898466:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c82b2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.898472:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c82b2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.898487:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528458.898490:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c82b2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.898497:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c82b2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.898506:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:2.0:1788528458.898508:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788528458.898515:0:13480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c82b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe20 expref: 19 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.898525:0:13480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c82b9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe20 expref: 19 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.898534:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c82b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe20 expref: 19 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.898633:0:13480:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c82b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe20 expref: 19 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528458.898645:0:13480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13480:1875407735493888:192.168.203.38@tcp:105: 00000100:00100000:2.0:1788528458.898741:0:13480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c7f83a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788528458.905922:0:13480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13480:1875407735493888:192.168.203.38@tcp:105: 00010000:00010000:2.0:1788528458.905955:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c82b2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.905986:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c82b2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.906132:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c8376 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.906149:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c8376 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.906162:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c8376 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.906174:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c8376 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.906181:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c8376 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.906188:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c8376 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.906197:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3ba00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528458.906201:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c8376 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.906209:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c8376 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.906220:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:2.0:1788528458.906223:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528458.906227:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c8376 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.906239:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c8376 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.906251:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c8368 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.906257:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c8368 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.906262:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c8368 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.906267:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031c00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528458.906270:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c8368 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.906275:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c8368 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.906283:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:2.0:1788528458.906286:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788528458.906288:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c8368 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528458.906294:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c8368 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528458.906470:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528458.906944:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719694976 00000100:00100000:0.0:1788528458.906954:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719694976 00000100:00100000:0.0:1788528458.907020:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 31 00000100:00100000:0.0:1788528458.907030:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+20:11391:x1875407719694976:12345-192.168.203.38@tcp:49:lfs.0 00000100:00100000:0.0:1788528458.907159:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+20:11391:x1875407719694976:12345-192.168.203.38@tcp:49:lfs.0 Request processed in 129us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528458.907166:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 31 00000100:00100000:2.0:1788528458.907339:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+19:11392:x1875407719694592:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 28344us (29650us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1788528458.907347:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 139 00000020:00080000:2.0:1788528458.907359:0:13480:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788528458.907501:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788528458.907506:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788528458.909514:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788528458.909545:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788528458.911336:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528458.911446:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719695232 00000100:00100000:3.0:1788528458.911457:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719695232 00000100:00100000:3.0:1788528458.911513:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 140 00000100:00100000:3.0:1788528458.911523:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+19:11391:x1875407719695232:12345-192.168.203.38@tcp:58:lfs.0 00000040:00080000:3.0:1788528458.911712:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788528458.911795:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+19:11391:x1875407719695232:12345-192.168.203.38@tcp:58:lfs.0 Request processed in 272us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528458.911803:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 140 00000100:00100000:1.0:1788528458.916543:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528458.917464:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719695488 00000100:00100000:3.0:1788528458.917477:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719695488 00000100:00100000:3.0:1788528458.917660:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 32 00000100:00100000:3.0:1788528458.917672:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e15850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+19:11392:x1875407719695488:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788528458.917897:0:14211:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788528458.918018:0:14211:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967410 00010000:00010000:3.0:1788528458.918050:0:14211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c837d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.918067:0:14211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c837d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.918077:0:14211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c837d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.918086:0:14211:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c837d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.918206:0:14211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c837d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.918213:0:14211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c837d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.918236:0:14211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788528458.918435:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e15850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+21:11392:x1875407719695488:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 765us (1900us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788528458.918443:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 32 00000020:00080000:3.0:1788528458.918449:0:14211:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788528458.918654:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528458.918668:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c837d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.918675:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428200 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528458.918680:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c837d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.918688:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c837d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.918701:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a8fc1fa8900) 00010000:00010000:1.0:1788528458.918704:0:8439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788528458.918709:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c837d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.918715:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c837d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.918728:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528458.918729:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528458.918731:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528458.973779:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528458.974722:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719695616 00000100:00100000:3.0:1788528458.974735:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719695616 00000100:00100000:3.0:1788528458.974806:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 141 00000100:00100000:3.0:1788528458.974816:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+21:11394:x1875407719695616:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1788528458.974841:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528458.974873:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8384 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfe58 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.974940:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c838b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.974956:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c838b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.974967:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c838b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.974982:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8392 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.975012:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8392 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.975020:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8392 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.975095:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c8399 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.975106:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c82a4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe19 expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.975114:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c8399 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.975156:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c82a4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe19 expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.975170:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c82a4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe19 expref: 22 pid: 6509 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528458.975182:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6510:1875407735494016:192.168.203.38@tcp:104: 00000100:00100000:3.0:1788528458.976613:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3eef3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528458.982185:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528458.984835:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719695872 00000100:00100000:2.0:1788528458.984850:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719695872 00000100:00100000:2.0:1788528458.984933:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:2.0:1788528458.984944:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+23:6170:x1875407719695872:12345-192.168.203.38@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788528458.985206:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+24:6170:x1875407719695872:12345-192.168.203.38@tcp:35:ldlm_bl.0 Request processed in 263us (3030us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788528458.985215:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:3.0:1788528458.989786:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6510:1875407735494016:192.168.203.38@tcp:104: 00010000:00010000:3.0:1788528458.989816:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c8399 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528458.990183:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528458.990309:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719696000 00000100:00100000:3.0:1788528458.990331:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719696000 00010000:00010000:3.0:1788528458.990375:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c82a4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe19 expref: 24 pid: 6509 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528458.990412:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 83 00000100:00100000:3.0:1788528458.990421:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+24:2403:x1875407719696000:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788528458.990580:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528458.990589:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c82a4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe19 expref: 24 pid: 6509 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.990603:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c82a4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe19 expref: 24 pid: 6509 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.990626:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c82a4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe19 expref: 24 pid: 6509 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.990641:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:3.0:1788528458.990646:0:8441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c8399 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.990655:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c8399 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.990663:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c8399 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528458.990691:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528458.990744:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+23:2403:x1875407719696000:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 324us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528458.990761:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 83 00010000:00010000:1.0:1788528458.990857:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c8399 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.990874:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c8399 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528458.990922:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788528458.990926:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788528458.990944:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c8399 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.990968:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c8399 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.990977:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c838b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.990983:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c838b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.990990:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c838b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.990996:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3429000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528458.991010:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c838b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.991018:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c838b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.991027:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:1.0:1788528458.991029:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528458.991032:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c838b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.991039:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c838b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.991050:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8392 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.991056:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8392 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.991068:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8392 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.991073:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528458.991076:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8392 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.991082:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8392 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.991090:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a8fc1fa8a00) 00010000:00010000:1.0:1788528458.991093:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528458.991096:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8392 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.991101:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8392 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.991607:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8384 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe58 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.991625:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c8399 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe58 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528458.991633:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:1.0:1788528458.991635:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788528458.991637:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3428600, rc 0) 00000100:00100000:1.0:1788528458.991672:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+22:11394:x1875407719695616:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 16858us (17903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528458.991688:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 141 00000001:00080000:0.0:1788528459.392823:0:8416:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:0.0:1788528459.392840:0:8416:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00010000:00010000:2.0:1788528459.911296:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528459.974684:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528459.974730:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528459.974760:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528459.974785:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528459.974804:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528459.974823:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528459.974844:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528459.974874:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719696128 00000100:00100000:0.0:1788528459.974883:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719696128 00000100:00100000:0.0:1788528459.974933:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 407 00000100:00100000:0.0:1788528459.974943:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2403:x1875407719696128:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528459.975023:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2403:x1875407719696128:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 81us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528459.975030:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 407 00000100:00100000:0.0:1788528459.975062:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719696256 00000100:00100000:0.0:1788528459.975066:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719696256 00000100:00100000:0.0:1788528459.975102:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719696768 00000100:00100000:0.0:1788528459.975105:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719696768 00000100:00100000:3.0:1788528459.975223:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719696384 00000100:00100000:3.0:1788528459.975228:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719696384 00000100:00100000:3.0:1788528459.975249:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719696896 00000100:00100000:3.0:1788528459.975252:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719696896 00000100:00100000:3.0:1788528459.975266:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 277 00000100:00100000:3.0:1788528459.975273:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+22:2403:x1875407719696256:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528459.975311:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+22:2403:x1875407719696256:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 38us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528459.975317:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 277 00000100:00100000:3.0:1788528459.975331:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 278 00000100:00100000:3.0:1788528459.975337:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719696384:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528459.975362:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719696384:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 25us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528459.975367:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 278 00000100:00100000:3.0:1788528459.975381:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 279 00000100:00100000:3.0:1788528459.975387:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719696896:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528459.975409:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719696896:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 22us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528459.975415:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 279 00000100:00100000:0.0:1788528459.975490:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 280 00000100:00100000:0.0:1788528459.975497:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719696768:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528459.975524:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719696768:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528459.975530:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 280 00000100:00100000:0.0:1788528459.975639:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719696512 00000100:00100000:0.0:1788528459.975653:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719696512 00000100:00100000:0.0:1788528459.975680:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719696640 00000100:00100000:0.0:1788528459.975683:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719696640 00000100:00100000:0.0:1788528459.975703:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 105 00000100:00100000:0.0:1788528459.975710:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719696512:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528459.975737:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719696512:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528459.975744:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 105 00000100:00100000:0.0:1788528459.975756:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 106 00000100:00100000:0.0:1788528459.975762:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2403:x1875407719696640:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528459.975785:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2403:x1875407719696640:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 24us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528459.975791:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 106 00000100:00080000:0.0:1788528459.975835:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788528459.975839:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788528459.975842:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788528459.985955:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788528459.985963:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788528459.986024:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788528459.986031:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788528459.986310:0:13786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1875407735494144:192.168.203.38@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788528459.986405:0:13786:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c96baf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788528459.994065:0:13786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1875407735494144:192.168.203.38@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788528459.996818:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528460.000931:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719697024 00000100:00100000:3.0:1788528460.000947:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719697024 00000100:00100000:3.0:1788528460.001020:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 142 00000100:00100000:3.0:1788528460.001031:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+22:11406:x1875407719697024:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788528460.001062:0:6509:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788528460.001264:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+22:11406:x1875407719697024:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 Request processed in 233us (4453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528460.001273:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 142 00000100:00100000:1.0:1788528460.008304:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528460.008344:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719697280 00000100:00100000:1.0:1788528460.008353:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719697280 00000100:00100000:1.0:1788528460.008406:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 143 00000100:00100000:1.0:1788528460.008415:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+22:11406:x1875407719697280:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788528460.008435:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528460.008456:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c83a0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfe5f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528460.008590:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c83a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528460.008606:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c83a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528460.008616:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c83a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528460.008628:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788528460.008733:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c83a0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe5f expref: 25 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528460.008749:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c83a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe5f expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528460.008757:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:1.0:1788528460.008760:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788528460.008773:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e17200, rc 0) 00000100:00100000:1.0:1788528460.008826:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+24:11406:x1875407719697280:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 411us (531us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1788528460.008833:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 143 00000100:00100000:1.0:1788528460.013420:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528460.013486:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719697536 00000100:00100000:3.0:1788528460.013495:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719697536 00000100:00100000:1.0:1788528460.013673:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 144 00000100:00100000:1.0:1788528460.013685:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+24:11406:x1875407719697536:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788528460.013765:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c83b5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528460.013782:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c83b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528460.013794:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c83b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528460.013951:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c83b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528460.013960:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c83b5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528460.013966:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c83b5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528460.013973:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17c00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528460.013977:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c83b5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528460.013984:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c83b5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528460.014015:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:1.0:1788528460.014018:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788528460.014023:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c83b5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528460.014029:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c83b5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528460.014199:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+25:11406:x1875407719697536:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 515us (786us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788528460.014207:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 144 00000040:00080000:2.0:1788528460.018940:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788528460.018949:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788528460.019690:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788528460.019702:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788528460.028785:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528460.029249:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719697664 00000100:00100000:3.0:1788528460.029258:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719697664 00000100:00100000:0.0:1788528460.029327:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528460.030136:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:3.0:1788528460.030151:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+25:2403:x1875407719697664:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788528460.030168:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528460.030192:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c83a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe5f expref: 25 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528460.030209:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:3.0:1788528460.030215:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528460.030272:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+24:2403:x1875407719697664:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 125us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528460.030280:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:2.0:1788528460.032920:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719697920 00000100:00100000:2.0:1788528460.032932:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719697920 00000100:00100000:2.0:1788528460.032984:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 34 00000100:00100000:2.0:1788528460.033004:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+24:11406:x1875407719697920:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788528460.033211:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+25:11406:x1875407719697920:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 218us (3883us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1788528460.033219:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 34 00000040:00080000:2.0:1788528460.053941:0:14250:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788528460.053950:0:14250:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788528460.053986:0:14250:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788528460.054004:0:14250:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788528460.278851:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528460.279112:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719698176 00000100:00100000:2.0:1788528460.279131:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719698176 00000100:00100000:2.0:1788528460.279199:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 145 00000100:00100000:2.0:1788528460.279210:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+25:11419:x1875407719698176:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1788528460.279234:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528460.279253:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c83bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfe66 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528460.279382:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c83c3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528460.279396:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c83c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528460.279407:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c83c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528460.279417:0:8449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788528460.279524:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c83bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe66 expref: 28 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528460.279539:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c83c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe66 expref: 27 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528460.279548:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:2.0:1788528460.279972:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788528460.279978:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3a400, rc 0) 00000100:00100000:2.0:1788528460.280054:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+27:11419:x1875407719698176:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 844us (1210us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788528460.280062:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 145 00000100:00100000:1.0:1788528460.285277:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528460.285413:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719698304 00000100:00100000:0.0:1788528460.285423:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719698304 00000100:00100000:0.0:1788528460.285490:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 146 00000100:00100000:0.0:1788528460.285500:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+27:11419:x1875407719698304:12345-192.168.203.38@tcp:54:lfs.0 00010000:00010000:0.0:1788528460.285612:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c83d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528460.285646:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c83d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528460.285658:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c83d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528460.285694:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c83d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528460.285700:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c83d1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528460.285706:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c83d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528460.285712:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528460.285717:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c83d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528460.285723:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c83d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528460.285734:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:0.0:1788528460.285737:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788528460.285742:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c83d1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528460.285748:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c83d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528460.285817:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+27:11419:x1875407719698304:12345-192.168.203.38@tcp:54:lfs.0 Request processed in 317us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528460.285830:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 146 00000100:00100000:3.0:1788528460.371912:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528460.374675:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719698432 00000100:00100000:0.0:1788528460.374689:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719698432 00000100:00100000:2.0:1788528460.378176:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:2.0:1788528460.378207:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fabb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2406:x1875407719698432:12345-192.168.203.38@tcp:101:cat.0 00010000:00010000:2.0:1788528460.378227:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528460.378247:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092d51e51/0x892c60dda91c83d8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfe6d expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788528460.378286:0:8421:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9ac74a, atime: 0x6a9ac74a, ctime: 0x6a9ac74a, blocks: 0x8 00010000:00010000:2.0:1788528460.378309:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=329s v=(0 0) 00010000:00010000:2.0:1788528460.378314:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528460.378322:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092d51e51/0x892c60dda91c83d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe6d expref: 7 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528460.378350:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000092d51e51/0x892c60dda91c83d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe6d expref: 7 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528460.378372:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3bc00, rc 0) 00000100:00100000:2.0:1788528460.378450:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fabb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2406:x1875407719698432:12345-192.168.203.38@tcp:101:cat.0 Request processed in 248us (6548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528460.378457:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00080000:0.0:1788528460.384829:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788528460.388963:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528460.389150:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719698560 00000100:00100000:1.0:1788528460.389160:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719698560 00002000:00100000:1.0:1788528460.389211:0:8428:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8a8fc44c7480 x1875407719698560/t0(0) o3->80304108-f3b9-46ea-888c-b2a7ec20e3e2@192.168.203.38@tcp:666/0 lens 488/0 e 0 to 0 dl 1788528471 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788528460.389222:0:8428:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a8fc44c7480 with x1875407719698560 ext(0->4095) 00002000:00010000:1.0:1788528460.389229:0:8428:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a8fc44c7480 00000100:00100000:1.0:1788528460.389274:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:1.0:1788528460.389285:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2404:x1875407719698560:12345-192.168.203.38@tcp:3:cat.0 00000100:00100000:1.0:1788528460.389743:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2404:x1875407719698560:12345-192.168.203.38@tcp:3:cat.0 Request processed in 458us (787us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788528460.389752:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 3 00002000:00100000:1.0:1788528460.389760:0:8428:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8a8fc44c7480 x1875407719698560/t0(0) o3->80304108-f3b9-46ea-888c-b2a7ec20e3e2@192.168.203.38@tcp:666/0 lens 488/4536 e 0 to 0 dl 1788528471 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788528460.389788:0:8428:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a8fc44c7480 with x1875407719698560 ext(0->4095) 00002000:00010000:1.0:1788528460.389792:0:8428:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a8fc44c7480 00010000:00010000:1.0:1788528460.928651:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528460.990802:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788528460.990842:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc45b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735494272:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788528460.990910:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528460.991311:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735494400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788528460.991341:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528460.991425:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735494272 00000100:00100000:3.0:1788528460.991434:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735494272 00000100:00100000:3.0:1788528460.991491:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735494400 00000100:00100000:3.0:1788528460.991494:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735494400 00000100:00100000:3.0:1788528460.991511:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788528460.991519:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735494272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788528460.991547:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788528460.991612:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735494272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528460.991620:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788528460.991638:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788528460.991645:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1875407735494400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788528460.991655:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788528460.991679:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1875407735494400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528460.991685:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1788528460.992938:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788528460.992964:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735494912:0@lo:400:kworker.0 00000100:00100000:0.0:1788528460.993025:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528460.993060:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735495424:0@lo:400:kworker.0 00000100:00100000:0.0:1788528460.993081:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528460.993123:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735494400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788528460.993136:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc45b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735494272:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788528460.993161:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788528460.993167:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735494784:0@lo:400:kworker.0 00000100:00100000:0.0:1788528460.993189:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528460.993204:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1875407735495296:0@lo:400:kworker.0 00000100:00100000:0.0:1788528460.993222:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528460.993233:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735495808:0@lo:400:kworker.0 00000100:00100000:0.0:1788528460.993250:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528460.993276:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735495424 00000100:00100000:0.0:1788528460.993295:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735495424 00000100:00100000:0.0:1788528460.993340:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788528460.993348:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735495424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528460.993391:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735495424:12345-0@lo:400:kworker.0 Request processed in 45us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528460.993398:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1788528460.993413:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788528460.993429:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735495424:0@lo:400:kworker.0 00000100:00100000:3.0:1788528460.993504:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735494912 00000100:00100000:3.0:1788528460.993509:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735494912 00000100:00100000:3.0:1788528460.993541:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735495296 00000100:00100000:3.0:1788528460.993543:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735495296 00000100:00100000:3.0:1788528460.993588:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735495808 00000100:00100000:3.0:1788528460.993591:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735495808 00000100:00100000:3.0:1788528460.993605:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788528460.993610:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735494912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528460.993646:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735494912:12345-0@lo:400:kworker.0 Request processed in 36us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528460.993653:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788528460.993675:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788528460.993680:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875407735495296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528460.993710:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875407735495296:12345-0@lo:400:kworker.0 Request processed in 30us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528460.993716:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788528460.993726:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788528460.993732:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735495808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528460.993757:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735495808:12345-0@lo:400:kworker.0 Request processed in 26us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528460.993763:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00080000:3.0:1788528460.993781:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788528460.994153:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc44c0a80 x1875407735495296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528460.994165:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1875407735495296:0@lo:400:kworker.0 00010000:00080000:0.0:1788528460.994175:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc44c2a00 x1875407735495808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528460.994184:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735495808:0@lo:400:kworker.0 00000100:00100000:0.0:1788528460.994194:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735494912:0@lo:400:kworker.0 00000100:00100000:1.0:1788528460.994304:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735494528:0@lo:400:kworker.0 00000100:00100000:1.0:1788528460.994343:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528460.994386:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735495040:0@lo:400:kworker.0 00000100:00100000:1.0:1788528460.994414:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528460.994468:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735494528 00000100:00100000:3.0:1788528460.994473:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735494528 00000100:00100000:3.0:1788528460.994505:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:3.0:1788528460.994513:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735494528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528460.994523:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735494784 00000100:00100000:2.0:1788528460.994530:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735494784 00000100:00100000:0.0:1788528460.994591:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735495936:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528460.994592:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735495040 00000100:00100000:2.0:1788528460.994599:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735495040 00000100:00100000:2.0:1788528460.994617:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788528460.994626:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735494784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528460.994646:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735495552:0@lo:400:kworker.0 00000100:00100000:3.0:1788528460.997725:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735494528:12345-0@lo:400:kworker.0 Request processed in 3206us (3374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528460.997739:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:3.0:1788528460.997844:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735494656:0@lo:400:kworker.0 00000100:00100000:3.0:1788528460.997897:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528460.997930:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735495168:0@lo:400:kworker.0 00000100:00100000:3.0:1788528460.997956:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528460.997974:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735495680:0@lo:400:kworker.0 00000100:00100000:3.0:1788528460.998004:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528460.998038:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735494656 00000100:00100000:3.0:1788528460.998057:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735494656 00000100:00100000:3.0:1788528460.998085:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735495168 00000100:00100000:3.0:1788528460.998087:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735495168 00000100:00100000:3.0:1788528460.998108:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735495680 00000100:00100000:3.0:1788528460.998110:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735495680 00000100:00100000:3.0:1788528460.998125:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788528460.998139:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735494656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528460.998187:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735494656:12345-0@lo:400:kworker.0 Request processed in 55us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528460.998193:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788528460.998206:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788528460.998212:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735495168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528460.998238:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735495168:12345-0@lo:400:kworker.0 Request processed in 27us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528460.998244:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788528460.998254:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788528460.998260:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735495680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528460.998283:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735495680:12345-0@lo:400:kworker.0 Request processed in 24us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528460.998288:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:3.0:1788528460.998302:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788528460.998327:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735494656:0@lo:400:kworker.0 00000100:00100000:3.0:1788528460.998336:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735495168:0@lo:400:kworker.0 00000100:00100000:3.0:1788528460.998343:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735495680:0@lo:400:kworker.0 00000100:00100000:3.0:1788528460.998381:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788528460.998390:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735495040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528460.998428:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735495040:12345-0@lo:400:kworker.0 Request processed in 40us (4014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528460.998433:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788528461.002652:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528461.002659:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528461.002727:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735494528:0@lo:400:kworker.0 00000100:00100000:1.0:1788528461.002748:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735495040:0@lo:400:kworker.0 00000100:00100000:0.0:1788528461.002777:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735495552 00000100:00100000:0.0:1788528461.002785:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735495552 00000100:00100000:0.0:1788528461.002863:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788528461.002871:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735494784:12345-0@lo:400:kworker.0 Request processed in 8243us (9677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528461.002873:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735495552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528461.002899:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788528461.002924:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735495936 00000100:00100000:2.0:1788528461.002929:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735495936 00000100:00100000:0.0:1788528461.002936:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735495552:12345-0@lo:400:kworker.0 Request processed in 65us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528461.002944:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1788528461.003014:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788528461.003034:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1788528461.003045:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:1.0:1788528461.003062:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a90c96c9880, transno 4294967302 00000004:00080000:1.0:1788528461.003071:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:1.0:1788528461.003082:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a90ffa67480, transno 4294967305 00000100:00100000:1.0:1788528461.003088:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735495552:0@lo:400:kworker.0 00000100:00100000:0.0:1788528461.003181:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735494784:0@lo:400:kworker.0 00000100:00100000:3.0:1788528461.006365:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788528461.006388:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735495936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788528461.006427:0:9268:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788528461.006589:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735495936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 211us (3930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528461.006596:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788528461.006695:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735495936:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788528461.951487:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528462.015762:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735496064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788528462.015837:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528462.015958:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735496064 00000100:00100000:1.0:1788528462.015966:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735496064 00000100:00100000:1.0:1788528462.016034:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788528462.016044:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735496064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788528462.016073:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528462.016133:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735496064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528462.016149:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788528462.016198:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735496064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788528462.017530:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735496192:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788528462.017603:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528462.018589:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735496192 00000100:00100000:2.0:1788528462.018600:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735496192 00000100:00100000:2.0:1788528462.018668:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788528462.018678:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735496192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788528462.018702:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528462.018761:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735496192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528462.018768:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788528462.018813:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735496192:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788528462.018871:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788528462.976432:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528463.043695:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788528463.043719:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735496320:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788528463.043784:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528463.043849:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735496320 00000100:00100000:2.0:1788528463.043857:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735496320 00000100:00100000:2.0:1788528463.043896:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788528463.043903:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735496320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788528463.043935:0:9268:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788528463.043990:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735496320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528463.043998:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788528463.044041:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735496320:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788528463.102962:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788528463.102980:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788528463.103004:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788528463.103010:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788528463.487344:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788528463.999405:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788528464.586056:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1788528464.586099:0:6487:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a90f6ef8cc0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788528464.586110:0:6487:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a8fc1cc4e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a90f6ef8480 00000020:00080000:2.0:1788528464.586114:0:6487:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a8fc1cc4c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a90f8df3800 00000020:00080000:2.0:1788528464.586134:0:6487:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788528464.586146:0:6540:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788528464.586437:0:6540:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:2.0:1788528464.586474:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:2.0:1788528464.586482:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:0.0:1788528464.586579:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8353 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528464.586591:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8353 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528464.586598:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8353 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528464.586605:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428c00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528464.586610:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8353 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528464.586617:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8353 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528464.586634:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a8fc1fa8900) 00010000:00010000:0.0:1788528464.586637:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528464.586641:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8353 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528464.586647:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8353 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528465.024307:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528465.093996:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528465.094048:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528465.094068:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528465.094087:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528465.094101:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528465.094115:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528465.094133:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528465.094155:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719699200 00000100:00100000:0.0:1788528465.094163:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719699200 00000100:00100000:0.0:1788528465.094209:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719699072 00000100:00100000:0.0:1788528465.094211:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719699072 00000100:00100000:0.0:1788528465.094232:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 109 00000100:00100000:0.0:1788528465.094240:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2406:x1875407719699200:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528465.094301:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2406:x1875407719699200:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 62us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528465.094308:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 109 00000100:00100000:0.0:1788528465.094322:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 110 00000100:00100000:0.0:1788528465.094327:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2406:x1875407719699072:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528465.094345:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2406:x1875407719699072:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 19us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528465.094351:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 110 00000100:00100000:0.0:1788528465.094365:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719698944 00000100:00100000:0.0:1788528465.094368:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719698944 00000100:00100000:0.0:1788528465.094391:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719699456 00000100:00100000:0.0:1788528465.094393:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719699456 00000100:00100000:0.0:1788528465.094403:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719698816 00000100:00100000:0.0:1788528465.094405:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719698816 00000100:00100000:0.0:1788528465.094415:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719699328 00000100:00100000:0.0:1788528465.094417:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719699328 00000100:00100000:0.0:1788528465.094444:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 287 00000100:00100000:0.0:1788528465.094449:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2406:x1875407719698944:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528465.094478:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2406:x1875407719698944:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 29us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528465.094484:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 287 00000100:00100000:0.0:1788528465.094496:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 288 00000100:00100000:0.0:1788528465.094502:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2406:x1875407719699456:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528465.094524:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2406:x1875407719699456:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 23us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528465.094530:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 288 00000100:00100000:0.0:1788528465.094541:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 289 00000100:00100000:0.0:1788528465.094547:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+13:2406:x1875407719698816:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528465.094619:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+13:2406:x1875407719698816:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 71us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528465.094625:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 289 00000100:00100000:0.0:1788528465.094635:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 290 00000100:00100000:0.0:1788528465.094641:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2406:x1875407719699328:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528465.094658:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2406:x1875407719699328:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 18us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528465.094662:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 290 00000100:00080000:0.0:1788528465.094682:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788528465.094686:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788528465.094688:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788528465.094690:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788528465.094995:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719698688 00000100:00100000:3.0:1788528465.095001:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719698688 00000100:00100000:3.0:1788528465.095040:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 409 00000100:00100000:3.0:1788528465.095046:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2406:x1875407719698688:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528465.095079:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2406:x1875407719698688:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 34us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528465.095084:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 409 00000100:00100000:0.0:1788528465.654706:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528465.654764:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719699584 00000100:00100000:3.0:1788528465.654773:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719699584 00000100:00100000:3.0:1788528465.654829:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 147 00000100:00100000:3.0:1788528465.654855:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+13:11079:x1875407719699584:12345-192.168.203.38@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788528465.654969:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+13:11079:x1875407719699584:12345-192.168.203.38@tcp:60:lhsmtool_posix.0 Request processed in 115us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528465.654977:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 147 00000100:00100000:3.0:1788528465.660923:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528465.661194:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719699712 00000100:00100000:0.0:1788528465.661207:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719699712 00000100:00100000:0.0:1788528465.661288:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 148 00000100:00100000:0.0:1788528465.661301:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:11079:x1875407719699712:12345-192.168.203.38@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788528465.661463:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:11079:x1875407719699712:12345-192.168.203.38@tcp:60:lhsmtool_posix.0 Request processed in 164us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528465.661472:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 148 00000100:00100000:0.0:1788528465.665191:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528465.665308:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719699968 00000100:00100000:2.0:1788528465.665325:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719699968 00000100:00100000:2.0:1788528465.665412:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 35 00000100:00100000:2.0:1788528465.665424:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+13:11079:x1875407719699968:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788528465.666096:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+14:11079:x1875407719699968:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 672us (919us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788528465.666107:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 35 00000100:00100000:1.0:1788528465.988792:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528465.990451:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719700096 00000100:00100000:3.0:1788528465.990465:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719700096 00000100:00100000:3.0:1788528465.990536:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 149 00000100:00100000:3.0:1788528465.990546:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:11879:x1875407719700096:12345-192.168.203.38@tcp:101:lsof.0 00010000:00010000:3.0:1788528465.990592:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528465.990614:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c83df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfe74 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528465.990676:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c83e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528465.990690:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c83e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528465.990703:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c83e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528465.990749:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788528465.990752:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788528465.990790:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c83e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528465.990812:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c83df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe74 expref: 7 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528465.990848:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c83e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe74 expref: 6 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528465.990856:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90d5d08500) 00010000:00010000:3.0:1788528465.990859:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788528465.990863:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3429400, rc 0) 00000100:00100000:3.0:1788528465.999134:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:11879:x1875407719700096:12345-192.168.203.38@tcp:101:lsof.0 Request processed in 3508us (5271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528465.999161:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 149 00010000:00010000:1.0:1788528466.046867:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528466.110742:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735496448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788528466.110773:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735496704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788528466.110813:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528466.110966:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735496576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528466.111003:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528466.111008:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735496832:0@lo:400:kworker.0 00000100:00100000:2.0:1788528466.111033:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735497088:0@lo:400:kworker.0 00000100:00100000:3.0:1788528466.111049:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528466.111063:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528466.111427:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735496576 00000100:00100000:0.0:1788528466.111427:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735496448 00000100:00100000:2.0:1788528466.111435:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735496576 00000100:00100000:0.0:1788528466.111435:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735496448 00000100:00100000:3.0:1788528466.111440:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735497344:0@lo:400:kworker.0 00000100:00100000:2.0:1788528466.111475:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735497088 00000100:00100000:2.0:1788528466.111479:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735497088 00000100:00100000:0.0:1788528466.111482:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788528466.111483:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528466.111492:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735496448:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788528466.111494:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735497344 00000100:00100000:3.0:1788528466.111505:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735497856:0@lo:400:kworker.0 00000100:00100000:2.0:1788528466.111509:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735497344 00002000:00000024:0.0:1788528466.111525:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788528466.111539:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788528466.111543:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528466.111549:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1875407735496576:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788528466.111595:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735496448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528466.111601:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788528466.111604:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788528466.111611:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875407735497216:0@lo:400:kworker.0 00000004:00000024:2.0:1788528466.111616:0:9268:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00080000:0.0:1788528466.111627:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788528466.111639:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735496960:0@lo:400:kworker.0 00000100:00100000:3.0:1788528466.111647:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528466.111658:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1875407735496576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528466.111665:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788528466.111668:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528466.111679:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788528466.111685:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735497088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528466.111689:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1875407735497472:0@lo:400:kworker.0 00000100:00100000:0.0:1788528466.111708:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528466.111710:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735497088:12345-0@lo:400:kworker.0 Request processed in 26us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528466.111716:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788528466.111723:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1875407735497984:0@lo:400:kworker.0 00000100:00100000:2.0:1788528466.111727:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788528466.111732:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735497344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528466.111743:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528466.111755:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735497344:12345-0@lo:400:kworker.0 Request processed in 24us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528466.111761:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788528466.111770:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735497216 00000100:00100000:0.0:1788528466.111774:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735497216 00000100:00100000:2.0:1788528466.111798:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735497088:0@lo:400:kworker.0 00000100:00100000:2.0:1788528466.111804:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1875407735497600:0@lo:400:kworker.0 00000100:00100000:0.0:1788528466.111807:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735496960 00000100:00100000:0.0:1788528466.111809:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735496960 00000100:00100000:0.0:1788528466.111828:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735497472 00000100:00100000:1.0:1788528466.111832:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528466.111832:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735497472 00000100:00100000:2.0:1788528466.111833:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528466.111848:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735498112:0@lo:400:kworker.0 00000100:00100000:0.0:1788528466.111852:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735497984 00000100:00100000:0.0:1788528466.111855:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735497984 00000100:00100000:2.0:1788528466.111873:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528466.111873:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735497600 00000100:00100000:0.0:1788528466.111876:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735497600 00000100:00100000:1.0:1788528466.111894:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735498112 00000100:00100000:1.0:1788528466.111899:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735498112 00000100:00100000:2.0:1788528466.111900:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735496448:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788528466.111900:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788528466.111909:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875407735497216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528466.111914:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735496576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788528466.111936:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788528466.111945:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735496960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528466.111985:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735497856 00000100:00100000:2.0:1788528466.111990:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735497856 00000100:00100000:1.0:1788528466.111998:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735496960:12345-0@lo:400:kworker.0 Request processed in 54us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528466.112006:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788528466.112022:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788528466.112029:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735497856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528466.112031:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735497728:0@lo:400:kworker.0 00000100:00100000:0.0:1788528466.112035:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875407735497216:12345-0@lo:400:kworker.0 Request processed in 125us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528466.112044:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788528466.112057:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788528466.112064:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875407735497472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528466.112068:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735497856:12345-0@lo:400:kworker.0 Request processed in 41us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528466.112076:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528466.112078:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788528466.112092:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875407735497472:12345-0@lo:400:kworker.0 Request processed in 29us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528466.112096:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735496832 00000100:00100000:0.0:1788528466.112097:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788528466.112099:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735496832 00000100:00100000:0.0:1788528466.112107:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788528466.112112:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875407735497984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528466.112120:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:2.0:1788528466.112126:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:3638:x1875407735496832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528466.112137:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875407735497984:12345-0@lo:400:kworker.0 Request processed in 25us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528466.112143:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788528466.112154:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1788528466.112156:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:3638:x1875407735496832:12345-0@lo:400:kworker.0 Request processed in 31us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528466.112160:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875407735497600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528466.112162:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:0.0:1788528466.112187:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875407735497600:12345-0@lo:400:kworker.0 Request processed in 28us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528466.112188:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1788528466.112195:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735498112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528466.112202:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00080000:0.0:1788528466.112219:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788528466.112223:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788528466.112225:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788528466.112245:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc44c1c00 x1875407735497600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528466.112256:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1875407735497600:0@lo:400:kworker.0 00000100:00100000:0.0:1788528466.112361:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735496960:0@lo:400:kworker.0 00000100:00100000:0.0:1788528466.112373:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1875407735497472:0@lo:400:kworker.0 00000100:00100000:0.0:1788528466.112380:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1875407735497984:0@lo:400:kworker.0 00000100:00100000:0.0:1788528466.112422:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735496704 00000100:00100000:0.0:1788528466.112426:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735496704 00000100:00100000:0.0:1788528466.112459:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00080000:1.0:1788528466.112462:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788528466.112467:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735496704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788528466.112480:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788528466.112499:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735497728 00000100:00100000:1.0:1788528466.112507:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735497728 00000100:00100000:1.0:1788528466.112540:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788528466.112546:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6feea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735497728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528466.116515:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735498112:12345-0@lo:400:kworker.0 Request processed in 4309us (4630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528466.116515:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6feea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735497728:12345-0@lo:400:kworker.0 Request processed in 3957us (4430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528466.116539:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788528466.116540:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00080000:1.0:1788528466.116607:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788528466.116647:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc44c3480 x1875407735498112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528466.116662:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735498112:0@lo:400:kworker.0 00000100:00100000:3.0:1788528466.116772:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735497728:0@lo:400:kworker.0 00000100:00100000:3.0:1788528466.116782:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735498240:0@lo:400:kworker.0 00000100:00100000:3.0:1788528466.116821:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528466.116868:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735496832:0@lo:400:kworker.0 00000100:00100000:3.0:1788528466.116881:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735497344:0@lo:400:kworker.0 00000100:00100000:3.0:1788528466.116894:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735497856:0@lo:400:kworker.0 00000100:00100000:3.0:1788528466.116923:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875407735497216:0@lo:400:kworker.0 00000100:00100000:2.0:1788528466.117001:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735498240 00000100:00100000:2.0:1788528466.117009:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735498240 00000100:00100000:0.0:1788528466.117034:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1875407735496704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4565us (5203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528466.117044:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788528466.117096:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788528466.117106:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735498240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528466.117171:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735498240:12345-0@lo:400:kworker.0 Request processed in 66us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528466.117178:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788528466.117207:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1788528466.117335:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a8fc374c700, transno 4294967311 00000004:00080000:1.0:1788528466.117345:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1788528466.117448:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735496704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788528466.117476:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735498240:0@lo:400:kworker.0 00010000:00010000:3.0:1788528467.072758:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528467.136819:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735498368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788528467.136902:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528467.137235:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735498368 00000100:00100000:3.0:1788528467.137244:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735498368 00000100:00100000:3.0:1788528467.137299:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788528467.137309:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735498368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788528467.137338:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788528467.137393:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735498368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528467.137413:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788528467.137705:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735498496:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788528467.137737:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528467.137826:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735498368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788528467.138031:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735498496 00000100:00100000:3.0:1788528467.138037:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735498496 00000100:00100000:3.0:1788528467.138076:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788528467.138084:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735498496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788528467.138098:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788528467.138141:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735498496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528467.138148:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788528467.138222:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735498496:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788528468.095283:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528468.159075:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788528468.159115:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735498624:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788528468.159184:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528468.159456:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735498624 00000100:00100000:2.0:1788528468.159464:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735498624 00000100:00100000:2.0:1788528468.159515:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788528468.159525:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735498624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788528468.159576:0:9268:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788528468.159633:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735498624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528468.159639:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788528468.159974:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735498624:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788528469.119720:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788528469.138064:0:14447:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 09:27:47 (1788528467) 00010000:00010000:2.0:1788528470.146171:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528470.215317:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528470.215437:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719700224 00000100:00100000:0.0:1788528470.215451:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719700224 00000100:00100000:0.0:1788528470.215513:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 411 00000100:00100000:0.0:1788528470.215526:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2405:x1875407719700224:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528470.215626:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2405:x1875407719700224:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 103us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528470.215634:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 411 00000100:00100000:2.0:1788528470.216461:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528470.216493:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528470.216518:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528470.216544:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528470.216599:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528470.216623:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719700736 00000100:00100000:2.0:1788528470.216629:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528470.216632:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719700736 00000100:00100000:2.0:1788528470.216655:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719700480 00000100:00100000:2.0:1788528470.216661:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719700480 00000100:00100000:1.0:1788528470.216693:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719700608 00000100:00100000:1.0:1788528470.216698:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719700608 00000100:00100000:2.0:1788528470.216702:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719700992 00000100:00100000:2.0:1788528470.216707:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719700992 00000100:00100000:2.0:1788528470.216732:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719700352 00000100:00100000:1.0:1788528470.216732:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 114 00000100:00100000:2.0:1788528470.216736:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719700352 00000100:00100000:1.0:1788528470.216746:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2405:x1875407719700736:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528470.216752:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719700864 00000100:00100000:2.0:1788528470.216756:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719700864 00000100:00100000:2.0:1788528470.216775:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 297 00000100:00100000:2.0:1788528470.216783:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2405:x1875407719700480:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528470.216800:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2405:x1875407719700736:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 58us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528470.216814:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 114 00000100:00100000:1.0:1788528470.216830:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 115 00000100:00100000:1.0:1788528470.216840:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2405:x1875407719700608:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528470.216848:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2405:x1875407719700480:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 64us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528470.216856:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 297 00000100:00100000:1.0:1788528470.216874:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2405:x1875407719700608:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 34us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528470.216875:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 298 00000100:00100000:1.0:1788528470.216888:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 115 00000100:00100000:2.0:1788528470.216890:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2405:x1875407719700992:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528470.216931:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 299 00000100:00100000:1.0:1788528470.216941:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+14:2405:x1875407719700352:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528470.216982:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+14:2405:x1875407719700352:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 43us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528470.216989:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 299 00000100:00100000:1.0:1788528470.217003:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 300 00000100:00100000:1.0:1788528470.217009:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:2405:x1875407719700864:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528470.217033:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:2405:x1875407719700864:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 25us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528470.217039:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 300 00000100:00080000:1.0:1788528470.217055:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788528470.217060:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788528470.217062:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788528470.217071:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788528470.217257:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2405:x1875407719700992:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 36us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528470.217265:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 298 00000100:00100000:1.0:1788528470.398640:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528470.399783:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719701248 00000100:00100000:2.0:1788528470.399796:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719701248 00000100:00100000:2.0:1788528470.399874:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 150 00000100:00100000:2.0:1788528470.399886:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+14:12146:x1875407719701248:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788528470.399908:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528470.399941:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c83ed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfe7b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528470.400021:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c83f4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528470.400046:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c83f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528470.400060:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c83f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528470.400075:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c83fb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528470.400101:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c83fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528470.400108:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c83fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528470.401536:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c8402 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528470.403534:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c8402 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528470.403582:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c8402 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528470.403601:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788528470.403718:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c83f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528470.403724:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c83f4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528470.403730:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c83f4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528470.403734:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3b600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528470.403737:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c83f4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528470.403743:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c83f4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528470.403753:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a8fc2721700) 00010000:00010000:3.0:1788528470.403755:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528470.403758:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c83f4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528470.403763:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c83f4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528470.403773:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c83fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528470.403782:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c83fb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528470.403785:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c83fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528470.403788:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3ba00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528470.403790:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c83fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528470.403793:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c83fb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528470.403797:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8a8fc3770400) 00010000:00010000:3.0:1788528470.403798:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528470.403800:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c83fb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528470.403803:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c83fb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528470.404169:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c83ed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe7b expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528470.404181:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c8402 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe7b expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528470.404189:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a8fc2721c00) 00010000:00010000:3.0:1788528470.404191:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528470.404200:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3429e00, rc 0) 00000100:00100000:3.0:1788528470.404272:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+16:12146:x1875407719701248:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 4388us (5642us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788528470.404282:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 150 00000100:00100000:0.0:1788528470.410107:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528470.410596:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719701376 00000100:00100000:1.0:1788528470.410612:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719701376 00000100:00100000:1.0:1788528470.410685:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 151 00000100:00100000:1.0:1788528470.410698:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+16:12146:x1875407719701376:12345-192.168.203.38@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788528470.410818:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+16:12146:x1875407719701376:12345-192.168.203.38@tcp:59:lhsmtool_posix.0 Request processed in 123us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528470.410826:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 151 00000100:00100000:2.0:1788528470.416145:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000001:00080000:2.0:1788528470.417292:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967418 is committed 00000020:00080000:2.0:1788528470.417312:0:6487:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000100:00100000:3.0:1788528470.417416:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719701504 00000100:00100000:3.0:1788528470.417434:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719701504 00000100:00100000:3.0:1788528470.417519:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:3.0:1788528470.417532:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+14:2406:x1875407719701504:12345-192.168.203.38@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788528470.417550:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00010000:00010000:3.0:1788528470.417598:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788528470.417630:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719701632 00010000:00010000:3.0:1788528470.417632:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c8402 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe7b expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528470.417643:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719701632 00010000:00010000:3.0:1788528470.417660:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a8fc2721c00) 00010000:00010000:3.0:1788528470.417668:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528470.417708:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 152 00000100:00100000:1.0:1788528470.417721:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:12146:x1875407719701632:12345-192.168.203.38@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788528470.417738:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+13:2406:x1875407719701504:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 207us (1602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528470.417757:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:1.0:1788528470.417847:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:12146:x1875407719701632:12345-192.168.203.38@tcp:59:lhsmtool_posix.0 Request processed in 126us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528470.417857:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 152 00000020:00080000:0.0:1788528470.422477:0:6540:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788528470.422501:0:6540:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000040:00080000:1.0:1788528470.655981:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788528471.170475:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528471.230833:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735499008:0@lo:400:kworker.0 00000100:00100000:3.0:1788528471.230903:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528471.230962:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735499520:0@lo:400:kworker.0 00000100:00100000:3.0:1788528471.230988:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528471.231006:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735500032:0@lo:400:kworker.0 00000100:00100000:3.0:1788528471.231026:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528471.231123:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735498880:0@lo:400:kworker.0 00000100:00100000:1.0:1788528471.231199:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc374c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735498752:0@lo:400:kworker.0 00000100:00100000:2.0:1788528471.231616:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735499008 00000100:00100000:2.0:1788528471.231623:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735499008 00000100:00100000:2.0:1788528471.231670:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788528471.231678:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735499008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528471.231937:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528471.231970:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735499392:0@lo:400:kworker.0 00000100:00100000:0.0:1788528471.231994:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528471.232017:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735499904:0@lo:400:kworker.0 00000100:00100000:0.0:1788528471.232092:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528471.232125:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735500416:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788528471.232150:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528471.232197:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735499520 00000100:00100000:0.0:1788528471.232201:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735499520 00000100:00100000:0.0:1788528471.232233:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735500032 00000100:00100000:0.0:1788528471.232236:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735500032 00000100:00100000:0.0:1788528471.232247:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735498880 00000100:00100000:0.0:1788528471.232249:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735498880 00000100:00100000:0.0:1788528471.232272:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735499392 00000100:00100000:0.0:1788528471.232275:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735499392 00000100:00100000:0.0:1788528471.232286:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735499904 00000100:00100000:0.0:1788528471.232288:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735499904 00000100:00100000:0.0:1788528471.232300:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788528471.232305:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735499520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528471.232340:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735499520:12345-0@lo:400:kworker.0 Request processed in 34us (1351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528471.232347:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788528471.232361:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788528471.232367:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735500032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528471.232392:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735500032:12345-0@lo:400:kworker.0 Request processed in 26us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528471.232397:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788528471.232407:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788528471.232412:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735498880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528471.232444:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735498880:12345-0@lo:400:kworker.0 Request processed in 32us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528471.232450:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788528471.232461:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788528471.232467:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735499392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528471.232493:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735499392:12345-0@lo:400:kworker.0 Request processed in 27us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528471.232499:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788528471.232510:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788528471.232516:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735499904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528471.232576:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735499904:12345-0@lo:400:kworker.0 Request processed in 59us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528471.232582:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788528471.232603:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735500416 00000100:00100000:0.0:1788528471.232607:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735500416 00000100:00100000:0.0:1788528471.232624:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788528471.232630:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1875407735500416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788528471.232656:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788528471.232688:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1875407735500416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528471.232694:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:0.0:1788528471.232710:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788528471.232713:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788528471.232748:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735500416:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788528471.232760:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735498880:0@lo:400:kworker.0 00000100:00100000:0.0:1788528471.232769:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735499392:0@lo:400:kworker.0 00000100:00100000:0.0:1788528471.232777:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735499904:0@lo:400:kworker.0 00000100:00100000:1.0:1788528471.233204:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528471.233247:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735499264:0@lo:400:kworker.0 00000100:00100000:1.0:1788528471.233276:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528471.233292:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe6e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735499776:0@lo:400:kworker.0 00000100:00100000:1.0:1788528471.233316:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528471.233335:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735500288:0@lo:400:kworker.0 00000100:00100000:1.0:1788528471.233356:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528471.233390:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735499776 00000100:00100000:1.0:1788528471.233395:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735499776 00000100:00100000:1.0:1788528471.233429:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735500288 00000100:00100000:1.0:1788528471.233433:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735500288 00000100:00100000:1.0:1788528471.233465:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788528471.233473:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c96ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735499776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528471.233513:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c96ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735499776:12345-0@lo:400:kworker.0 Request processed in 41us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528471.233519:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788528471.233532:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788528471.233538:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc30adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735500288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528471.233588:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc30adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735500288:12345-0@lo:400:kworker.0 Request processed in 50us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528471.233607:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788528471.233643:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe6e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735499776:0@lo:400:kworker.0 00000100:00100000:1.0:1788528471.233653:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735500288:0@lo:400:kworker.0 00000100:00100000:1.0:1788528471.233710:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735499264 00000100:00100000:1.0:1788528471.233714:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735499264 00000100:00100000:1.0:1788528471.233734:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788528471.233740:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c96c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735499264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528471.233776:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c96c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735499264:12345-0@lo:400:kworker.0 Request processed in 37us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528471.233782:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788528471.233801:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735499136:0@lo:400:kworker.0 00000100:00100000:1.0:1788528471.233827:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528471.233843:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735499648:0@lo:400:kworker.0 00000100:00100000:1.0:1788528471.233863:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528471.233877:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735500160:0@lo:400:kworker.0 00000100:00100000:1.0:1788528471.233895:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528471.233907:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735500672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788528471.233944:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528471.233962:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788528471.233967:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735500544:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788528471.233985:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528471.234016:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735499648 00000100:00100000:1.0:1788528471.234020:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735499648 00000100:00100000:1.0:1788528471.234050:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735500160 00000100:00100000:1.0:1788528471.234061:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735500160 00000100:00100000:1.0:1788528471.234082:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788528471.234087:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735499648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528471.234120:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735499648:12345-0@lo:400:kworker.0 Request processed in 32us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528471.234125:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788528471.234136:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788528471.234141:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735500160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528471.234164:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735500160:12345-0@lo:400:kworker.0 Request processed in 24us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528471.234169:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788528471.234188:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735500672 00000100:00100000:1.0:1788528471.234191:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735500672 00000100:00100000:1.0:1788528471.234208:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735500544 00000100:00100000:1.0:1788528471.234211:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735500544 00000100:00100000:1.0:1788528471.234221:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788528471.234226:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735500672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788528471.234246:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788528471.234275:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735500672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528471.234280:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788528471.234292:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788528471.234297:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735500544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788528471.234306:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788528471.234328:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735500544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 31us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528471.234334:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788528471.234374:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735500544:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788528471.234384:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735499648:0@lo:400:kworker.0 00000100:00100000:1.0:1788528471.234392:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735500160:0@lo:400:kworker.0 00000100:00100000:1.0:1788528471.234401:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735500672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788528471.234429:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735499264:0@lo:400:kworker.0 00000100:00100000:1.0:1788528471.234466:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735499136 00000100:00100000:1.0:1788528471.234469:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735499136 00000100:00100000:1.0:1788528471.234493:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1788528471.234499:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe6e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735499136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528471.234532:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe6e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735499136:12345-0@lo:400:kworker.0 Request processed in 33us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528471.234538:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1788528471.234592:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f5a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735499136:0@lo:400:kworker.0 00000100:00100000:0.0:1788528471.235872:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735498752 00000100:00100000:0.0:1788528471.235882:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735498752 00000100:00100000:0.0:1788528471.235943:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:0.0:1788528471.235951:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735498752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528471.236022:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735498752:12345-0@lo:400:kworker.0 Request processed in 72us (2820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528471.236029:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00080000:0.0:1788528471.236080:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788528471.236085:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788528471.236117:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc374c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735498752:0@lo:400:kworker.0 00000100:00100000:2.0:1788528471.237633:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735499008:12345-0@lo:400:kworker.0 Request processed in 5950us (6725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528471.237646:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00010000:00080000:3.0:1788528471.245192:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc44ad500 x1875407735500032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528471.245225:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735500032:0@lo:400:kworker.0 00000100:00100000:3.0:1788528471.245265:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735499008:0@lo:400:kworker.0 00010000:00080000:3.0:1788528471.245276:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6ef4e00 x1875407735499520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528471.245284:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735499520:0@lo:400:kworker.0 00000040:00080000:1.0:1788528471.304233:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788528471.304242:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788528471.304758:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788528471.304768:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788528472.195701:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528472.254974:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788528472.255004:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735500800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788528472.255093:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528472.255194:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735500800 00000100:00100000:1.0:1788528472.255204:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735500800 00000100:00100000:1.0:1788528472.255264:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788528472.255274:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735500800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788528472.255308:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528472.255362:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735500800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528472.255384:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788528472.255483:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735500800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788528472.256229:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735500928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788528472.256274:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528472.256362:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735500928 00000100:00100000:1.0:1788528472.256369:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735500928 00000100:00100000:1.0:1788528472.256409:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788528472.256415:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735500928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788528472.256434:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528472.256468:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735500928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528472.256475:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788528472.256536:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735500928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788528472.362983:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528472.363064:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719701760 00000100:00100000:3.0:1788528472.363079:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719701760 00000100:00100000:3.0:1788528472.363168:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 153 00000100:00100000:3.0:1788528472.363182:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+13:12188:x1875407719701760:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1788528472.363203:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528472.363224:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c8410 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfe82 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.363290:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8417 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.363305:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8417 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.363317:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8417 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.363334:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c841e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.363342:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c841e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.363363:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c841e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.363408:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8417 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.363415:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8417 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.363421:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8417 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.363426:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528472.363430:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8417 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.363438:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8417 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.363450:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90d5d08500) 00010000:00010000:3.0:1788528472.363453:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528472.363458:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8417 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.363465:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8417 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.363478:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c841e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.363485:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c841e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.363499:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c841e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.363505:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428e00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528472.363508:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c841e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.363515:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c841e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.363524:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8a8fc1fa8e00) 00010000:00010000:3.0:1788528472.363527:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528472.363530:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c841e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.363537:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c841e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.363609:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c8410 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe82 expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.363621:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90d5d08500) 00010000:00010000:3.0:1788528472.363624:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528472.363628:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c8410 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe82 expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.363639:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3429e00, rc 0) 00000100:00100000:3.0:1788528472.363717:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+13:12188:x1875407719701760:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 538us (743us total) trans 0 rc 301/301 00000100:00100000:3.0:1788528472.363735:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 153 00000100:00080000:0.0:1788528472.367837:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788528472.373425:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528472.373510:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719702016 00000100:00100000:2.0:1788528472.373528:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719702016 00000100:00100000:2.0:1788528472.373638:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 154 00000100:00100000:2.0:1788528472.373651:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+13:12188:x1875407719702016:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:2.0:1788528472.373724:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528472.373760:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c7d64 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfca6 expref: 13 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.373781:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90d5d08500) 00010000:00010000:2.0:1788528472.373787:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788528472.373862:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c8425 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.373878:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c83e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe74 expref: 5 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.373888:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c8425 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.373940:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c83e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe74 expref: 5 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.373957:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c83e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe74 expref: 5 pid: 6509 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528472.373973:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6510:1875407735501056:192.168.203.38@tcp:104: 00000100:00100000:2.0:1788528472.374098:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90ce872b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788528472.375635:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6510:1875407735501056:192.168.203.38@tcp:104: 00010000:00010000:2.0:1788528472.375667:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c8425 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528472.379890:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528472.380127:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719702144 00000100:00100000:3.0:1788528472.380140:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719702144 00010000:00010000:3.0:1788528472.380244:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c83e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe74 expref: 6 pid: 6509 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528472.380300:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 84 00000100:00100000:3.0:1788528472.380312:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:2403:x1875407719702144:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788528472.380331:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528472.380340:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c83e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe74 expref: 6 pid: 6509 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.380364:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c83e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe74 expref: 6 pid: 6509 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.380393:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c83e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe74 expref: 6 pid: 6509 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.380411:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90d5d08500) 00010000:00010000:3.0:1788528472.380418:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c8425 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.380430:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c8425 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.380439:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c8425 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.380482:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528472.380580:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719702144:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 244us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528472.380589:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 84 00010000:00010000:3.0:1788528472.380631:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c8425 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.380641:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c8425 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.380669:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c842c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.380683:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c842c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.380692:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c842c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.381407:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8433 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.381424:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8433 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.381433:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8433 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788528472.381452:0:6510:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf868a52 reply state 000000004c8c5215 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8433 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.381478:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8433 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.381486:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:3.0:1788528472.381489:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788528472.381493:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788528472.381500:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788528472.381509:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c8425 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.381517:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c8425 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.381525:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c8425 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.381533:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3b600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528472.381537:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c8425 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.381547:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c8425 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.381595:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90d5d08500) 00010000:00010000:3.0:1788528472.381598:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528472.381602:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c8425 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.381609:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c8425 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788528472.381641:0:6510:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf868a52 reply state 000000004c8c5215 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c842c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.381650:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c842c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.381658:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8a8fc1fa8e00) 00010000:00010000:3.0:1788528472.381660:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788528472.381663:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788528472.381738:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+14:12188:x1875407719702016:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 8087us (8321us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1788528472.381747:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 154 00000100:00080000:0.0:1788528472.382075:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788528472.458007:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528472.458116:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719702272 00000100:00100000:0.0:1788528472.458129:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719702272 00000100:00100000:0.0:1788528472.458196:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 155 00000100:00100000:0.0:1788528472.458207:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+14:12196:x1875407719702272:12345-192.168.203.38@tcp:101:lctl.0 00010000:00010000:0.0:1788528472.458241:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528472.458273:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c843a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfe89 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.458353:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c8441 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.458369:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c8441 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.458383:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c8441 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788528472.458441:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788528472.458445:0:6508:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788528472.458474:0:6508:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c8441 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.458502:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c843a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe89 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.458543:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c8441 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe89 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.458572:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:0.0:1788528472.458576:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788528472.458581:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031c00, rc 0) 00000100:00100000:0.0:1788528472.458650:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+15:12196:x1875407719702272:12345-192.168.203.38@tcp:101:lctl.0 Request processed in 444us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528472.458659:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 155 00000100:00100000:3.0:1788528472.506302:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528472.506752:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719702400 00000100:00100000:2.0:1788528472.506766:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719702400 00000100:00100000:2.0:1788528472.506852:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 156 00000100:00100000:2.0:1788528472.506864:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+15:12202:x1875407719702400:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:2.0:1788528472.506890:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528472.506925:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c8448 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfe90 expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.507010:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c844f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.507194:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c844f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.507211:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c844f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.507226:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8456 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.507235:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8456 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.507242:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8456 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.507347:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c845d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.507699:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c845d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.507728:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c845d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528472.507837:0:13480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788528472.507841:0:13480:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788528472.507868:0:13480:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c845d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.507883:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c844f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.507890:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c844f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.507898:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c844f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.507915:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528472.507920:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c844f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.507930:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c844f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.507946:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:2.0:1788528472.507950:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528472.507955:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c844f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.507962:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c844f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.507989:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8456 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.507995:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8456 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.508000:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8456 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.508005:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3be00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528472.508008:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8456 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.508014:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8456 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.508023:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8a8fc1fa8e00) 00010000:00010000:2.0:1788528472.508025:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528472.508162:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8456 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.508170:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8456 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.508208:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c8448 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe90 expref: 17 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.508223:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c845d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe90 expref: 16 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.508243:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:2.0:1788528472.508245:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788528472.508248:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3a800, rc 0) 00000100:00100000:2.0:1788528472.508373:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+16:12202:x1875407719702400:12345-192.168.203.38@tcp:101:bash.0 Request processed in 1510us (2084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528472.508381:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 156 00000100:00100000:0.0:1788528472.516124:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528472.516222:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719702656 00000100:00100000:3.0:1788528472.516235:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719702656 00000100:00100000:3.0:1788528472.516310:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 157 00000100:00100000:3.0:1788528472.516322:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+16:12202:x1875407719702656:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:3.0:1788528472.516353:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528472.516381:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8464 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfe97 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.516515:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c846b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.516534:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c846b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.516547:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c846b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.517114:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c8472 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.517125:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c8472 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.517133:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c8472 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788528472.517623:0:6510:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788528472.517891:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8479 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.517903:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8479 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.517922:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8479 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.517969:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c846b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.517977:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c846b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.517996:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c846b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.518003:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3429400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528472.518008:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c846b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.518018:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c846b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.518034:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:2.0:1788528472.518037:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528472.518044:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c846b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.518051:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c846b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788528472.518069:0:6510:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d857d07 reply state 00000000af9a73f0 transno 4294967420 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c8472 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.518082:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c8472 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.518088:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a8fc3770900) 00010000:00010000:2.0:1788528472.518091:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788528472.518094:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788528472.518140:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8464 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe97 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.518157:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8479 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe97 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.518171:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770200) 00010000:00010000:2.0:1788528472.518174:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788528472.518177:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3a000, rc 0) 00000100:00100000:2.0:1788528472.518268:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+19:12202:x1875407719702656:12345-192.168.203.38@tcp:101:bash.0 Request processed in 1947us (2158us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788528472.518278:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 157 00000100:00100000:2.0:1788528472.522258:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528472.522347:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719702784 00000100:00100000:1.0:1788528472.522360:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719702784 00000100:00100000:1.0:1788528472.522465:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 55 00000100:00100000:1.0:1788528472.522477:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2404:x1875407719702784:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:1.0:1788528472.522500:0:8725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528472.522524:0:8725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d809a420/0x892c60dda91c8487 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfe9e expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788528472.522596:0:8725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788528472.522623:0:8725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=341s v=(0 0) 00010000:00010000:1.0:1788528472.522629:0:8725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788528472.522641:0:8725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d809a420/0x892c60dda91c8487 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe9e expref: 6 pid: 8725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.522664:0:8725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d809a420/0x892c60dda91c8487 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe9e expref: 6 pid: 8725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.522706:0:8725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e16800, rc 0) 00000100:00100000:1.0:1788528472.522784:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2404:x1875407719702784:12345-192.168.203.38@tcp:101:bash.0 Request processed in 308us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528472.522792:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 55 00000100:00080000:0.0:1788528472.523023:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788528472.525711:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528472.526000:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719702912 00000100:00100000:1.0:1788528472.526012:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719702912 00000100:00100000:1.0:1788528472.526178:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:1.0:1788528472.526190:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4653100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:12202:x1875407719702912:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:1.0:1788528472.526213:0:8422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528472.526237:0:8422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba08a800/0x892c60dda91c848e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfea5 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.526280:0:8422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d809a420/0x892c60dda91c8487 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe9e expref: 7 pid: 8725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.526291:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788528472.526296:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788528472.526302:0:8422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba08a800/0x892c60dda91c848e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfea5 expref: 7 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.526345:0:8422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d809a420/0x892c60dda91c8487 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe9e expref: 7 pid: 8725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.526362:0:8422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d809a420/0x892c60dda91c8487 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe9e expref: 7 pid: 8725 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528472.526400:0:8422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8422:1875407735501184:192.168.203.38@tcp:104: 00000100:00100000:1.0:1788528472.526517:0:8422:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3eef480 going to sleep for 11 seconds 00000100:00100000:2.0:1788528472.529635:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528472.529756:0:8422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8422:1875407735501184:192.168.203.38@tcp:104: 00010000:00010000:1.0:1788528472.529802:0:8422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ba08a800/0x892c60dda91c848e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfea5 expref: 7 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.529829:0:8422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e17a00, rc 0) 00000100:00100000:1.0:1788528472.529927:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4653100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:12202:x1875407719702912:12345-192.168.203.38@tcp:101:bash.0 Request processed in 3738us (4230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528472.529937:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:0.0:1788528472.530305:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719703040 00000100:00100000:0.0:1788528472.530316:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719703040 00010000:00010000:0.0:1788528472.530359:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d809a420/0x892c60dda91c8487 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe9e expref: 7 pid: 8725 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528472.530394:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 85 00000100:00100000:0.0:1788528472.530477:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2404:x1875407719703040:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788528472.530501:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528472.530529:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d809a420/0x892c60dda91c8487 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe9e expref: 7 pid: 8725 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.530545:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d809a420/0x892c60dda91c8487 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe9e expref: 7 pid: 8725 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.530698:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d809a420/0x892c60dda91c8487 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe9e expref: 7 pid: 8725 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.530715:0:6494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788528472.530720:0:6494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788528472.530731:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba08a800/0x892c60dda91c848e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfea5 expref: 6 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.530742:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba08a800/0x892c60dda91c848e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfea5 expref: 6 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.530781:0:6494:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ba08a800/0x892c60dda91c848e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfea5 expref: 6 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528472.530801:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6494:1875407735501312:192.168.203.38@tcp:105: 00000100:00100000:0.0:1788528472.530941:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3922c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788528472.542604:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528472.542795:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719703296 00000100:00100000:3.0:1788528472.542808:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719703296 00000100:00100000:3.0:1788528472.542881:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:3.0:1788528472.542895:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+19:12202:x1875407719703296:12345-192.168.203.38@tcp:35:bash.0 00000100:00100000:3.0:1788528472.543328:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+20:12202:x1875407719703296:12345-192.168.203.38@tcp:35:bash.0 Request processed in 432us (738us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1788528472.543338:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:0.0:1788528472.544788:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6494:1875407735501312:192.168.203.38@tcp:105: 00010000:00010000:0.0:1788528472.544820:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528472.548867:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2404:x1875407719703040:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 18373us (19227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528472.548886:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 85 00000100:00100000:2.0:1788528472.642342:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528472.643068:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719703552 00000100:00100000:0.0:1788528472.643080:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719703552 00000100:00100000:0.0:1788528472.643302:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 158 00000100:00100000:0.0:1788528472.643313:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+20:12212:x1875407719703552:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1788528472.643338:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528472.643359:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c8495 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfeac expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788528472.643984:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788528472.644293:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c8495 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfeac expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.644309:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:0.0:1788528472.644312:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788528472.644317:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c8495 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfeac expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.644331:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0030800, rc 0) 00000100:00100000:0.0:1788528472.644772:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+21:12212:x1875407719703552:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 1458us (3733us total) trans 4294967422 rc 301/301 00000100:00100000:0.0:1788528472.644781:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 158 00000100:00100000:2.0:1788528472.651370:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528472.651591:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719703808 00000100:00100000:1.0:1788528472.651602:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719703808 00000100:00100000:1.0:1788528472.651658:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:1.0:1788528472.651669:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+21:12212:x1875407719703808:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:1.0:1788528472.652060:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+22:12212:x1875407719703808:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 391us (697us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1788528472.652067:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:1.0:1788528472.709824:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528472.710021:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719703936 00000100:00100000:2.0:1788528472.710030:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719703936 00000100:00100000:2.0:1788528472.710105:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 159 00000100:00100000:2.0:1788528472.710115:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+22:12218:x1875407719703936:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1788528472.710147:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528472.710168:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c84a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfeb3 expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.710233:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c84aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.710249:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c84aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.710261:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c84aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528472.710319:0:13480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788528472.710323:0:13480:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788528472.710343:0:13480:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c84aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.710368:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c84a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfeb3 expref: 24 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.710386:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c84aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfeb3 expref: 23 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.710395:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:2.0:1788528472.710399:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788528472.710402:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3b600, rc 0) 00000100:00100000:2.0:1788528472.710679:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+23:12218:x1875407719703936:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 564us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528472.710687:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 159 00000100:00100000:2.0:1788528472.721778:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528472.721889:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719704192 00000100:00100000:0.0:1788528472.721899:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719704192 00000100:00100000:0.0:1788528472.721969:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 160 00000100:00100000:0.0:1788528472.721981:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+23:12218:x1875407719704192:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1788528472.722002:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528472.722024:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c84b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfeba expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.722145:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c84b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.722160:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c84b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.722189:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c84b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788528472.722201:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788528472.722307:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c84b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfeba expref: 26 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.722327:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c84b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfeba expref: 25 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.722336:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770200) 00010000:00010000:0.0:1788528472.722339:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788528472.722342:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031e00, rc 0) 00000100:00100000:0.0:1788528472.722420:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+25:12218:x1875407719704192:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 441us (652us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1788528472.722427:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 160 00000100:00100000:3.0:1788528472.726025:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528472.726111:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528472.726601:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719704448 00000100:00100000:2.0:1788528472.726610:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719704448 00000100:00100000:2.0:1788528472.726674:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:2.0:1788528472.726689:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4653b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+25:2406:x1875407719704448:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528472.726704:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528472.726727:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c84b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfeba expref: 25 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.726747:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770200) 00010000:00010000:2.0:1788528472.726766:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528472.726818:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4653b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+24:2406:x1875407719704448:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 136us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528472.726827:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:0.0:1788528472.727128:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719704576 00000100:00100000:0.0:1788528472.727134:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719704576 00000100:00100000:0.0:1788528472.727172:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 161 00000100:00100000:0.0:1788528472.727180:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+24:12218:x1875407719704576:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1788528472.727198:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528472.727215:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c84c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfec1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.727306:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c84cd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.727330:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c84cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.727341:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c84cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788528472.727353:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788528472.727447:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c84c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfec1 expref: 27 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.727462:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c84cd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfec1 expref: 26 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.727469:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770200) 00010000:00010000:0.0:1788528472.727472:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788528472.727475:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031400, rc 0) 00000100:00100000:0.0:1788528472.727510:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+26:12218:x1875407719704576:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 330us (1399us total) trans 4294967425 rc 0/0 00000100:00100000:0.0:1788528472.727516:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 161 00000100:00100000:3.0:1788528472.739122:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528472.739224:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719704704 00000100:00100000:2.0:1788528472.739234:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719704704 00000100:00100000:2.0:1788528472.739292:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:2.0:1788528472.739302:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4651c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2404:x1875407719704704:12345-192.168.203.38@tcp:1:lfs.0 00010000:00010000:2.0:1788528472.739346:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d5c23f/0x892c60dda91c84db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.739366:0:8421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba08a800/0x892c60dda91c848e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfea5 expref: 6 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.739375:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528472.739380:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788528472.739385:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d5c23f/0x892c60dda91c84db lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.739421:0:8421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba08a800/0x892c60dda91c848e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfea5 expref: 6 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.739434:0:8421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba08a800/0x892c60dda91c848e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfea5 expref: 6 pid: 8422 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528472.739447:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8421:1875407735501440:192.168.203.38@tcp:104: 00000100:00100000:2.0:1788528472.739531:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c133a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528472.746266:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528472.746384:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8421:1875407735501440:192.168.203.38@tcp:104: 00010000:00010000:2.0:1788528472.746409:0:8421:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000061d5c23f/0x892c60dda91c84db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528472.746522:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719704832 00000100:00100000:1.0:1788528472.746530:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719704832 00002000:00100000:1.0:1788528472.746622:0:8428:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8a90c81a0700 x1875407719704832/t0(0) o4->80304108-f3b9-46ea-888c-b2a7ec20e3e2@192.168.203.38@tcp:678/0 lens 504/0 e 0 to 0 dl 1788528483 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788528472.746632:0:8428:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a90c81a0700 with x1875407719704832 ext(0->12) 00010000:00010000:1.0:1788528472.746639:0:8428:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ba08a800/0x892c60dda91c848e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfea5 expref: 7 pid: 8422 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.746654:0:8428:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ba08a800/0x892c60dda91c848e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfea5 expref: 7 pid: 8422 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788528472.746663:0:8428:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a90c81a0700 00000100:00100000:1.0:1788528472.746686:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:1.0:1788528472.746695:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2403:x1875407719704832:12345-192.168.203.38@tcp:4:lfs.0 00000100:00100000:1.0:1788528472.752591:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+9:2403:x1875407719704832:12345-192.168.203.38@tcp:4:lfs.0 Request processed in 5885us (6323us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788528472.752606:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 2 00002000:00100000:1.0:1788528472.752619:0:8428:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8a90c81a0700 x1875407719704832/t4294967306(0) o4->80304108-f3b9-46ea-888c-b2a7ec20e3e2@192.168.203.38@tcp:678/0 lens 504/448 e 0 to 0 dl 1788528483 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788528472.752630:0:8428:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a90c81a0700 with x1875407719704832 ext(0->12) 00010000:00010000:1.0:1788528472.752640:0:8428:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ba08a800/0x892c60dda91c848e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfea5 expref: 9 pid: 8422 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.752714:0:8428:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ba08a800/0x892c60dda91c848e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfea5 expref: 9 pid: 8422 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788528472.752723:0:8428:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a90c81a0700 00000100:00100000:1.0:1788528472.758016:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528472.758095:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719704960 00000100:00100000:0.0:1788528472.758105:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719704960 00010000:00010000:0.0:1788528472.758145:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba08a800/0x892c60dda91c848e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfea5 expref: 9 pid: 8422 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528472.758190:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 86 00000100:00100000:0.0:1788528472.758200:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90efa84850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+9:2404:x1875407719704960:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788528472.758233:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788528472.758251:0:6493:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788528472.758254:0:6493:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788528472 00002000:00010000:0.0:1788528472.758256:0:6493:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788528472 00002000:00010000:0.0:1788528472.758258:0:6493:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788528472 00002000:00010000:0.0:1788528472.758260:0:6493:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788528472.758267:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba08a800/0x892c60dda91c848e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfea5 expref: 9 pid: 8422 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.758280:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba08a800/0x892c60dda91c848e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfea5 expref: 9 pid: 8422 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.758303:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba08a800/0x892c60dda91c848e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfea5 expref: 9 pid: 8422 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.758319:0:6493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788528472.758323:0:6493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788528472.758329:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061d5c23f/0x892c60dda91c84db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.758339:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d5c23f/0x892c60dda91c84db lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.758373:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528472.758428:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90efa84850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:2404:x1875407719704960:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 229us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528472.758435:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 86 00010000:00010000:2.0:1788528472.758542:0:8421:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000061d5c23f/0x892c60dda91c84db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.758589:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061d5c23f/0x892c60dda91c84db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.758610:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d5c23f/0x892c60dda91c84db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.758620:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061d5c23f/0x892c60dda91c84db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.758629:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061d5c23f/0x892c60dda91c84db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.758637:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3ba00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528472.758641:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d5c23f/0x892c60dda91c84db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.758651:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d5c23f/0x892c60dda91c84db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.758676:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061d5c23f/0x892c60dda91c84db lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.758685:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061d5c23f/0x892c60dda91c84db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528472.758732:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4651c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2404:x1875407719704704:12345-192.168.203.38@tcp:1:lfs.0 Request processed in 19431us (19620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528472.758740:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:3.0:1788528472.764158:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528472.767348:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719705216 00000100:00100000:2.0:1788528472.767362:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719705216 00000100:00100000:2.0:1788528472.767432:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 38 00000100:00100000:2.0:1788528472.767446:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e17450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+26:12218:x1875407719705216:12345-192.168.203.38@tcp:35:lfs.0 00000004:00010000:2.0:1788528472.767502:0:6512:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c84cd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfec1 expref: 26 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788528472.767676:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788528472.767704:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:2.0:1788528472.767983:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00010000:00010000:2.0:1788528472.768020:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c84e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.768034:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8479 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe97 expref: 30 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.768043:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c84e2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.768090:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8479 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe97 expref: 30 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.768104:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8479 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe97 expref: 30 pid: 6510 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528472.768119:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6512:1875407735501568:192.168.203.38@tcp:104: 00000100:00100000:2.0:1788528472.768213:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f5906180 going to sleep for 11 seconds 00000100:00100000:1.0:1788528472.773217:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528472.773333:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6512:1875407735501568:192.168.203.38@tcp:104: 00010000:00010000:2.0:1788528472.773360:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c84e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528472.774063:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719705344 00000100:00100000:0.0:1788528472.774071:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719705344 00010000:00010000:0.0:1788528472.774106:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8479 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe97 expref: 31 pid: 6510 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528472.774155:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 87 00000100:00100000:0.0:1788528472.774164:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+31:2403:x1875407719705344:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788528472.774178:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528472.774185:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8479 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe97 expref: 31 pid: 6510 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.774198:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8479 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe97 expref: 31 pid: 6510 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.774219:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8479 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe97 expref: 31 pid: 6510 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.774235:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770200) 00010000:00010000:0.0:1788528472.774241:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c84e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.774249:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c84e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.774257:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c84e2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.774287:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528472.774341:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+30:2403:x1875407719705344:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 178us (1133us total) trans 0 rc 0/0 00010000:00010000:2.0:1788528472.774342:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c84e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.774349:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c84e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528472.774361:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 87 00000001:00080000:2.0:1788528472.774465:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000001:00080000:2.0:1788528472.774614:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1788528472.774692:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6512:1875407735501696:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788528472.774741:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528472.774784:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f5906300 going to sleep for 11 seconds 00000100:00100000:1.0:1788528472.775356:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735501696 00000100:00100000:1.0:1788528472.775363:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735501696 00000100:00100000:1.0:1788528472.775414:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788528472.775423:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6512:x1875407735501696:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788528472.775503:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6512:x1875407735501696:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 82us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528472.775510:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788528472.775689:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6512:1875407735501696:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788528472.776495:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00000100:00100000:2.0:1788528472.776585:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6512:1875407735501824:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788528472.776643:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528472.776665:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f5906900 going to sleep for 11 seconds 00000100:00100000:1.0:1788528472.776732:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735501824 00000100:00100000:1.0:1788528472.776738:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735501824 00000100:00100000:1.0:1788528472.776783:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788528472.776791:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6512:x1875407735501824:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788528472.777061:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6512:x1875407735501824:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 270us (417us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788528472.777069:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788528472.778164:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6512:1875407735501824:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788528472.778226:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1788528472.778272:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c84e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.778283:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c84e2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.778290:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c84e2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.778298:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3be00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528472.778302:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c84e2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.778325:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c84e2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.778342:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770200) 00010000:00010000:3.0:1788528472.778345:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788528472.778351:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c84e2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.778497:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c84e2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788528472.778701:0:6512:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788528472.778759:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1788528472.778840:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 341996285510ns, next at 342996283321ns, rc = 0 00000001:00080000:3.0:1788528472.778849:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967433 00010000:00010000:3.0:1788528472.778874:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770200) 00010000:00010000:3.0:1788528472.778877:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788528472.778884:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c84cd lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfec1 expref: 34 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528472.779349:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e17450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+33:12218:x1875407719705216:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 11902us (15198us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1788528472.779370:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 38 00000020:00080000:3.0:1788528472.779376:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788528472.781658:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528472.781765:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719705472 00000100:00100000:2.0:1788528472.781784:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719705472 00000100:00100000:2.0:1788528472.781842:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 162 00000100:00100000:2.0:1788528472.781851:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+33:12218:x1875407719705472:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1788528472.781871:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528472.781890:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c84e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfec8 expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.781951:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c84e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfec8 expref: 34 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.781964:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c84e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfec8 expref: 34 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528472.781983:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:2.0:1788528472.781986:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788528472.782179:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3ba00, rc 0) 00000100:00100000:2.0:1788528472.782238:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+34:12218:x1875407719705472:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 387us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528472.782244:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 162 00000100:00100000:1.0:1788528472.784875:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528472.785343:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719705728 00000100:00100000:2.0:1788528472.785352:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719705728 00000100:00100000:2.0:1788528472.785537:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:2.0:1788528472.785548:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+34:12218:x1875407719705728:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:2.0:1788528472.785818:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+35:12218:x1875407719705728:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 266us (945us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788528472.785841:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:3.0:1788528472.865777:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528472.865939:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719705984 00000100:00100000:0.0:1788528472.865950:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719705984 00000100:00100000:0.0:1788528472.866008:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 163 00000100:00100000:0.0:1788528472.866018:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+35:12229:x1875407719705984:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1788528472.866041:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528472.866061:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c84f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfecf expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788528472.866155:0:8449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788528472.866252:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c84f0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfecf expref: 37 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.866266:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:0.0:1788528472.866269:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788528472.866275:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c84f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfecf expref: 37 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528472.866289:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031600, rc 0) 00000100:00100000:0.0:1788528472.866366:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+36:12229:x1875407719705984:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 339us (600us total) trans 4294967436 rc 301/301 00000100:00100000:0.0:1788528472.866374:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 163 00000100:00100000:1.0:1788528472.869269:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528472.870177:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719706112 00000100:00100000:2.0:1788528472.870187:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719706112 00000100:00100000:3.0:1788528472.870463:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 164 00000100:00100000:3.0:1788528472.870475:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+36:12229:x1875407719706112:12345-192.168.203.38@tcp:34:lfs.0 00010000:00010000:3.0:1788528472.870569:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c84fe lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.870599:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c84fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.870612:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c84fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.870626:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8505 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.870633:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.870639:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.870711:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c850c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.870720:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c850c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.870727:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c850c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788528472.870788:0:6508:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c850c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.870801:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c84fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.870808:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c84fe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.870826:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c84fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.870832:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428c00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528472.870837:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c84fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.870844:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c84fe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.870856:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:3.0:1788528472.870859:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528472.870863:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c84fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.870869:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c84fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.870884:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.870890:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8505 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.870895:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8505 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.870899:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528472.870913:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8505 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.870929:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8505 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.870938:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a8fc3770900) 00010000:00010000:3.0:1788528472.870941:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528472.870944:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8505 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.870949:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8505 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.870958:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c850c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.870963:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c850c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.870969:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c850c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.870973:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528472.870976:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c850c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.870981:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c850c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.870988:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:3.0:1788528472.870990:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528472.870992:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c850c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.871007:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c850c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528472.871132:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+36:12229:x1875407719706112:12345-192.168.203.38@tcp:34:lfs.0 Request processed in 657us (1869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528472.871140:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 164 00000100:00100000:1.0:1788528472.874096:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528472.874176:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719706368 00000100:00100000:3.0:1788528472.874187:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719706368 00000100:00100000:3.0:1788528472.874245:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:3.0:1788528472.874256:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+36:12229:x1875407719706368:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:3.0:1788528472.874476:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+37:12229:x1875407719706368:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 221us (388us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788528472.874487:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:2.0:1788528472.914398:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528472.914516:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719706624 00000100:00100000:1.0:1788528472.914526:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719706624 00000100:00100000:1.0:1788528472.914721:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 165 00000100:00100000:1.0:1788528472.914737:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+37:12232:x1875407719706624:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1788528472.914762:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528472.914783:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17000/0x892c60dda91c8513 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfed6 expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.914894:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c851a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.914923:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c851a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.914934:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c851a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.914945:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8521 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.914951:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8521 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.914968:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8521 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.915259:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8528 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.915269:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8528 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.915276:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8528 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528472.915286:0:13480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788528472.915363:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c851a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.915381:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c851a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.915388:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c851a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.915393:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17c00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528472.915397:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c851a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.915404:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c851a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.915415:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:1.0:1788528472.915419:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528472.915423:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c851a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.915430:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c851a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.915444:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8521 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.915450:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8521 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.915456:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8521 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.915460:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528472.915470:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8521 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.915477:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8521 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.915485:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a8fc3770900) 00010000:00010000:1.0:1788528472.915487:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528472.915491:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8521 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.915497:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8521 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.915533:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17000/0x892c60dda91c8513 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfed6 expref: 40 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.915546:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8528 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfed6 expref: 39 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528472.915598:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:1.0:1788528472.915600:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788528472.915603:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e17800, rc 0) 00000100:00100000:1.0:1788528472.916121:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+39:12232:x1875407719706624:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 1389us (1730us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1788528472.916131:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 165 00000100:00100000:1.0:1788528472.929786:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528472.929914:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719706752 00000100:00100000:3.0:1788528472.929923:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719706752 00000100:00100000:3.0:1788528472.930167:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 166 00000100:00100000:3.0:1788528472.930180:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+39:12232:x1875407719706752:12345-192.168.203.38@tcp:54:lfs.0 00010000:00010000:3.0:1788528472.930251:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8536 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.930268:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8536 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.930279:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8536 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.930312:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8536 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.930332:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8536 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.930339:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8536 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.930344:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528472.930349:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8536 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.930357:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8536 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.930369:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:3.0:1788528472.930372:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788528472.930377:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8536 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528472.930382:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c8536 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528472.930469:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+39:12232:x1875407719706752:12345-192.168.203.38@tcp:54:lfs.0 Request processed in 292us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528472.930477:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 166 00000100:00100000:0.0:1788528472.936925:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528472.937386:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719707008 00000100:00100000:1.0:1788528472.937396:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719707008 00000100:00100000:1.0:1788528472.937455:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:1.0:1788528472.937510:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+39:12232:x1875407719707008:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:1.0:1788528472.937762:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+40:12232:x1875407719707008:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 275us (858us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1788528472.937784:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 41 00010000:00010000:0.0:1788528473.216516:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528473.279668:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788528473.280677:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735501952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788528473.280835:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528473.280893:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735501952 00000100:00100000:0.0:1788528473.280911:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735501952 00000100:00100000:0.0:1788528473.281025:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788528473.281053:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735501952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788528473.281089:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:0.0:1788528473.281153:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735501952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528473.281160:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788528473.281247:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735501952:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788528473.290749:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528473.294319:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719707264 00000100:00100000:3.0:1788528473.294335:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719707264 00000100:00100000:3.0:1788528473.294418:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 167 00000100:00100000:3.0:1788528473.294428:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+40:12263:x1875407719707264:12345-192.168.203.38@tcp:101:cat.0 00010000:00010000:3.0:1788528473.294452:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528473.294490:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c853d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfedd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.294627:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8544 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.294643:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8544 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.294656:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8544 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528473.294667:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788528473.294772:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c853d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfedd expref: 43 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.294792:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8544 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfedd expref: 42 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.294801:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:3.0:1788528473.294805:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788528473.294808:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3428400, rc 0) 00000100:00100000:3.0:1788528473.294877:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+42:12263:x1875407719707264:12345-192.168.203.38@tcp:101:cat.0 Request processed in 449us (4137us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1788528473.294884:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 167 00000100:00100000:1.0:1788528473.307623:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528473.307826:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719707520 00000100:00100000:2.0:1788528473.307836:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719707520 00000100:00100000:2.0:1788528473.307950:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 42 00000100:00100000:2.0:1788528473.307962:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+42:12263:x1875407719707520:12345-192.168.203.38@tcp:35:cat.0 00000100:00100000:2.0:1788528473.308230:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+43:12263:x1875407719707520:12345-192.168.203.38@tcp:35:cat.0 Request processed in 269us (614us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788528473.308238:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 42 00000100:00100000:0.0:1788528473.311778:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528473.312448:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719707648 00000100:00100000:3.0:1788528473.312460:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719707648 00000100:00100000:3.0:1788528473.312532:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:3.0:1788528473.312543:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+43:2403:x1875407719707648:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788528473.312615:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528473.312641:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8544 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfedd expref: 43 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.312661:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:3.0:1788528473.312666:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528473.312717:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+42:2403:x1875407719707648:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 176us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528473.312725:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 11 00000040:00080000:3.0:1788528473.342881:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788528473.342890:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788528473.343004:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1788528473.343011:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788528473.398027:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528473.398161:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719707904 00000100:00100000:1.0:1788528473.398174:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719707904 00000100:00100000:1.0:1788528473.398253:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 168 00000100:00100000:1.0:1788528473.398265:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+42:12269:x1875407719707904:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:1.0:1788528473.398299:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528473.398302:0:13480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788528473.398337:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c84aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfeb3 expref: 42 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528473.398372:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:1.0:1788528473.398380:0:13480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788528473.398399:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c8552 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfee4 expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528473.398687:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8559 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528473.398704:0:13480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8528 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfed6 expref: 42 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528473.398843:0:13480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8559 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528473.398890:0:13480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8528 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfed6 expref: 42 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528473.398917:0:13480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8528 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfed6 expref: 42 pid: 13480 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528473.398937:0:13480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3e0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13480:1875407735502080:192.168.203.38@tcp:104: 00000100:00100000:1.0:1788528473.399069:0:13480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3eef3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528473.405308:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528473.405523:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719708032 00000100:00100000:3.0:1788528473.405536:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719708032 00010000:00010000:3.0:1788528473.405697:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8528 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfed6 expref: 43 pid: 13480 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528473.405891:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 88 00000100:00100000:3.0:1788528473.405917:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+43:2403:x1875407719708032:12345-192.168.203.38@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788528473.405924:0:13480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3e0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13480:1875407735502080:192.168.203.38@tcp:104: 00010000:00010000:3.0:1788528473.405940:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528473.405952:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8528 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfed6 expref: 43 pid: 13480 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.405959:0:13480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8559 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.405971:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8528 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfed6 expref: 43 pid: 13480 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.410246:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8528 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfed6 expref: 43 pid: 13480 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.410282:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:3.0:1788528473.410288:0:8441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8559 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.410304:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8559 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.410312:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8559 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.410499:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528473.410656:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+42:2403:x1875407719708032:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 4752us (5360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528473.410670:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 88 00010000:00010000:2.0:1788528473.412215:0:13480:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8559 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.412234:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8559 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528473.412265:0:13480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788528473.412514:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c8552 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfee4 expref: 43 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.412657:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8559 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfee4 expref: 42 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.412685:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:2.0:1788528473.412689:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788528473.412693:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e16600, rc 0) 00000100:00100000:2.0:1788528473.412950:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+42:12269:x1875407719707904:12345-192.168.203.38@tcp:101:dd.0 Request processed in 14685us (14936us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1788528473.412961:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 168 00000100:00100000:1.0:1788528473.416417:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528473.416503:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719708160 00000100:00100000:3.0:1788528473.416516:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719708160 00000100:00100000:3.0:1788528473.416750:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 169 00000100:00100000:3.0:1788528473.416770:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+42:12269:x1875407719708160:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:3.0:1788528473.416803:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528473.416828:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8567 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfeeb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.416869:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c856e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.416916:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c856e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.416930:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c856e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.417070:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8567 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfeeb expref: 44 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.417090:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c856e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfeeb expref: 43 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.417099:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:3.0:1788528473.417102:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788528473.417106:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3428200, rc 0) 00000100:00100000:3.0:1788528473.417177:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+43:12269:x1875407719708160:12345-192.168.203.38@tcp:101:dd.0 Request processed in 417us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528473.417185:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 169 00000100:00100000:0.0:1788528473.420653:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528473.421060:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719708416 00000100:00100000:3.0:1788528473.421073:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719708416 00000100:00100000:3.0:1788528473.421146:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 170 00000100:00100000:3.0:1788528473.421158:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+43:12269:x1875407719708416:12345-192.168.203.38@tcp:36:dd.0 00010000:00010000:3.0:1788528473.421450:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8575 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.421473:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8575 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.421510:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8575 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788528473.421884:0:6508:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1788528473.421926:0:6508:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ca6afdd reply state 000000004ad8e276 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8575 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.421942:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8575 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.421950:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:3.0:1788528473.421953:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788528473.421959:0:6508:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788528473.422241:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+46:12269:x1875407719708416:12345-192.168.203.38@tcp:36:dd.0 Request processed in 1082us (1611us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788528473.422251:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 170 00000020:00080000:3.0:1788528473.422257:0:6508:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788528473.652383:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528473.652502:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719708544 00000100:00100000:2.0:1788528473.652516:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719708544 00000100:00100000:2.0:1788528473.652619:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 171 00000100:00100000:2.0:1788528473.652630:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+46:12283:x1875407719708544:12345-192.168.203.38@tcp:101:stat.0 00010000:00010000:2.0:1788528473.652663:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528473.652699:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c857c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfef2 expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.652783:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8583 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.652800:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8583 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.652814:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8583 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.652827:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c858a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.652834:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c858a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.652859:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c858a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.652964:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8591 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.652976:0:13480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8559 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfee4 expref: 47 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.654445:0:13480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8591 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.654507:0:13480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8559 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfee4 expref: 47 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.654526:0:13480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8559 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfee4 expref: 47 pid: 13480 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528473.654545:0:13480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13480:1875407735502208:192.168.203.38@tcp:104: 00000100:00100000:2.0:1788528473.654765:0:13480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f59069c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528473.664968:0:13480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13480:1875407735502208:192.168.203.38@tcp:104: 00010000:00010000:2.0:1788528473.665005:0:13480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8591 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528473.665775:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528473.666215:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719708800 00000100:00100000:3.0:1788528473.666226:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719708800 00000100:00100000:3.0:1788528473.666301:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:3.0:1788528473.666314:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+48:6170:x1875407719708800:12345-192.168.203.38@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788528473.666736:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+49:6170:x1875407719708800:12345-192.168.203.38@tcp:35:ldlm_bl.0 Request processed in 423us (964us total) trans 4294967445 rc 0/0 00000100:00100000:3.0:1788528473.666745:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:1.0:1788528473.668484:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528473.668635:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719708928 00000100:00100000:0.0:1788528473.668646:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719708928 00010000:00010000:0.0:1788528473.668690:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8559 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfee4 expref: 49 pid: 13480 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528473.668735:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 89 00000100:00100000:0.0:1788528473.668745:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+49:2404:x1875407719708928:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788528473.668762:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528473.668770:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8559 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfee4 expref: 49 pid: 13480 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528473.668784:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8559 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfee4 expref: 49 pid: 13480 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528473.668813:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8559 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfee4 expref: 49 pid: 13480 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528473.668832:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:0.0:1788528473.668838:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8591 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528473.668870:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8591 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528473.668880:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8591 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528473.668928:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528473.668988:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+48:2404:x1875407719708928:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 243us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528473.668996:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 89 00010000:00010000:2.0:1788528473.670328:0:13480:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8591 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.670347:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8591 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528473.670433:0:13480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788528473.670439:0:13480:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788528473.670472:0:13480:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8591 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.670492:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8591 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.670504:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8583 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.670512:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8583 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.670521:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8583 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.670529:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528473.670534:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8583 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.670544:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8583 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.670590:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:2.0:1788528473.670595:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528473.670600:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8583 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.670609:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c8583 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.670635:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c858a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.670642:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c858a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.670648:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c858a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.670652:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3b600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528473.670655:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c858a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.670661:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c858a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.670669:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a8fc3770900) 00010000:00010000:2.0:1788528473.670671:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528473.670674:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c858a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.670680:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c858a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.670723:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c857c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfef2 expref: 48 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.670739:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8591 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfef2 expref: 47 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.670757:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:2.0:1788528473.670759:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788528473.670762:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3a200, rc 0) 00000100:00100000:2.0:1788528473.670844:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+47:12283:x1875407719708544:12345-192.168.203.38@tcp:101:stat.0 Request processed in 18215us (18475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528473.670853:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 171 00000040:00080000:1.0:1788528473.727343:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788528473.755851:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528473.755977:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719709184 00000100:00100000:3.0:1788528473.755991:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719709184 00000100:00100000:3.0:1788528473.756074:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 172 00000100:00100000:3.0:1788528473.756087:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+47:12289:x1875407719709184:12345-192.168.203.38@tcp:36:truncate.0 00010000:00010000:3.0:1788528473.756376:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528473.756479:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8591 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfef2 expref: 47 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.756505:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:3.0:1788528473.756512:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788528473.756794:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8598 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.756812:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8598 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.756823:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8598 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788528473.756873:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967446 00000004:00010000:3.0:1788528473.756905:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ecb8e51b reply state 00000000d948af10 transno 4294967447 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8598 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.756919:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8598 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.756925:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:3.0:1788528473.756928:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788528473.756930:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788528473.757049:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+49:12289:x1875407719709184:12345-192.168.203.38@tcp:36:truncate.0 Request processed in 964us (1214us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1788528473.757057:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 172 00000020:00080000:3.0:1788528473.757063:0:6509:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788528473.911116:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528473.911184:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719709312 00000100:00100000:3.0:1788528473.911221:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719709312 00000100:00100000:3.0:1788528473.911298:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 173 00000100:00100000:3.0:1788528473.911310:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+49:12303:x1875407719709312:12345-192.168.203.38@tcp:101:stat.0 00010000:00010000:3.0:1788528473.911404:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528473.911433:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c859f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfef9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.911534:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c85a6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.911548:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c85a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.911598:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c85a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.911607:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c85ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.911614:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c85ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.911621:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c85ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.911713:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c85b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.911723:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c85b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.911730:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c85b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528473.911952:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788528473.911958:0:6508:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788528473.911987:0:6508:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c85b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.912001:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c85b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.912019:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c85a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.912027:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c85a6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.912034:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c85a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.912040:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528473.912045:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c85a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.912055:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c85a6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.912069:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:3.0:1788528473.912072:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528473.912078:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c85a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.912084:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c85a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.912110:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c85ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.912116:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c85ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.912121:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c85ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.912136:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3429400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528473.912139:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c85ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.912145:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c85ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.912153:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a8fc3770900) 00010000:00010000:3.0:1788528473.912156:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528473.912159:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c85ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.912165:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c85ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.912205:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c859f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfef9 expref: 51 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.912220:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c85b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfef9 expref: 50 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528473.912239:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:3.0:1788528473.912241:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788528473.912245:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3429800, rc 0) 00000100:00100000:3.0:1788528473.912326:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+50:12303:x1875407719709312:12345-192.168.203.38@tcp:101:stat.0 Request processed in 1019us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528473.912333:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 173 00000100:00100000:1.0:1788528473.973536:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528473.973918:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719709568 00000100:00100000:2.0:1788528473.973932:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719709568 00000100:00100000:2.0:1788528473.974062:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 174 00000100:00100000:2.0:1788528473.974074:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+50:12313:x1875407719709568:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1788528473.974102:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528473.974129:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c85bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bff00 expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528473.974258:0:13480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788528473.974403:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c85bb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff00 expref: 52 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.974430:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:2.0:1788528473.974433:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788528473.974440:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c85bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff00 expref: 52 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528473.974456:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3be00, rc 0) 00000100:00100000:2.0:1788528473.974534:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+51:12313:x1875407719709568:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 462us (1013us total) trans 4294967448 rc 301/301 00000100:00100000:2.0:1788528473.974632:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 174 00000100:00100000:1.0:1788528473.977489:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528473.977975:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719709824 00000100:00100000:2.0:1788528473.977988:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719709824 00000100:00100000:2.0:1788528473.978126:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:2.0:1788528473.978138:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e16450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+51:12313:x1875407719709824:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:2.0:1788528473.978744:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e16450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+52:12313:x1875407719709824:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 605us (1266us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788528473.978753:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:3.0:1788528474.035072:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528474.035635:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719710080 00000100:00100000:0.0:1788528474.035646:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719710080 00000100:00100000:0.0:1788528474.035790:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 175 00000100:00100000:0.0:1788528474.035806:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+52:12319:x1875407719710080:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:0.0:1788528474.035831:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528474.035851:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c85c9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bff07 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528474.035970:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c85d0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528474.035986:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c85b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfef9 expref: 53 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528474.035995:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c85d0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528474.036028:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c85b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfef9 expref: 53 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528474.036055:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c85b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfef9 expref: 53 pid: 6508 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528474.036068:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6509:1875407735502336:192.168.203.38@tcp:104: 00000100:00100000:0.0:1788528474.036177:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c39229c0 going to sleep for 11 seconds 00000100:00080000:2.0:1788528474.036700:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788528474.042139:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528474.042285:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719710208 00000100:00100000:2.0:1788528474.042293:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719710208 00000100:00100000:0.0:1788528474.042308:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6509:1875407735502336:192.168.203.38@tcp:104: 00010000:00010000:0.0:1788528474.042336:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c85d0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.043013:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c85b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfef9 expref: 54 pid: 6508 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528474.043636:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 90 00000100:00100000:0.0:1788528474.043651:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+54:2403:x1875407719710208:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788528474.043669:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528474.043677:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c85b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfef9 expref: 54 pid: 6508 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528474.043691:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c85b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfef9 expref: 54 pid: 6508 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528474.043724:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c85b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfef9 expref: 54 pid: 6508 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528474.043742:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:0.0:1788528474.043747:0:10330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c85d0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528474.043918:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c85d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528474.043926:0:10330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c85d0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528474.043960:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528474.044034:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+53:2403:x1875407719710208:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 387us (1914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528474.044041:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 90 00010000:00010000:3.0:1788528474.044115:0:6509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c85d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.044123:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c85d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528474.044140:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1788528474.044272:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c85c9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff07 expref: 54 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.044288:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c85d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff07 expref: 53 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.044295:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:3.0:1788528474.044298:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788528474.044301:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031200, rc 0) 00000100:00100000:3.0:1788528474.044328:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+53:12319:x1875407719710080:12345-192.168.203.38@tcp:101:bash.0 Request processed in 8529us (9265us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1788528474.044335:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 175 00000100:00100000:1.0:1788528474.049183:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528474.049392:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719710464 00000100:00100000:3.0:1788528474.049410:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719710464 00000100:00100000:3.0:1788528474.049475:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 176 00000100:00100000:3.0:1788528474.049484:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+53:12319:x1875407719710464:12345-192.168.203.38@tcp:36:bash.0 00010000:00010000:3.0:1788528474.050233:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c85de lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.050253:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c85de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.050264:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c85de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788528474.050300:0:6508:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967451 00000004:00010000:3.0:1788528474.050317:0:6508:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b30452d reply state 000000008a232ea8 transno 4294967452 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c85de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.050329:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c85de lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.050337:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:3.0:1788528474.050340:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788528474.050344:0:6508:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788528474.050428:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+56:12319:x1875407719710464:12345-192.168.203.38@tcp:36:bash.0 Request processed in 943us (1253us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788528474.050436:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 176 00000020:00080000:3.0:1788528474.050440:0:6508:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788528474.058350:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528474.059733:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719710592 00000100:00100000:2.0:1788528474.059745:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719710592 00000100:00100000:2.0:1788528474.059824:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 177 00000100:00100000:2.0:1788528474.059835:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+56:12319:x1875407719710592:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:2.0:1788528474.059861:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528474.059903:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c85e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bff0e expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.060018:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c85ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.060034:0:13480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c85d0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff07 expref: 57 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.060055:0:13480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c85ec lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.060089:0:13480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c85d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff07 expref: 57 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.060117:0:13480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c85d0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff07 expref: 57 pid: 6509 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528474.060132:0:13480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13480:1875407735502464:192.168.203.38@tcp:104: 00000100:00100000:2.0:1788528474.060222:0:13480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f5906e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788528474.065151:0:13480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13480:1875407735502464:192.168.203.38@tcp:104: 00010000:00010000:2.0:1788528474.065182:0:13480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c85ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528474.069135:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528474.074351:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719710720 00000100:00100000:3.0:1788528474.074366:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719710720 00010000:00010000:3.0:1788528474.074415:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c85d0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff07 expref: 58 pid: 6509 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528474.074472:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 91 00000100:00100000:3.0:1788528474.074482:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+58:2404:x1875407719710720:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788528474.074498:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528474.074507:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c85d0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff07 expref: 58 pid: 6509 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.074668:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c85d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff07 expref: 58 pid: 6509 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.074693:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c85d0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff07 expref: 58 pid: 6509 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.074785:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:3.0:1788528474.074859:0:8441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c85ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.074872:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c85ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.074955:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c85ec lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.075045:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528474.075115:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+57:2404:x1875407719710720:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 633us (5987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528474.075124:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 91 00010000:00010000:2.0:1788528474.083389:0:13480:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c85ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.083406:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c85ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528474.083466:0:13480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788528474.083470:0:13480:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788528474.083493:0:13480:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c85ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.084951:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c85e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff0e expref: 57 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.085000:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c85ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff0e expref: 56 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.085009:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:2.0:1788528474.085012:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788528474.085015:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3b600, rc 0) 00000100:00100000:2.0:1788528474.085104:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+56:12319:x1875407719710592:12345-192.168.203.38@tcp:101:bash.0 Request processed in 25270us (26762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528474.085113:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 177 00000100:00100000:1.0:1788528474.092403:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528474.092491:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719710976 00000100:00100000:2.0:1788528474.092500:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719710976 00000100:00100000:2.0:1788528474.092590:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:2.0:1788528474.092601:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+56:12319:x1875407719710976:12345-192.168.203.38@tcp:35:bash.0 00000100:00100000:2.0:1788528474.092829:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+57:12319:x1875407719710976:12345-192.168.203.38@tcp:35:bash.0 Request processed in 228us (435us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1788528474.092837:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:1.0:1788528474.217693:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528474.217816:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719711232 00000100:00100000:3.0:1788528474.217832:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719711232 00000100:00100000:3.0:1788528474.217909:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 178 00000100:00100000:3.0:1788528474.217920:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+57:12329:x1875407719711232:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1788528474.217945:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528474.217965:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c85f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bff15 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528474.218234:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788528474.218343:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c85f3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff15 expref: 59 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.218358:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:3.0:1788528474.218361:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788528474.218367:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c85f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff15 expref: 59 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.218380:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3429400, rc 0) 00000100:00100000:3.0:1788528474.218907:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+58:12329:x1875407719711232:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 986us (1221us total) trans 4294967454 rc 301/301 00000100:00100000:3.0:1788528474.218916:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 178 00000100:00100000:1.0:1788528474.224237:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528474.224311:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719711360 00000100:00100000:3.0:1788528474.224321:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719711360 00000100:00100000:3.0:1788528474.224378:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 179 00000100:00100000:3.0:1788528474.224388:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+58:12329:x1875407719711360:12345-192.168.203.38@tcp:34:lfs.0 00010000:00010000:3.0:1788528474.224477:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8601 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.224505:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8601 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.224530:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8601 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.224542:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c8608 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.224549:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c8608 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.224579:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c8608 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.224647:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c860f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.224656:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c860f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.224662:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c860f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788528474.224879:0:6508:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c860f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.224902:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8601 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.224910:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8601 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.224917:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8601 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.224933:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528474.224937:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8601 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.224945:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8601 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.224957:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:3.0:1788528474.224960:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528474.224965:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8601 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.224971:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8601 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.224984:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c8608 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.224991:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c8608 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.224997:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c8608 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.225002:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3429800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528474.225004:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c8608 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.225010:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c8608 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.225027:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a8fc3770900) 00010000:00010000:3.0:1788528474.225030:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528474.225034:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c8608 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.225039:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c8608 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.225048:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c860f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.225183:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c860f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.225190:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c860f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.225195:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e3800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528474.225198:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c860f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.225203:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c860f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.225212:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:3.0:1788528474.225214:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528474.225218:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c860f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.225223:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c860f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528474.225428:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+58:12329:x1875407719711360:12345-192.168.203.38@tcp:34:lfs.0 Request processed in 1039us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528474.225437:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 179 00000100:00100000:1.0:1788528474.236020:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528474.236202:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719711616 00000100:00100000:2.0:1788528474.236212:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719711616 00000100:00100000:2.0:1788528474.236273:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 46 00000100:00100000:2.0:1788528474.236283:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+58:12329:x1875407719711616:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:2.0:1788528474.237002:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+59:12329:x1875407719711616:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 718us (990us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788528474.237012:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 46 00010000:00010000:1.0:1788528474.241742:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528474.273514:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528474.273657:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719711872 00000100:00100000:2.0:1788528474.273680:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719711872 00000100:00100000:2.0:1788528474.273750:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 180 00000100:00100000:2.0:1788528474.273769:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+59:12332:x1875407719711872:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1788528474.273793:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528474.273815:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8616 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bff1c expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.273886:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c861d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.273912:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c861d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.273923:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c861d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.273934:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8624 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.273942:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8624 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.273948:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8624 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.274220:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c862b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.274230:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c862b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.274236:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c862b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528474.274252:0:13480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788528474.274330:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c861d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.274338:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c861d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.274344:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c861d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.274351:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528474.274356:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c861d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.274364:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c861d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.274376:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:2.0:1788528474.274379:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528474.274384:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c861d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.274390:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c861d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.274403:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8624 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.274409:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8624 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.274425:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8624 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.274431:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528474.274434:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8624 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.274440:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8624 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.274448:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a8fc3770900) 00010000:00010000:2.0:1788528474.274450:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528474.274453:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8624 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.274459:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a200/0x892c60dda91c8624 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.274936:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3be00/0x892c60dda91c8616 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff1c expref: 62 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.274956:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c862b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff1c expref: 61 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.274965:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:2.0:1788528474.274967:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788528474.274970:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101851000, rc 0) 00000100:00100000:2.0:1788528474.275194:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+61:12332:x1875407719711872:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 1435us (1698us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788528474.275214:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 180 00000100:00100000:1.0:1788528474.283198:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528474.283249:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528474.283326:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719712128 00000100:00100000:2.0:1788528474.283337:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719712128 00000100:00100000:2.0:1788528474.283431:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:2.0:1788528474.283442:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90efa87850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+61:2404:x1875407719712128:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528474.283456:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528474.283479:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c862b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff1c expref: 61 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.283506:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:2.0:1788528474.283512:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528474.283595:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90efa87850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+60:2404:x1875407719712128:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 155us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528474.283603:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:3.0:1788528474.286344:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719712000 00000100:00100000:3.0:1788528474.286357:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719712000 00000100:00100000:3.0:1788528474.286506:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 181 00000100:00100000:3.0:1788528474.286517:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+60:12332:x1875407719712000:12345-192.168.203.38@tcp:54:lfs.0 00010000:00010000:3.0:1788528474.286620:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c8639 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.286638:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c8639 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.286650:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c8639 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.286685:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c8639 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.286692:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c8639 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.286698:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c8639 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.286704:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e3800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528474.286708:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c8639 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.286715:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c8639 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.286740:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:3.0:1788528474.286743:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788528474.286747:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c8639 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.286754:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c8639 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528474.286815:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+60:12332:x1875407719712000:12345-192.168.203.38@tcp:54:lfs.0 Request processed in 300us (3625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528474.286823:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 181 00000100:00100000:1.0:1788528474.290546:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528474.290637:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719712384 00000100:00100000:3.0:1788528474.290646:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719712384 00000100:00100000:3.0:1788528474.290701:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 47 00000100:00100000:3.0:1788528474.290712:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+60:12332:x1875407719712384:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:3.0:1788528474.290921:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+61:12332:x1875407719712384:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 211us (382us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1788528474.290929:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 47 00000100:00100000:1.0:1788528474.467606:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528474.467979:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719712640 00000100:00100000:3.0:1788528474.467989:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719712640 00000100:00100000:3.0:1788528474.468058:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 182 00000100:00100000:3.0:1788528474.468068:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+61:12350:x1875407719712640:12345-192.168.203.38@tcp:101:cat.0 00010000:00010000:3.0:1788528474.468093:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528474.468116:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c8640 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bff23 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.468235:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c8647 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.468261:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c8647 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.468274:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c8647 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528474.468286:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788528474.468386:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c8640 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff23 expref: 64 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.468404:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c8647 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff23 expref: 63 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.468413:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:3.0:1788528474.468416:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788528474.468420:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3429800, rc 0) 00000100:00100000:3.0:1788528474.468716:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+63:12350:x1875407719712640:12345-192.168.203.38@tcp:101:cat.0 Request processed in 647us (1166us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788528474.468723:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 182 00000100:00100000:1.0:1788528474.507745:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528474.507958:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719712768 00000100:00100000:2.0:1788528474.507968:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719712768 00000100:00100000:2.0:1788528474.508032:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 183 00000100:00100000:2.0:1788528474.508044:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+63:12351:x1875407719712768:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1788528474.508067:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528474.508095:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c8655 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bff2a expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.508161:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851800/0x892c60dda91c865c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.508177:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851800/0x892c60dda91c865c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.508203:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851800/0x892c60dda91c865c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528474.508248:0:13480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788528474.508251:0:13480:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788528474.508269:0:13480:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851800/0x892c60dda91c865c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.508294:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c8655 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff2a expref: 65 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.508312:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851800/0x892c60dda91c865c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff2a expref: 64 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.508320:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:2.0:1788528474.508323:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788528474.508327:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101851800, rc 0) 00000100:00100000:2.0:1788528474.508383:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+64:12351:x1875407719712768:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 341us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528474.508390:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 183 00000100:00100000:1.0:1788528474.519865:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528474.519955:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719713152 00000100:00100000:2.0:1788528474.519965:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719713152 00000100:00100000:2.0:1788528474.520023:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:2.0:1788528474.520033:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+64:12351:x1875407719713152:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:2.0:1788528474.520314:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+65:12351:x1875407719713152:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 282us (458us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1788528474.520322:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:1.0:1788528474.535520:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528474.538905:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719713280 00000100:00100000:0.0:1788528474.538921:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719713280 00000100:00100000:0.0:1788528474.539007:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:0.0:1788528474.539018:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+65:12351:x1875407719713280:12345-192.168.203.38@tcp:103:lfs.0 00010000:00010000:0.0:1788528474.539472:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788528474.539499:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c85ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff0e expref: 65 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528474.539524:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c8647 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff23 expref: 64 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528474.539538:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c84e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfec8 expref: 63 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528474.539549:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:0.0:1788528474.539592:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528474.539654:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+62:12351:x1875407719713280:12345-192.168.203.38@tcp:103:lfs.0 Request processed in 637us (4141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528474.539675:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:1.0:1788528474.543370:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528474.543527:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719713408 00000100:00100000:3.0:1788528474.543537:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719713408 00000100:00100000:3.0:1788528474.543622:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 184 00000100:00100000:3.0:1788528474.543631:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+62:12351:x1875407719713408:12345-192.168.203.38@tcp:58:lfs.0 00010000:00010000:3.0:1788528474.543738:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8663 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.543909:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8663 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528474.543942:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8663 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788528474.544241:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788528474.544373:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+62:12351:x1875407719713408:12345-192.168.203.38@tcp:58:lfs.0 Request processed in 742us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528474.544382:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 184 00000100:00100000:2.0:1788528474.587059:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528474.598398:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719713536 00000100:00100000:3.0:1788528474.598413:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719713536 00000100:00100000:2.0:1788528474.598641:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 185 00000100:00100000:2.0:1788528474.598653:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+62:12353:x1875407719713536:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1788528474.598672:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528474.598696:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c866a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bff31 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.598759:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c8671 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.598774:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c8671 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.598784:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c8671 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.598795:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8678 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.598803:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8678 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.598810:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8678 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.598879:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850c00/0x892c60dda91c867f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.598889:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850c00/0x892c60dda91c867f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.598907:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850c00/0x892c60dda91c867f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528474.598962:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788528474.598967:0:6508:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788528474.598984:0:6508:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850c00/0x892c60dda91c867f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.598995:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850c00/0x892c60dda91c867f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.599004:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c8671 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.599010:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c8671 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.599017:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c8671 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.599023:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528474.599027:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c8671 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.599035:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c8671 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.599048:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:2.0:1788528474.599050:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528474.599055:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c8671 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.599061:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c8671 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.599259:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8678 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.599266:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8678 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.599271:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8678 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.599276:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528474.599279:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8678 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.599284:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8678 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.599293:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a8fc3770900) 00010000:00010000:2.0:1788528474.599295:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528474.599298:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8678 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.599304:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8678 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.599332:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851000/0x892c60dda91c866a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff31 expref: 64 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.599347:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850c00/0x892c60dda91c867f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff31 expref: 63 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528474.599365:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:2.0:1788528474.599367:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788528474.599370:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101850c00, rc 0) 00000100:00100000:2.0:1788528474.599473:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+63:12353:x1875407719713536:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 821us (12422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528474.599480:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 185 00010000:00010000:1.0:1788528475.262762:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528475.335859:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528475.336043:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719713664 00000100:00100000:2.0:1788528475.336056:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719713664 00000100:00100000:2.0:1788528475.336129:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 413 00000100:00100000:2.0:1788528475.336139:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2404:x1875407719713664:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528475.336238:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2404:x1875407719713664:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 100us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528475.336247:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 413 00000100:00100000:1.0:1788528475.347914:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528475.347965:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528475.347992:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528475.348035:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528475.348062:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528475.348090:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528475.348125:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719713792 00000100:00100000:1.0:1788528475.348138:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719713792 00000100:00100000:1.0:1788528475.348198:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719714304 00000100:00100000:1.0:1788528475.348201:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719714304 00000100:00100000:1.0:1788528475.348225:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719713920 00000100:00100000:1.0:1788528475.348228:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719713920 00000100:00100000:1.0:1788528475.348241:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719714432 00000100:00100000:1.0:1788528475.348244:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719714432 00000100:00100000:1.0:1788528475.348261:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 307 00000100:00100000:1.0:1788528475.348270:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+63:2403:x1875407719713792:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528475.348382:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+63:2403:x1875407719713792:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 113us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528475.348391:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 307 00000100:00100000:0.0:1788528475.348727:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 308 00000100:00100000:0.0:1788528475.348741:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719714304:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528475.348777:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719714304:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 41us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528475.348784:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 308 00000100:00100000:0.0:1788528475.348807:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 309 00000100:00100000:0.0:1788528475.348814:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719713920:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528475.348839:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719713920:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 26us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528475.348845:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 309 00000100:00100000:0.0:1788528475.348855:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 310 00000100:00100000:0.0:1788528475.348861:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719714432:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528475.348883:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719714432:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 22us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528475.348901:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 310 00000100:00100000:3.0:1788528475.349102:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719714048 00000100:00100000:3.0:1788528475.349109:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719714048 00000100:00100000:3.0:1788528475.349146:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719714176 00000100:00100000:3.0:1788528475.349148:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719714176 00000100:00100000:3.0:1788528475.349168:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 120 00000100:00100000:3.0:1788528475.349174:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2403:x1875407719714048:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528475.349205:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2403:x1875407719714048:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 31us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528475.349211:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 120 00000100:00100000:3.0:1788528475.349225:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 121 00000100:00100000:3.0:1788528475.349230:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2403:x1875407719714176:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528475.349250:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2403:x1875407719714176:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 20us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528475.349256:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 121 00000100:00080000:2.0:1788528475.349699:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788528475.349706:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788528475.349709:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788528475.349712:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788528475.390778:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788528475.390789:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788528475.391965:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788528475.391988:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788528475.392193:0:13786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4651180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1875407735502592:192.168.203.38@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788528475.392321:0:13786:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c82e2540 going to sleep for 11 seconds 00000100:00100000:1.0:1788528475.398868:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528475.398899:0:13786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4651180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1875407735502592:192.168.203.38@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788528475.398928:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719714560 00000100:00100000:1.0:1788528475.398937:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719714560 00000100:00100000:1.0:1788528475.399004:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 186 00000100:00100000:1.0:1788528475.399023:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+63:12364:x1875407719714560:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788528475.399065:0:8449:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788528475.399206:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+63:12364:x1875407719714560:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 Request processed in 191us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528475.399214:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 186 00000100:00100000:2.0:1788528475.408933:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528475.409084:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719714688 00000100:00100000:3.0:1788528475.409097:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719714688 00000100:00100000:3.0:1788528475.409173:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 187 00000100:00100000:3.0:1788528475.409185:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+63:12364:x1875407719714688:12345-192.168.203.38@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788528475.409285:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c8686 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.409307:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c8686 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.409321:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c8686 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.420997:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c868d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.421018:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c868d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.421031:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c868d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.421081:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c8694 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.421091:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c8694 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.421097:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c8694 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528475.421423:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788528475.421428:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788528475.421442:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c8694 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.421453:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c8686 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.421460:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c8686 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.421467:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c8686 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.421473:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3429800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528475.421478:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c8686 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.421486:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c8686 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.421499:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a8fc2721c00) 00010000:00010000:2.0:1788528475.421508:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528475.421514:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c8686 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.421521:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c8686 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.421536:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c868d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.421542:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c868d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.421548:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c868d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.421576:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101851400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528475.421580:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c868d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.421586:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c868d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.421594:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8a8fc3770b00) 00010000:00010000:2.0:1788528475.421596:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528475.421599:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c868d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.421605:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c868d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.421621:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c8694 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.421634:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c8694 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.421639:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c8694 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.421644:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528475.421647:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c8694 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.421653:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c8694 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.421660:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:2.0:1788528475.421662:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528475.421665:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c8694 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.421670:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c8694 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528475.421753:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+63:12364:x1875407719714688:12345-192.168.203.38@tcp:34:lhsmtool_posix.0 Request processed in 12567us (12832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528475.421762:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 187 00000100:00100000:3.0:1788528475.425002:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528475.425972:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719714944 00000100:00100000:1.0:1788528475.425989:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719714944 00000100:00100000:1.0:1788528475.426081:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 188 00000100:00100000:1.0:1788528475.426095:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+63:12364:x1875407719714944:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788528475.426132:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528475.426160:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c869b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bff38 expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.426307:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c86a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.426326:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c86a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.426341:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c86a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528475.426363:0:13480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788528475.426462:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c86a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.426471:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c86a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.426479:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c86a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.426486:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528475.426492:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c86a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.426501:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c86a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.426516:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:1.0:1788528475.426519:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788528475.426525:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c86a2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.426532:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c86a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.426610:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c869b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff38 expref: 65 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.426623:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a8fc2721c00) 00010000:00010000:1.0:1788528475.426626:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788528475.426638:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c869b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff38 expref: 65 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.426650:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e16200, rc 0) 00000100:00100000:1.0:1788528475.426735:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+64:12364:x1875407719714944:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 643us (1740us total) trans 4294967460 rc 301/301 00000100:00100000:1.0:1788528475.426742:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 188 00000100:00100000:1.0:1788528475.432260:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528475.432341:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719715072 00000100:00100000:2.0:1788528475.432354:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719715072 00000100:00100000:2.0:1788528475.432440:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 189 00000100:00100000:2.0:1788528475.432450:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+64:12364:x1875407719715072:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788528475.432487:0:6509:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788528475.435523:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+64:12364:x1875407719715072:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 Request processed in 2337us (2541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528475.435538:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 189 00000100:00100000:3.0:1788528475.441541:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528475.446952:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719715328 00000100:00100000:2.0:1788528475.446967:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719715328 00000100:00100000:2.0:1788528475.447043:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 190 00000100:00100000:2.0:1788528475.447053:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+64:12364:x1875407719715328:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788528475.447076:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528475.447079:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788528475.447113:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851800/0x892c60dda91c865c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff2a expref: 64 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.447129:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:2.0:1788528475.447135:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788528475.447148:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c86b0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bff3f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788528475.447508:0:6510:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788528475.447680:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c86b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.447694:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c86b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.447705:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c86b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.447759:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c86b0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff3f expref: 66 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.447794:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c86b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff3f expref: 65 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.447802:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a8fc3770b00) 00010000:00010000:2.0:1788528475.447805:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788528475.447807:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101851400, rc 0) 00000100:00100000:2.0:1788528475.447869:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+65:12364:x1875407719715328:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 817us (6337us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1788528475.447877:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 190 00000100:00100000:3.0:1788528475.453232:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528475.453303:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719715584 00000100:00100000:1.0:1788528475.453312:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719715584 00000100:00100000:1.0:1788528475.453364:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 191 00000100:00100000:1.0:1788528475.453374:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+65:12364:x1875407719715584:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788528475.453424:0:13480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528475.453449:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c86b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff3f expref: 65 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.453466:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a8fc3770b00) 00010000:00010000:1.0:1788528475.453475:0:13480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788528475.453501:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c86c5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.453516:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c86c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.453526:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c86c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.453645:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c86cc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x4686ffca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.453655:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c86cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4686ffca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.453663:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c86cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4686ffca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.453715:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c86c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.453723:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c86c5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.453730:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c86c5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.453735:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528475.453739:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c86c5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.453747:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c86c5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.453754:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:0.0:1788528475.453757:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528475.453761:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c86c5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.453768:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c86c5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.453776:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c86cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4686ffca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.453782:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c86cc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4686ffca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.453788:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c86cc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4686ffca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.453798:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528475.453801:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c86cc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4686ffca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.453808:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c86cc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4686ffca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.453814:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x4686ffca (ffff8a90c87be400) 00010000:00010000:0.0:1788528475.453817:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528475.453819:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c86cc lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x4686ffca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.453825:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c86cc lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x4686ffca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528475.453928:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+64:12364:x1875407719715584:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 555us (704us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788528475.453935:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 191 00000100:00100000:1.0:1788528475.472903:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528475.473131:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719715712 00000100:00100000:3.0:1788528475.473141:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719715712 00000100:00100000:3.0:1788528475.473205:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 192 00000100:00100000:3.0:1788528475.473215:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+64:12364:x1875407719715712:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788528475.473234:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528475.473255:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c86d3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bff46 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.473290:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c86da lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.473312:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c86da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.473324:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c86da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.473425:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429400/0x892c60dda91c86d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff46 expref: 66 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.473442:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c86da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff46 expref: 65 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.473450:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a8fc1fa8500) 00010000:00010000:3.0:1788528475.473454:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788528475.473458:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3429800, rc 0) 00000100:00100000:3.0:1788528475.473520:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+65:12364:x1875407719715712:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 306us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528475.473528:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 192 00000100:00100000:3.0:1788528475.476017:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528475.476140:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719715968 00000100:00100000:0.0:1788528475.476149:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719715968 00000100:00100000:0.0:1788528475.476366:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 193 00000100:00100000:0.0:1788528475.476377:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+65:12364:x1875407719715968:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788528475.476452:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c86e1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.476605:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c86e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.476617:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c86e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788528475.476785:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1788528475.476795:0:8449:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 344694240629ns, next at 345694238655ns, rc = 0 00000004:00010000:0.0:1788528475.476842:0:8449:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a50239d1 reply state 00000000e0fdd341 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c86e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.476855:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c86e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.476863:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a8fc1fa8500) 00010000:00010000:0.0:1788528475.476866:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788528475.476869:0:8449:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788528475.476983:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+67:12364:x1875407719715968:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 607us (971us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1788528475.476991:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 193 00000100:00100000:3.0:1788528475.483287:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528475.484150:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719716096 00000100:00100000:1.0:1788528475.484166:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719716096 00000100:00100000:1.0:1788528475.484234:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 194 00000100:00100000:1.0:1788528475.484244:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+67:12364:x1875407719716096:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788528475.484267:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528475.484287:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c86e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bff4d expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.484345:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c86e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff4d expref: 68 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.484363:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c86e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff4d expref: 68 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.484382:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a8fc1fa8500) 00010000:00010000:1.0:1788528475.484385:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788528475.484390:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e17c00, rc 0) 00000100:00100000:1.0:1788528475.484444:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+68:12364:x1875407719716096:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 200us (1382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528475.484451:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 194 00000100:00100000:1.0:1788528475.486875:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528475.487383:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719716224 00000100:00100000:3.0:1788528475.487392:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719716224 00000100:00100000:3.0:1788528475.487449:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:3.0:1788528475.487460:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2403:x1875407719716224:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788528475.487799:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2403:x1875407719716224:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 Request processed in 340us (931us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788528475.487806:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:0.0:1788528475.494938:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528475.495031:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719716480 00000100:00100000:1.0:1788528475.495042:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719716480 00000100:00100000:1.0:1788528475.495095:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:1.0:1788528475.495105:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+68:12364:x1875407719716480:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788528475.495310:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+69:12364:x1875407719716480:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 206us (382us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1788528475.495318:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:0.0:1788528475.504391:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528475.504465:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719716736 00000100:00100000:3.0:1788528475.504474:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719716736 00000100:00100000:3.0:1788528475.504528:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 195 00000100:00100000:3.0:1788528475.504538:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+69:12364:x1875407719716736:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788528475.504658:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+69:12364:x1875407719716736:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 121us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528475.504665:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 195 00000100:00100000:1.0:1788528475.508431:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528475.508612:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719716864 00000100:00100000:2.0:1788528475.508622:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719716864 00000100:00100000:2.0:1788528475.508684:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 196 00000100:00100000:2.0:1788528475.508705:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+69:12364:x1875407719716864:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788528475.508725:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528475.508747:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c86ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bff54 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.508832:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851800/0x892c60dda91c86f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.508848:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851800/0x892c60dda91c86f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.508860:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851800/0x892c60dda91c86f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528475.508915:0:8449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788528475.508955:0:8449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851800/0x892c60dda91c86f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.508982:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c86ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff54 expref: 71 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.508999:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851800/0x892c60dda91c86f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff54 expref: 70 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.509007:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a8fc1fa8500) 00010000:00010000:2.0:1788528475.509011:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788528475.509014:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101851800, rc 0) 00000100:00100000:2.0:1788528475.509084:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+70:12364:x1875407719716864:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 390us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528475.509091:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 196 00000100:00100000:1.0:1788528475.514822:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528475.514900:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719716992 00000100:00100000:3.0:1788528475.514909:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719716992 00000100:00100000:3.0:1788528475.514969:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:3.0:1788528475.514979:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2403:x1875407719716992:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788528475.514997:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528475.515018:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000512aef58/0x892c60dda91c86fd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bff5b expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788528475.515044:0:8421:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ac75b, blocks: 0x0 00010000:00010000:3.0:1788528475.515061:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=344s v=(0 0) 00010000:00010000:3.0:1788528475.515066:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528475.515075:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000512aef58/0x892c60dda91c86fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff5b expref: 8 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.515092:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000512aef58/0x892c60dda91c86fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff5b expref: 8 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.515106:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e3800, rc 0) 00000100:00100000:3.0:1788528475.515162:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:2403:x1875407719716992:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 185us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528475.515176:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:3.0:1788528475.517267:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528475.517350:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719717248 00000100:00100000:0.0:1788528475.517362:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719717248 00000100:00100000:0.0:1788528475.517426:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 197 00000100:00100000:0.0:1788528475.517437:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+70:12364:x1875407719717248:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788528475.517550:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+70:12364:x1875407719717248:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 114us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528475.517576:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 197 00000100:00100000:1.0:1788528475.523770:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528475.523851:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719717376 00000100:00100000:3.0:1788528475.523861:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719717376 00000100:00100000:3.0:1788528475.523929:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:3.0:1788528475.523942:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:12364:x1875407719717376:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788528475.524039:0:8423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528475.524123:0:8423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8569505/0x892c60dda91c8704 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bff62 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.524154:0:8423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000512aef58/0x892c60dda91c86fd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff5b expref: 9 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.524163:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528475.524167:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528475.524172:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8569505/0x892c60dda91c8704 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff62 expref: 9 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.524208:0:8423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000512aef58/0x892c60dda91c86fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff5b expref: 9 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.524222:0:8423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000512aef58/0x892c60dda91c86fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff5b expref: 9 pid: 8421 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528475.524235:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8423:1875407735502720:192.168.203.38@tcp:104: 00000100:00100000:3.0:1788528475.524932:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c82e2c00 going to sleep for 11 seconds 00000040:00080000:0.0:1788528475.535806:0:14595:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788528475.535816:0:14595:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788528475.535842:0:14595:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788528475.535849:0:14595:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788528475.541291:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8423:1875407735502720:192.168.203.38@tcp:104: 00010000:00010000:0.0:1788528475.541330:0:8423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b8569505/0x892c60dda91c8704 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff62 expref: 9 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.541352:0:8423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3429400, rc 0) 00000100:00100000:0.0:1788528475.541413:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+9:12364:x1875407719717376:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 17474us (17651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528475.541422:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:2.0:1788528475.541469:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528475.541504:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719717504 00000100:00100000:2.0:1788528475.541511:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719717504 00010000:00010000:2.0:1788528475.541545:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000512aef58/0x892c60dda91c86fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff5b expref: 9 pid: 8421 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528475.541601:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 92 00000100:00100000:2.0:1788528475.541611:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+9:2404:x1875407719717504:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528475.541626:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528475.541646:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000512aef58/0x892c60dda91c86fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff5b expref: 9 pid: 8421 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.541660:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000512aef58/0x892c60dda91c86fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff5b expref: 9 pid: 8421 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.541692:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000512aef58/0x892c60dda91c86fd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff5b expref: 9 pid: 8421 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.542109:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528475.542113:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528475.542121:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8569505/0x892c60dda91c8704 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff62 expref: 8 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.542132:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8569505/0x892c60dda91c8704 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff62 expref: 8 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.542167:0:8441:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b8569505/0x892c60dda91c8704 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff62 expref: 8 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528475.542180:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ac380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8441:1875407735502848:192.168.203.38@tcp:105: 00000100:00100000:2.0:1788528475.542247:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528475.552668:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528475.553132:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719717632 00000100:00100000:1.0:1788528475.553141:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719717632 00002000:00100000:1.0:1788528475.553197:0:8427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8a8fc374c700 x1875407719717632/t0(0) o4->80304108-f3b9-46ea-888c-b2a7ec20e3e2@192.168.203.38@tcp:681/0 lens 504/0 e 0 to 0 dl 1788528486 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788528475.553213:0:8427:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a8fc374c700 with x1875407719717632 ext(0->8) 00002000:00010000:1.0:1788528475.553224:0:8427:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a8fc374c700 00000100:00100000:1.0:1788528475.553263:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:1.0:1788528475.553275:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+9:2404:x1875407719717632:12345-192.168.203.38@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788528475.553919:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ac380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8441:1875407735502848:192.168.203.38@tcp:105: 00010000:00010000:2.0:1788528475.553963:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528475.554058:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+11:2404:x1875407719717504:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 12448us (12589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528475.554071:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 92 00000100:00100000:1.0:1788528475.554667:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+10:2404:x1875407719717632:12345-192.168.203.38@tcp:4:lhsmtool_posix.0 Request processed in 1389us (2000us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788528475.554679:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4 00002000:00100000:1.0:1788528475.554688:0:8427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8a8fc374c700 x1875407719717632/t4294967315(0) o4->80304108-f3b9-46ea-888c-b2a7ec20e3e2@192.168.203.38@tcp:681/0 lens 504/448 e 0 to 0 dl 1788528486 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788528475.554698:0:8427:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a8fc374c700 with x1875407719717632 ext(0->8) 00002000:00010000:1.0:1788528475.554703:0:8427:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a8fc374c700 00000100:00100000:0.0:1788528475.578522:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528475.580970:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719717760 00000100:00100000:3.0:1788528475.580989:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719717760 00000100:00100000:3.0:1788528475.581066:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 198 00000100:00100000:3.0:1788528475.581079:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+70:12364:x1875407719717760:12345-192.168.203.38@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788528475.590679:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967463 is committed 00000004:00080000:3.0:1788528475.590703:0:6487:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:3.0:1788528475.590775:0:6487:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788528475.590792:0:6487:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a90f5906300 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788528475.590798:0:6487:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a90ce83fd00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a90f5906780 00000020:00080000:3.0:1788528475.590801:0:6487:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a90ce83f800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a90f6f60600 00000020:00080000:3.0:1788528475.590848:0:6540:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00010000:00010000:2.0:1788528475.590855:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c842c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.590870:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c842c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.590895:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c842c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.590903:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3429e00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528475.590909:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c842c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.590919:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c842c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.590940:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8a8fc1fa8e00) 00010000:00010000:2.0:1788528475.590944:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528475.590950:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c842c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.590957:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c842c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.590986:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8433 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.590994:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8433 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591001:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8433 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591007:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428e00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528475.591010:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8433 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591028:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8433 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591044:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:2.0:1788528475.591047:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528475.591051:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8433 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591057:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8433 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528475.591071:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc45e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735502976:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1788528475.591078:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c8472 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591087:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c8472 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591095:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c8472 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591100:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528475.591104:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c8472 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591110:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c8472 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591119:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a8fc3770900) 00010000:00010000:2.0:1788528475.591122:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528475.591125:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c8472 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591139:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c8472 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528475.591150:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788528475.591176:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8575 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591184:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8575 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591191:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8575 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591197:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428c00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528475.591201:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8575 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591209:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8575 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591220:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:2.0:1788528475.591224:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528475.591232:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8575 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528475.591233:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc45e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735503104:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788528475.591254:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428c00/0x892c60dda91c8575 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591271:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8598 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591279:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8598 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591293:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8598 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528475.591307:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788528475.591308:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528475.591316:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8598 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591337:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8598 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591348:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:2.0:1788528475.591351:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528475.591356:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8598 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528475.591360:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735502976 00010000:00010000:2.0:1788528475.591364:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c8598 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528475.591369:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735502976 00010000:00010000:2.0:1788528475.591384:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c85de lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591394:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c85de lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591401:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c85de lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591406:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3429000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528475.591409:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c85de lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591426:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c85de lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528475.591437:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735503104 00010000:00010000:2.0:1788528475.591440:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:2.0:1788528475.591443:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528475.591446:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c85de lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528475.591452:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735503104 00010000:00010000:2.0:1788528475.591456:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c85de lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591479:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c86e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591486:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c86e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528475.591491:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00010000:00010000:2.0:1788528475.591504:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c86e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528475.591507:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc45eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735502976:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1788528475.591514:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528475.591518:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c86e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591524:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c86e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591532:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a8fc1fa8500) 00010000:00010000:2.0:1788528475.591535:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788528475.591538:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c86e1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.591592:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c86e1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788528475.591618:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788528475.591626:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1788528475.591718:0:8421:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788528475.591723:0:8421:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788528475 00002000:00010000:1.0:1788528475.591725:0:8421:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788528475.591727:0:8421:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788528475 -> 1788528475 00002000:00010000:1.0:1788528475.591729:0:8421:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788528475.591782:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc45eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1875407735502976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 277us (635us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788528475.591789:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788528475.591810:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788528475.591816:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1875407735503104:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788528475.591832:0:8421:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:1.0:1788528475.591855:0:8421:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9ac758, atime: 0x6a9ac758, ctime: 0x6a9ac758, blocks: 0x8 00010000:00010000:1.0:1788528475.591863:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003f3db7e/0x892c60dda91c870b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.591879:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=344s v=(0 0) 00010000:00010000:1.0:1788528475.591892:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788528475.591899:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003f3db7e/0x892c60dda91c870b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.591914:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003f3db7e/0x892c60dda91c870b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.591923:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003f3db7e/0x892c60dda91c870b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.591938:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003f3db7e/0x892c60dda91c870b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.591956:0:8421:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788528475.592055:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3637:x1875407735503104:12345-0@lo:6:osp-syn-0-0.0 Request processed in 239us (757us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788528475.592062:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:1.0:1788528475.592092:0:8438:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528475.592098:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003f3db7e/0x892c60dda91c870b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.592106:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17000 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528475.592111:0:8438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003f3db7e/0x892c60dda91c870b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.592121:0:8438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003f3db7e/0x892c60dda91c870b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.592137:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003f3db7e/0x892c60dda91c870b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.592144:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003f3db7e/0x892c60dda91c870b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788528475.592545:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a8fc45e8e00/2, rc 0, transno 4294967316 00000100:00100000:2.0:1788528475.592579:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc45e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735502976:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788528475.592637:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528475.592647:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528475.592649:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788528475.592676:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a8fc45e9f80/2, rc 0, transno 4294967308 00000100:00100000:1.0:1788528475.592681:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc45e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735503104:0@lo:6:osp-syn-0-0.0 00000020:00080000:3.0:1788528475.593739:0:6540:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788528475.593754:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+19:12364:x1875407719717760:12345-192.168.203.38@tcp:44:lhsmtool_posix.0 Request processed in 12673us (15243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528475.593768:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 198 00000100:00100000:0.0:1788528475.607982:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528475.608250:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719717888 00000100:00100000:1.0:1788528475.608266:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719717888 00000100:00100000:1.0:1788528475.608356:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:1.0:1788528475.608369:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+10:2403:x1875407719717888:12345-192.168.203.38@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788528475.610490:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:1.0:1788528475.610509:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1788528475.610724:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2403:x1875407719717888:12345-192.168.203.38@tcp:16:lhsmtool_posix.0 Request processed in 2347us (2747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528475.610746:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:0.0:1788528475.615099:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528475.615236:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719718144 00000100:00100000:2.0:1788528475.615253:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719718144 00000100:00100000:0.0:1788528475.615399:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 199 00000100:00100000:0.0:1788528475.615420:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+19:12364:x1875407719718144:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788528475.615659:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528475.615690:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851800/0x892c60dda91c86f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff54 expref: 19 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.615712:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a8fc1fa8500) 00010000:00010000:0.0:1788528475.615718:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788528475.615896:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c8712 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.615911:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c8712 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.615922:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c8712 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788528475.616718:0:6510:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000052abed45 reply state 00000000e1f3d045 transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c8712 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.617082:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c8712 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.617090:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a8fc1fa8500) 00010000:00010000:0.0:1788528475.617093:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788528475.617097:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788528475.617746:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+20:12364:x1875407719718144:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 2331us (2652us total) trans 4294967464 rc 0/0 00000100:00100000:0.0:1788528475.617757:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 199 00000100:00100000:0.0:1788528475.622136:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528475.622381:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719718272 00000100:00100000:2.0:1788528475.622391:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719718272 00000100:00100000:2.0:1788528475.622445:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:2.0:1788528475.622455:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2404:x1875407719718272:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788528475.623468:0:8422:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788528475.623474:0:8422:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788528475 -> 1788528474 00002000:00010000:2.0:1788528475.623477:0:8422:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788528472 00002000:00010000:2.0:1788528475.623480:0:8422:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788528475 -> 1788528474 00002000:00010000:2.0:1788528475.623482:0:8422:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788528475.624882:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:2404:x1875407719718272:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 Request processed in 2419us (2746us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788528475.624906:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:3.0:1788528475.636154:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528475.636232:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719718528 00000100:00100000:0.0:1788528475.636243:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719718528 00000100:00100000:0.0:1788528475.636306:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 200 00000100:00100000:0.0:1788528475.636316:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+20:12364:x1875407719718528:12345-192.168.203.38@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788528475.636388:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8719 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.636407:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c86da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff46 expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.636417:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8719 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.636451:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c86da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff46 expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.636482:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c86da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff46 expref: 20 pid: 6509 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528475.636497:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6509:1875407735503232:192.168.203.38@tcp:104: 00000100:00100000:0.0:1788528475.636617:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ef8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788528475.643094:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6509:1875407735503232:192.168.203.38@tcp:104: 00010000:00010000:1.0:1788528475.643123:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8719 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528475.649463:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528475.649610:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719718656 00000100:00100000:0.0:1788528475.649620:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719718656 00010000:00010000:0.0:1788528475.649663:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c86da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff46 expref: 21 pid: 6509 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528475.649702:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 93 00000100:00100000:0.0:1788528475.649713:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4542a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+21:2403:x1875407719718656:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788528475.649728:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528475.649736:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c86da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff46 expref: 21 pid: 6509 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.649749:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c86da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff46 expref: 21 pid: 6509 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.649771:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429800/0x892c60dda91c86da lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff46 expref: 21 pid: 6509 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.649788:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a8fc1fa8500) 00010000:00010000:0.0:1788528475.649793:0:6493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8719 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.649814:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8719 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.649823:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8719 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.649851:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788528475.649879:0:6509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8719 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.649901:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8719 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528475.649914:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4542a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+20:2403:x1875407719718656:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 203us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528475.649922:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 93 00010000:00010000:1.0:1788528475.649943:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8719 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.649951:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8719 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.649958:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8719 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.649963:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528475.649974:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8719 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.649981:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8719 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.649991:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a8fc1fa8500) 00010000:00010000:1.0:1788528475.649994:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788528475.649997:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8719 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.650003:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8719 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528475.650055:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+19:12364:x1875407719718528:12345-192.168.203.38@tcp:55:lhsmtool_posix.0 Request processed in 13739us (13909us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788528475.650065:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 200 00000100:00100000:0.0:1788528475.658174:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528475.658300:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719718784 00000100:00100000:1.0:1788528475.658310:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719718784 00000100:00100000:1.0:1788528475.658405:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 65 00000100:00100000:1.0:1788528475.658416:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:2403:x1875407719718784:12345-192.168.203.38@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788528475.658462:0:8725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000031b22d91/0x892c60dda91c8720 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.658483:0:8725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8569505/0x892c60dda91c8704 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff62 expref: 8 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.658492:0:8725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788528475.658496:0:8725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788528475.658512:0:8725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031b22d91/0x892c60dda91c8720 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.658547:0:8725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b8569505/0x892c60dda91c8704 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff62 expref: 8 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.658587:0:8725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b8569505/0x892c60dda91c8704 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff62 expref: 8 pid: 8423 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528475.658602:0:8725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8725:1875407735503360:192.168.203.38@tcp:104: 00000100:00100000:1.0:1788528475.658679:0:8725:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3eef000 going to sleep for 11 seconds 00000100:00100000:3.0:1788528475.662405:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528475.662453:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719718912 00000100:00100000:0.0:1788528475.662462:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719718912 00010000:00010000:0.0:1788528475.662501:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b8569505/0x892c60dda91c8704 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff62 expref: 9 pid: 8423 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528475.662505:0:8725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8725:1875407735503360:192.168.203.38@tcp:104: 00010000:00010000:1.0:1788528475.662534:0:8725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000031b22d91/0x892c60dda91c8720 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528475.662615:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 94 00000100:00100000:0.0:1788528475.662626:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4542d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+9:2404:x1875407719718912:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788528475.662640:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528475.662661:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b8569505/0x892c60dda91c8704 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff62 expref: 9 pid: 8423 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.662675:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b8569505/0x892c60dda91c8704 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff62 expref: 9 pid: 8423 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.662698:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8569505/0x892c60dda91c8704 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff62 expref: 9 pid: 8423 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.662724:0:10330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788528475.662729:0:10330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788528475.662735:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000031b22d91/0x892c60dda91c8720 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.662744:0:10330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031b22d91/0x892c60dda91c8720 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.662771:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528475.662816:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4542d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:2404:x1875407719718912:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 191us (419us total) trans 0 rc 0/0 00010000:00010000:1.0:1788528475.662823:0:8725:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000031b22d91/0x892c60dda91c8720 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528475.662823:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 94 00010000:00010000:1.0:1788528475.662835:0:8725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031b22d91/0x892c60dda91c8720 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.662857:0:8725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000031b22d91/0x892c60dda91c8720 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.662865:0:8725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031b22d91/0x892c60dda91c8720 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.662894:0:8725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031b22d91/0x892c60dda91c8720 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.662902:0:8725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17200 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528475.662907:0:8725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031b22d91/0x892c60dda91c8720 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.662917:0:8725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031b22d91/0x892c60dda91c8720 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.662928:0:8725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031b22d91/0x892c60dda91c8720 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.662935:0:8725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031b22d91/0x892c60dda91c8720 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528475.662979:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2403:x1875407719718784:12345-192.168.203.38@tcp:1:lhsmtool_posix.0 Request processed in 4566us (4816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528475.662987:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 65 00000100:00100000:0.0:1788528475.665544:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528475.665613:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719719168 00000100:00100000:1.0:1788528475.665624:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719719168 00000100:00100000:1.0:1788528475.665677:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 201 00000100:00100000:1.0:1788528475.665823:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+19:12364:x1875407719719168:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788528475.665916:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c8727 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.665942:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c856e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfeeb expref: 19 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.665951:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c8727 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.665984:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c856e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfeeb expref: 19 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.665996:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c856e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfeeb expref: 19 pid: 6509 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528475.666019:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6508:1875407735503488:192.168.203.38@tcp:104: 00000100:00100000:1.0:1788528475.666094:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3eef000 going to sleep for 11 seconds 00000100:00100000:0.0:1788528475.668324:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528475.668396:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6508:1875407735503488:192.168.203.38@tcp:104: 00010000:00010000:1.0:1788528475.668423:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c8727 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528475.670110:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719719296 00000100:00100000:3.0:1788528475.670121:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719719296 00010000:00010000:3.0:1788528475.670159:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c856e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfeeb expref: 20 pid: 6509 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528475.670205:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 95 00000100:00100000:3.0:1788528475.670214:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+20:2403:x1875407719719296:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788528475.670238:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528475.670245:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c856e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfeeb expref: 20 pid: 6509 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.670258:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c856e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfeeb expref: 20 pid: 6509 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.670280:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c856e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfeeb expref: 20 pid: 6509 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.670297:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:3.0:1788528475.670303:0:8441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c8727 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.670313:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c8727 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.670320:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c8727 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.670349:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528475.670421:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+19:2403:x1875407719719296:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 208us (2105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528475.670429:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 95 00010000:00010000:2.0:1788528475.671502:0:6508:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c8727 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.671524:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c8727 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.671816:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c872e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.671831:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c86e8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff4d expref: 19 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.671839:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c872e lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.671875:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c86e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff4d expref: 19 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.671900:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c86e8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff4d expref: 19 pid: 13480 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528475.671921:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6508:1875407735503616:192.168.203.38@tcp:104: 00000100:00100000:0.0:1788528475.671995:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ef89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528475.676215:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6508:1875407735503616:192.168.203.38@tcp:104: 00010000:00010000:3.0:1788528475.676245:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c872e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528475.678405:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528475.679695:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719719424 00000100:00100000:3.0:1788528475.679712:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719719424 00010000:00010000:3.0:1788528475.679743:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c86e8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff4d expref: 20 pid: 13480 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528475.679776:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 96 00000100:00100000:3.0:1788528475.679783:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+20:2403:x1875407719719424:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788528475.679795:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528475.679802:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c86e8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff4d expref: 20 pid: 13480 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.679814:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c86e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff4d expref: 20 pid: 13480 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.679837:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c86e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff4d expref: 20 pid: 13480 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.679852:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a8fc1fa8500) 00010000:00010000:3.0:1788528475.679857:0:6493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c872e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.679866:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c872e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.679874:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c872e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.679972:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528475.680034:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+19:2403:x1875407719719424:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 249us (1635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528475.680051:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 96 00010000:00010000:1.0:1788528475.680712:0:6508:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c872e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.680723:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c872e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788528475.680848:0:6508:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1788528475.680972:0:6508:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000001:00080000:1.0:1788528475.681109:0:6508:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1788528475.681193:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6508:1875407735503744:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788528475.681255:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528475.681328:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3eef480 going to sleep for 11 seconds 00000100:00100000:3.0:1788528475.681430:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735503744 00000100:00100000:3.0:1788528475.681437:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735503744 00000100:00100000:3.0:1788528475.681484:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788528475.681491:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6508:x1875407735503744:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788528475.681583:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6508:x1875407735503744:12345-0@lo:1000:mdt00_000.0 Request processed in 91us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528475.681590:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788528475.681659:0:6508:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1788528475.681665:0:6508:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a8fc45e8e00, transno 4294967316 00000100:00100000:1.0:1788528475.681687:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6508:1875407735503744:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788528475.681972:0:6508:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:1.0:1788528475.682077:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6508:1875407735503872:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788528475.682109:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528475.682134:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3eefa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788528475.682173:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735503872 00000100:00100000:3.0:1788528475.682178:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735503872 00000100:00100000:3.0:1788528475.682244:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788528475.682251:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6508:x1875407735503872:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788528475.682353:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6508:x1875407735503872:12345-0@lo:1000:mdt00_000.0 Request processed in 103us (243us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788528475.682360:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788528475.682414:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6508:1875407735503872:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788528475.682443:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c872e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.682452:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c872e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.682460:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c872e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.682467:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031a00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528475.682471:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c872e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.682480:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c872e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.682494:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a8fc1fa8500) 00010000:00010000:1.0:1788528475.682497:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788528475.682502:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c872e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.682514:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c872e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.682535:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8663 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.682542:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8663 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.682548:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8663 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.682706:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528475.682710:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8663 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.682717:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8663 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.682726:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:1.0:1788528475.682729:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788528475.682732:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8663 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.682738:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428000/0x892c60dda91c8663 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.682775:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8735 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.682790:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850c00/0x892c60dda91c867f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff31 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.682804:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8735 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.682832:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850c00/0x892c60dda91c867f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff31 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.682846:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850c00/0x892c60dda91c867f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff31 expref: 22 pid: 6508 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528475.682859:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6508:1875407735504000:192.168.203.38@tcp:104: 00000100:00100000:1.0:1788528475.682930:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3eefa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788528475.687205:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528475.687252:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719719552 00000100:00100000:2.0:1788528475.687261:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719719552 00010000:00010000:2.0:1788528475.687302:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850c00/0x892c60dda91c867f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff31 expref: 23 pid: 6508 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528475.687343:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 97 00000100:00100000:2.0:1788528475.687353:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90efa85c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+23:2404:x1875407719719552:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528475.687367:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528475.687374:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850c00/0x892c60dda91c867f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff31 expref: 23 pid: 6508 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.687387:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850c00/0x892c60dda91c867f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff31 expref: 23 pid: 6508 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.687410:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:2.0:1788528475.687416:0:10330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8735 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.687425:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8735 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528475.687432:0:10330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8735 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.687433:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850c00/0x892c60dda91c867f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff31 expref: 23 pid: 6508 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528475.687446:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6508:1875407735504000:192.168.203.38@tcp:104: 00010000:00010000:2.0:1788528475.687450:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788528475.687467:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8735 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.687476:0:6508:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8735 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.687482:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8735 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.687493:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8735 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.687499:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8735 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528475.687506:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90efa85c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+22:2404:x1875407719719552:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 154us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528475.687514:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 97 00010000:00010000:1.0:1788528475.687514:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8735 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.687520:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528475.687524:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8735 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.687531:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8735 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.687539:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:1.0:1788528475.687542:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528475.687545:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8735 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.687551:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8735 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.687580:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c8727 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.687587:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c8727 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.687593:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c8727 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.687598:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17a00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528475.687600:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c8727 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.687616:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c8727 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.687625:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a8fc3770f00) 00010000:00010000:1.0:1788528475.687627:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788528475.687630:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c8727 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528475.687635:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c8727 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528475.687777:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+21:12364:x1875407719719168:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 22090us (22240us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1788528475.687785:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 201 00000020:00080000:1.0:1788528475.687788:0:6508:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788528475.689046:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788528475.689053:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788528475.689509:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1788528475.689516:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788528475.696636:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528475.696789:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719719808 00000100:00100000:3.0:1788528475.696798:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719719808 00000100:00100000:3.0:1788528475.696860:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 50 00000100:00100000:3.0:1788528475.696869:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e16850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+21:12364:x1875407719719808:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788528475.697133:0:6512:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788528475.697166:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00010000:00010000:3.0:1788528475.697200:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c873c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.697218:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c873c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.697239:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c873c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.697248:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c873c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.697255:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c873c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.697261:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c873c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528475.697287:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788528475.697385:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e16850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+23:12364:x1875407719719808:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 515us (757us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788528475.697393:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 50 00000020:00080000:3.0:1788528475.697398:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788528475.697712:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528475.697719:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c873c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.697726:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428200 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528475.697731:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c873c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.697739:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c873c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.697756:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a8fc1fa8500) 00010000:00010000:0.0:1788528475.697760:0:8440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788528475.697764:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c873c lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.697770:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428200/0x892c60dda91c873c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528475.697781:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528475.697783:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528475.697785:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528476.287210:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528476.351584:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788528476.351607:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735504128:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788528476.351676:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528476.352127:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735504384:0@lo:400:kworker.0 00000100:00100000:2.0:1788528476.352170:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528476.352213:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788528476.352219:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735504256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788528476.352244:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528476.354916:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735504128 00000100:00100000:1.0:1788528476.354932:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735504128 00000100:00100000:1.0:1788528476.355020:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788528476.355029:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4541500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735504128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788528476.355054:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923509248 avail 3691958272 00000100:00100000:2.0:1788528476.355877:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735504384 00000100:00100000:2.0:1788528476.355898:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735504384 00000100:00100000:2.0:1788528476.355937:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1788528476.355944:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:3640:x1875407735504384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528476.356003:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:3640:x1875407735504384:12345-0@lo:400:kworker.0 Request processed in 60us (3832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528476.356010:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00080000:2.0:1788528476.356044:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788528476.356055:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735504256 00000100:00100000:2.0:1788528476.356059:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735504256 00000100:00100000:2.0:1788528476.356076:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788528476.356082:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1875407735504256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788528476.356093:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923509248 avail 3691958272 00000100:00100000:2.0:1788528476.356134:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1875407735504256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (3889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528476.356157:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788528476.356205:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735504256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788528476.356215:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735504384:0@lo:400:kworker.0 00000100:00100000:2.0:1788528476.356289:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735504640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528476.356323:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528476.356348:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788528476.356356:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735504512:0@lo:400:kworker.0 00000100:00100000:2.0:1788528476.356380:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528476.356421:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735504640 00000100:00100000:2.0:1788528476.356425:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735504640 00000100:00100000:2.0:1788528476.356451:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788528476.356457:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735504640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788528476.356481:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788528476.356517:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735504640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528476.356523:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788528476.356550:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735504640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528476.356606:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735504512 00000100:00100000:2.0:1788528476.356610:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735504512 00000100:00100000:2.0:1788528476.356637:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788528476.356643:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735504512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528476.356676:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735504512:12345-0@lo:400:kworker.0 Request processed in 34us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528476.356682:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788528476.356713:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735504512:0@lo:400:kworker.0 00000100:00100000:0.0:1788528476.363079:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735504768:0@lo:400:kworker.0 00000100:00100000:0.0:1788528476.363236:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528476.363343:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788528476.363350:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735504896:0@lo:400:kworker.0 00000100:00100000:0.0:1788528476.363378:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528476.363947:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788528476.363957:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735505024:0@lo:400:kworker.0 00000100:00100000:0.0:1788528476.363986:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528476.364024:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4676300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735505152:0@lo:400:kworker.0 00000100:00100000:0.0:1788528476.364047:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528476.364170:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735505280:0@lo:400:kworker.0 00000100:00100000:0.0:1788528476.364197:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528476.364240:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788528476.364247:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735505408:0@lo:400:kworker.0 00000100:00100000:0.0:1788528476.364270:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528476.364441:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788528476.364450:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735505536:0@lo:400:kworker.0 00000100:00100000:2.0:1788528476.364472:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735504768 00000100:00100000:0.0:1788528476.364479:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528476.364540:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1875407735505664:0@lo:400:kworker.0 00000100:00100000:2.0:1788528476.364549:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735504768 00000100:00100000:2.0:1788528476.364642:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735505024 00000100:00100000:1.0:1788528476.364645:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4541500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735504128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 9608us (12959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528476.364648:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735505024 00000100:00100000:1.0:1788528476.364667:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788528476.364681:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735505152 00000100:00100000:2.0:1788528476.364686:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735505152 00000100:00100000:2.0:1788528476.364704:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735505536 00000100:00100000:2.0:1788528476.364707:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735505536 00000100:00100000:2.0:1788528476.364731:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788528476.364743:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735504768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528476.364759:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788528476.364779:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4675c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735505024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528476.364817:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735504768:12345-0@lo:400:kworker.0 Request processed in 75us (1578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528476.364827:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788528476.364851:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1788528476.364860:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4675c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735505024:12345-0@lo:400:kworker.0 Request processed in 88us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528476.364868:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875407735505152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528476.364905:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788528476.364935:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875407735505152:12345-0@lo:400:kworker.0 Request processed in 72us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528476.364940:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788528476.364958:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1788528476.364961:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735505536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528476.365009:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735505536:12345-0@lo:400:kworker.0 Request processed in 54us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528476.365029:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1788528476.365069:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735505280 00000100:00100000:1.0:1788528476.365077:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735505280 00000100:00100000:1.0:1788528476.365126:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735505408 00000100:00100000:1.0:1788528476.365130:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735505408 00000100:00100000:1.0:1788528476.365151:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788528476.365158:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4675180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735505280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528476.365198:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528476.365206:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4675180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735505280:12345-0@lo:400:kworker.0 Request processed in 44us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528476.365214:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788528476.365252:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735505536:0@lo:400:kworker.0 00010000:00080000:0.0:1788528476.365266:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc4676300 x1875407735505152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528476.365277:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4676300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735505152:0@lo:400:kworker.0 00000100:00100000:0.0:1788528476.365287:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735505024:0@lo:400:kworker.0 00000100:00100000:0.0:1788528476.365442:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788528476.365457:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4675f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3639:x1875407735505408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528476.365465:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735505664 00000100:00100000:1.0:1788528476.365472:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735505664 00000100:00100000:1.0:1788528476.365520:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788528476.365528:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4675f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3639:x1875407735505408:12345-0@lo:400:kworker.0 Request processed in 68us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528476.365537:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4676680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875407735505664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528476.365549:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788528476.365638:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4676680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875407735505664:12345-0@lo:400:kworker.0 Request processed in 105us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528476.365647:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00010000:00080000:0.0:1788528476.365673:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc4675500 x1875407735505664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528476.365759:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735504128:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788528476.365813:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735505408:0@lo:400:kworker.0 00000100:00100000:1.0:1788528476.365826:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735505280:0@lo:400:kworker.0 00000100:00100000:1.0:1788528476.365852:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735504768:0@lo:400:kworker.0 00000100:00080000:1.0:1788528476.365877:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788528476.365892:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788528476.365895:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788528476.365920:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735504896 00000100:00100000:1.0:1788528476.365924:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735504896 00000100:00100000:1.0:1788528476.365957:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788528476.365964:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4677b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735504896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528476.366159:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1875407735505664:0@lo:400:kworker.0 00000100:00100000:1.0:1788528476.366474:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4677b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735504896:12345-0@lo:400:kworker.0 Request processed in 508us (3091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528476.366484:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788528476.366534:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735504896:0@lo:400:kworker.0 00010000:00010000:0.0:1788528477.310971:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528477.374986:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788528477.375008:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735505792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788528477.375073:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528477.375132:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735505792 00000100:00100000:2.0:1788528477.375140:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735505792 00000100:00100000:2.0:1788528477.375194:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788528477.375204:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1875407735505792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788528477.375246:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528477.375291:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1875407735505792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528477.375307:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1788528477.375328:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788528477.375362:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735505792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788528477.375670:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788528477.375680:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735505920:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788528477.375712:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528477.375890:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735505920 00000100:00100000:1.0:1788528477.375895:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735505920 00000100:00100000:1.0:1788528477.375959:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788528477.375968:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4543800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735505920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788528477.375981:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528477.376024:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4543800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735505920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528477.376030:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788528477.378603:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735505920:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1788528477.437203:0:14646:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788528477.437211:0:14646:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788528477.437233:0:14646:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788528477.437239:0:14646:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788528477.628307:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528477.630520:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719720064 00000100:00100000:1.0:1788528477.630535:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719720064 00000100:00100000:1.0:1788528477.630938:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 202 00000100:00100000:1.0:1788528477.630950:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4677100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+23:12382:x1875407719720064:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1788528477.630971:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528477.631003:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8743 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bff69 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.631119:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c874a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.631133:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c874a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.631143:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c874a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528477.631154:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788528477.631251:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8743 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff69 expref: 26 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.631266:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c874a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff69 expref: 25 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.631274:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:1.0:1788528477.631276:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788528477.631279:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e17e00, rc 0) 00000100:00100000:1.0:1788528477.631338:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4677100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+25:12382:x1875407719720064:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 391us (3041us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788528477.631346:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 202 00000100:00100000:3.0:1788528477.635585:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528477.636008:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719720192 00000100:00100000:0.0:1788528477.636018:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719720192 00000100:00100000:0.0:1788528477.636079:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 203 00000100:00100000:0.0:1788528477.636089:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+25:12382:x1875407719720192:12345-192.168.203.38@tcp:34:lfs.0 00010000:00010000:0.0:1788528477.636163:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8758 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.636180:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8758 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.636190:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8758 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.636204:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c875f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.636230:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c875f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.636237:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c875f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.636314:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c8766 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.636322:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c8766 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.636329:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c8766 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788528477.636374:0:13480:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c8766 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.636386:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8758 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.636393:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8758 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.636400:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8758 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.636406:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528477.636410:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8758 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.636418:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8758 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.636437:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:0.0:1788528477.636440:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528477.636446:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8758 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.636453:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8758 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.636465:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c875f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.636471:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c875f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.636476:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c875f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.636482:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528477.636484:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c875f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.636491:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c875f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.636499:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a90c87bee00) 00010000:00010000:0.0:1788528477.636501:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528477.636504:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c875f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.636509:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c875f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.636534:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c8766 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.636541:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c8766 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.636547:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c8766 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.636582:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528477.636586:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c8766 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.636592:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c8766 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.636599:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a90c87be900) 00010000:00010000:0.0:1788528477.636602:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528477.636605:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c8766 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.636611:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c8766 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528477.636682:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+25:12382:x1875407719720192:12345-192.168.203.38@tcp:34:lfs.0 Request processed in 593us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528477.636690:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 203 00000100:00080000:2.0:1788528477.641609:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788528477.693251:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528477.693334:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719720448 00000100:00100000:1.0:1788528477.693343:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719720448 00000100:00100000:0.0:1788528477.696702:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 204 00000100:00100000:0.0:1788528477.696789:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4675500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+25:12385:x1875407719720448:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1788528477.696825:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528477.696847:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c876d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bff70 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.696955:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c8774 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.696970:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c8774 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.696983:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c8774 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.696998:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c877b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.697006:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c877b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.697014:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c877b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.697230:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8782 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.697239:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8782 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.697247:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8782 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788528477.697257:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788528477.697344:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c8774 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.697353:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c8774 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.697359:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c8774 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.697365:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528477.697369:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c8774 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.697377:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c8774 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.697390:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:0.0:1788528477.697394:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528477.697399:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c8774 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.697406:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c8774 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.697419:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c877b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.697426:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c877b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.697432:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c877b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.697438:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528477.697448:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c877b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.697454:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c877b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.697463:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a90c87be900) 00010000:00010000:0.0:1788528477.697466:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528477.697469:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c877b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.697475:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c877b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.697519:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c876d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff70 expref: 28 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.697535:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8782 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff70 expref: 27 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.697543:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a90c87bee00) 00010000:00010000:0.0:1788528477.697546:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788528477.697550:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031600, rc 0) 00000100:00100000:0.0:1788528477.698217:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4675500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+27:12385:x1875407719720448:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 1502us (4972us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1788528477.698225:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 204 00000100:00100000:0.0:1788528477.706505:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528477.706617:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719720576 00000100:00100000:1.0:1788528477.706627:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719720576 00000100:00100000:1.0:1788528477.706682:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 205 00000100:00100000:1.0:1788528477.706692:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4675880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+27:12385:x1875407719720576:12345-192.168.203.38@tcp:54:lfs.0 00010000:00010000:1.0:1788528477.706775:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8790 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.706866:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8790 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.706887:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8790 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.706925:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8790 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.706933:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8790 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.706940:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8790 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.707058:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528477.707063:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8790 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.707071:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8790 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.707083:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a90c87bee00) 00010000:00010000:1.0:1788528477.707087:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788528477.707092:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8790 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.707098:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8790 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528477.707220:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4675880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+27:12385:x1875407719720576:12345-192.168.203.38@tcp:54:lfs.0 Request processed in 528us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528477.707228:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 205 00000100:00100000:2.0:1788528477.712135:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528477.712332:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719720832 00000100:00100000:3.0:1788528477.712341:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719720832 00000100:00100000:3.0:1788528477.712396:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:3.0:1788528477.712406:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+27:12385:x1875407719720832:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:3.0:1788528477.713283:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+28:12385:x1875407719720832:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 874us (1153us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1788528477.713293:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:0.0:1788528477.743072:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528477.743235:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719721088 00000100:00100000:1.0:1788528477.743245:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719721088 00000100:00100000:1.0:1788528477.743346:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 206 00000100:00100000:1.0:1788528477.743357:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4676300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+28:11910:x1875407719721088:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:1.0:1788528477.743380:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528477.743401:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8797 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bff77 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.743526:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c879e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.743540:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8782 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff70 expref: 29 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.743549:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c879e lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.743629:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8782 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff70 expref: 29 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.743642:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8782 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff70 expref: 29 pid: 6508 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528477.743656:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6510:1875407735506048:192.168.203.38@tcp:104: 00000100:00100000:1.0:1788528477.744284:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3eefc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788528477.749840:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528477.750011:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719721216 00000100:00100000:3.0:1788528477.750020:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719721216 00010000:00010000:3.0:1788528477.750066:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8782 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff70 expref: 30 pid: 6508 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528477.750108:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 98 00000100:00100000:3.0:1788528477.750118:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4676a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+30:2403:x1875407719721216:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788528477.750131:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528477.750138:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8782 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff70 expref: 30 pid: 6508 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528477.750152:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8782 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff70 expref: 30 pid: 6508 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528477.750173:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a90c87bee00) 00010000:00010000:3.0:1788528477.750185:0:8441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c879e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528477.750195:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c879e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528477.750216:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c879e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528477.750237:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528477.750298:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4676a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+30:2403:x1875407719721216:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 181us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528477.750306:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 98 00010000:00010000:1.0:1788528477.750674:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8782 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff70 expref: 29 pid: 6508 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528477.750694:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6510:1875407735506048:192.168.203.38@tcp:104: 00010000:00010000:1.0:1788528477.750720:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c879e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.750730:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c879e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.750746:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c879e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528477.750765:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788528477.751020:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8797 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff77 expref: 30 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.751036:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c879e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff77 expref: 29 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.751044:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a90c87bee00) 00010000:00010000:1.0:1788528477.751047:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788528477.751060:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e17a00, rc 0) 00000100:00100000:1.0:1788528477.751213:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4676300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+29:11910:x1875407719721088:12345-192.168.203.38@tcp:101:bash.0 Request processed in 7857us (8149us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1788528477.751222:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 206 00000100:00100000:0.0:1788528477.761429:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528477.761540:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719721344 00000100:00100000:1.0:1788528477.761587:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719721344 00000100:00100000:1.0:1788528477.761637:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 207 00000100:00100000:1.0:1788528477.761647:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+29:11910:x1875407719721344:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:1.0:1788528477.761670:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528477.761692:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c87ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bff7e expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.761727:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c87b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.761742:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c87b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.761753:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c87b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.761879:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c87ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff7e expref: 31 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.761898:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c87b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff7e expref: 30 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.761907:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a90c87bee00) 00010000:00010000:1.0:1788528477.761910:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788528477.761914:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e16e00, rc 0) 00000100:00100000:1.0:1788528477.761980:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+30:11910:x1875407719721344:12345-192.168.203.38@tcp:101:bash.0 Request processed in 333us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528477.761988:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 207 00000100:00100000:3.0:1788528477.765927:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528477.766018:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719721600 00000100:00100000:1.0:1788528477.766039:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719721600 00000100:00100000:1.0:1788528477.766101:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 208 00000100:00100000:1.0:1788528477.766110:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+30:11910:x1875407719721600:12345-192.168.203.38@tcp:36:bash.0 00010000:00010000:1.0:1788528477.766339:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c87ba lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.766357:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c87ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.766368:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c87ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788528477.766744:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000004:00010000:1.0:1788528477.766769:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008bd4c4d6 reply state 000000003134285b transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c87ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.766856:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c87ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.766864:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a90c87bee00) 00010000:00010000:1.0:1788528477.766867:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788528477.766879:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788528477.766923:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:1.0:1788528477.767021:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+34:11910:x1875407719721600:12345-192.168.203.38@tcp:36:bash.0 Request processed in 910us (1102us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788528477.767028:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 208 00000020:00080000:1.0:1788528477.767033:0:6509:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788528477.771413:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528477.771629:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719721728 00000100:00100000:1.0:1788528477.771639:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719721728 00000100:00100000:1.0:1788528477.771702:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 209 00000100:00100000:1.0:1788528477.771713:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+34:11910:x1875407719721728:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:1.0:1788528477.771750:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528477.771769:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c87c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bff85 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.771835:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c87c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff85 expref: 35 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.771850:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c87c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff85 expref: 35 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.771877:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a90c87bee00) 00010000:00010000:1.0:1788528477.771881:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788528477.771885:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e17200, rc 0) 00000100:00100000:1.0:1788528477.771945:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+35:11910:x1875407719721728:12345-192.168.203.38@tcp:101:bash.0 Request processed in 233us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528477.771953:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 209 00000100:00100000:2.0:1788528477.777616:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528477.777741:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719721856 00000100:00100000:1.0:1788528477.777752:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719721856 00000100:00080000:2.0:1788528477.777862:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788528477.778698:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 66 00000100:00100000:1.0:1788528477.778713:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3f77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:11910:x1875407719721856:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:1.0:1788528477.778733:0:8423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528477.778754:0:8423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003f3db7e/0x892c60dda91c87c8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bff8c expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788528477.778791:0:8423:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9ac75a, atime: 0x6a9ac758, ctime: 0x6a9ac75a, blocks: 0x8 00010000:00010000:1.0:1788528477.778812:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=346s v=(0 0) 00010000:00010000:1.0:1788528477.778817:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788528477.778838:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003f3db7e/0x892c60dda91c87c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff8c expref: 8 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.778854:0:8423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000003f3db7e/0x892c60dda91c87c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff8c expref: 8 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.778867:0:8423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e17000, rc 0) 00000100:00100000:1.0:1788528477.778936:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3f77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:11910:x1875407719721856:12345-192.168.203.38@tcp:101:bash.0 Request processed in 229us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528477.778944:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 66 00000100:00100000:3.0:1788528477.784234:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528477.784353:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719721984 00000100:00100000:2.0:1788528477.784363:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719721984 00002000:00010000:2.0:1788528477.784408:0:8428:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1788528477.784413:0:8428:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a8fc4540380 with x1875407719721984 ext(0->18446744073709551615) 00002000:00010000:2.0:1788528477.784425:0:8428:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a8fc4540380. 00000100:00100000:2.0:1788528477.784461:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:2.0:1788528477.784471:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:2403:x1875407719721984:12345-192.168.203.38@tcp:10:bash.0 00002000:00010000:2.0:1788528477.784837:0:8428:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788528477.784841:0:8428:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788528474 -> 1788528477 00002000:00010000:2.0:1788528477.784843:0:8428:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1788528472 -> 1788528472 00002000:00010000:2.0:1788528477.784845:0:8428:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788528474 -> 1788528477 00002000:00010000:2.0:1788528477.784848:0:8428:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788528477.784913:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+9:2403:x1875407719721984:12345-192.168.203.38@tcp:10:bash.0 Request processed in 444us (688us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788528477.784922:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5 00002000:00010000:2.0:1788528477.784925:0:8428:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1788528477.784928:0:8428:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a8fc4540380 with x1875407719721984 ext(0->18446744073709551615) 00002000:00010000:2.0:1788528477.784933:0:8428:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a8fc4540380. 00000100:00100000:2.0:1788528477.858649:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528477.858764:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719722112 00000100:00100000:0.0:1788528477.858774:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719722112 00000100:00100000:0.0:1788528477.858835:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 210 00000100:00100000:0.0:1788528477.858844:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc327d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+35:12399:x1875407719722112:12345-192.168.203.38@tcp:34:lfs.0 00010000:00010000:0.0:1788528477.858930:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c87cf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.858946:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c87cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.858957:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c87cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.858972:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c87d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.858980:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c87d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.858987:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c87d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.859065:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c87dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.859075:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c87dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.859081:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c87dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788528477.859124:0:13480:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c87dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.859149:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c87cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.859154:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c87cf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.859159:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c87cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.859165:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528477.859168:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c87cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.859175:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c87cf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.859187:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:0.0:1788528477.859190:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528477.859194:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c87cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.859201:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c87cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.859213:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c87d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.859218:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c87d6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.859223:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c87d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.859234:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031e00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528477.859237:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c87d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.859243:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c87d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.859251:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a90c87be900) 00010000:00010000:0.0:1788528477.859253:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528477.859256:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c87d6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.859262:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c87d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.859278:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c87dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.859284:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c87dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.859290:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c87dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.859294:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528477.859297:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c87dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.859304:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c87dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.859319:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a90c87bee00) 00010000:00010000:0.0:1788528477.859322:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528477.859325:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c87dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.859332:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c87dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528477.859406:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc327d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+35:12399:x1875407719722112:12345-192.168.203.38@tcp:34:lfs.0 Request processed in 562us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528477.859413:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 210 00000100:00100000:2.0:1788528477.892892:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528477.893159:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719722368 00000100:00100000:0.0:1788528477.893170:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719722368 00000100:00100000:0.0:1788528477.893238:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 211 00000100:00100000:0.0:1788528477.893249:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+35:12402:x1875407719722368:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1788528477.893269:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528477.893291:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c87e4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bff93 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.893366:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c87eb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.893380:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c87eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.893392:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c87eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.893406:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c87f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.893433:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c87f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.893440:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c87f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.893541:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c87f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.893550:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c87f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.893913:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c87f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788528477.893925:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788528477.894004:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c87eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.894010:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c87eb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.894017:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c87eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.894023:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031e00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528477.894027:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c87eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.894034:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c87eb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.894059:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:0.0:1788528477.894062:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528477.894067:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c87eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.894073:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c87eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.894086:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c87f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.894142:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c87f2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.894146:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c87f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.894149:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528477.894151:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c87f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.894155:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c87f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.894160:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a90c87be900) 00010000:00010000:0.0:1788528477.894162:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528477.894164:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c87f2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.894168:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c87f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.894209:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c87e4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff93 expref: 38 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.894220:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c87f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff93 expref: 37 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.894227:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a90c87bee00) 00010000:00010000:0.0:1788528477.894229:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788528477.894231:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0030200, rc 0) 00000100:00100000:0.0:1788528477.894370:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+37:12402:x1875407719722368:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 1122us (1486us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1788528477.894377:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 211 00000100:00100000:3.0:1788528477.898299:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528477.899778:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719722496 00000100:00100000:2.0:1788528477.899789:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719722496 00000100:00100000:2.0:1788528477.900644:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 212 00000100:00100000:2.0:1788528477.900658:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+37:12402:x1875407719722496:12345-192.168.203.38@tcp:54:lfs.0 00010000:00010000:2.0:1788528477.900736:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c8807 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528477.900753:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c879e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff77 expref: 37 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528477.900761:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c8807 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528477.900793:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c879e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff77 expref: 37 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528477.900805:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c879e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff77 expref: 37 pid: 6510 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528477.900829:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe691880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8449:1875407735506176:192.168.203.38@tcp:104: 00000100:00100000:2.0:1788528477.900940:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c96fe0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528477.905070:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528477.905187:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe691880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8449:1875407735506176:192.168.203.38@tcp:104: 00010000:00010000:1.0:1788528477.905213:0:8449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c8807 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528477.906534:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719722752 00000100:00100000:3.0:1788528477.906545:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719722752 00000100:00100000:3.0:1788528477.906674:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:3.0:1788528477.906684:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+38:6169:x1875407719722752:12345-192.168.203.38@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788528477.906984:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+39:6169:x1875407719722752:12345-192.168.203.38@tcp:35:ldlm_bl.0 Request processed in 301us (1921us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788528477.907812:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:3.0:1788528477.910327:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528477.910495:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719722880 00000100:00100000:0.0:1788528477.910504:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719722880 00010000:00010000:0.0:1788528477.910540:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c879e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff77 expref: 39 pid: 6510 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528477.910612:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 99 00000100:00100000:0.0:1788528477.910622:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4543b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+39:2403:x1875407719722880:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788528477.910636:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528477.910643:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c879e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff77 expref: 39 pid: 6510 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.910655:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c879e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff77 expref: 39 pid: 6510 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.911187:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c879e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff77 expref: 39 pid: 6510 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.911206:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a90c87bee00) 00010000:00010000:0.0:1788528477.911212:0:6493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c8807 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.911222:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c8807 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.911229:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c8807 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528477.911261:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528477.911322:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4543b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+38:2403:x1875407719722880:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 701us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528477.911331:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 99 00010000:00010000:1.0:1788528477.911391:0:8449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c8807 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.911400:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c8807 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.911440:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c8807 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.911447:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c8807 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.911454:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c8807 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.911461:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101851400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528477.911473:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c8807 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.911481:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c8807 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.911492:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a90c87bee00) 00010000:00010000:1.0:1788528477.911495:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788528477.911499:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c8807 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528477.911505:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c8807 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528477.911545:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+37:12402:x1875407719722496:12345-192.168.203.38@tcp:54:lfs.0 Request processed in 10890us (13253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528477.912254:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 212 00000100:00100000:0.0:1788528477.915745:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528477.915936:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719723136 00000100:00100000:2.0:1788528477.915946:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719723136 00000100:00100000:2.0:1788528477.916002:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:2.0:1788528477.916012:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+37:12402:x1875407719723136:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:2.0:1788528477.916267:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+38:12402:x1875407719723136:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 255us (1531us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788528477.916275:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:2.0:1788528478.026617:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528478.029400:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719723392 00000100:00100000:0.0:1788528478.029420:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719723392 00000100:00100000:0.0:1788528478.029528:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 213 00000100:00100000:0.0:1788528478.029541:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+38:12414:x1875407719723392:12345-192.168.203.38@tcp:101:cat.0 00010000:00010000:0.0:1788528478.029608:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528478.029636:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c880e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bff9a expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.029731:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8815 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.029782:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8815 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.029797:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8815 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.029816:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c881c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.029823:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c881c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.029831:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c881c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.029999:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c8823 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.030010:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c8823 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.030018:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c8823 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788528478.030030:0:13480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788528478.030384:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8815 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.030394:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8815 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.030401:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8815 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.030417:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031e00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528478.030423:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8815 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.030431:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8815 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.030446:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:0.0:1788528478.030449:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528478.030454:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8815 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.030459:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8815 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.030475:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c881c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.030480:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c881c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.030485:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c881c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.030490:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528478.030492:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c881c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.030498:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c881c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.030515:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a90c87be900) 00010000:00010000:0.0:1788528478.030518:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528478.030521:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c881c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.030527:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c881c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.030712:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c880e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff9a expref: 41 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.030729:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c8823 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff9a expref: 40 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.030748:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a90c87bee00) 00010000:00010000:0.0:1788528478.030751:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788528478.030754:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031a00, rc 0) 00000100:00100000:0.0:1788528478.030859:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+40:12414:x1875407719723392:12345-192.168.203.38@tcp:101:cat.0 Request processed in 1320us (4251us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788528478.030879:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 213 00000100:00100000:1.0:1788528478.047667:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528478.047827:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719723648 00000100:00100000:3.0:1788528478.047840:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719723648 00000100:00100000:3.0:1788528478.048287:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:3.0:1788528478.048300:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+40:12414:x1875407719723648:12345-192.168.203.38@tcp:35:cat.0 00000100:00100000:3.0:1788528478.048758:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+41:12414:x1875407719723648:12345-192.168.203.38@tcp:35:cat.0 Request processed in 459us (1104us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788528478.048768:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:2.0:1788528478.083022:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528478.084635:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719723904 00000100:00100000:0.0:1788528478.084652:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719723904 00000100:00100000:0.0:1788528478.084741:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 214 00000100:00100000:0.0:1788528478.084752:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+41:12415:x1875407719723904:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:0.0:1788528478.085518:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1788528478.085661:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c87c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff85 expref: 41 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.085736:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c8823 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff9a expref: 40 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.085752:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c87f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff93 expref: 39 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.085768:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c87b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff7e expref: 38 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.085781:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a90c87bee00) 00010000:00010000:0.0:1788528478.085926:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788528478.086244:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c8831 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.086263:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c8831 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.086276:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c8831 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.086296:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8838 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.086303:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8838 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.086323:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8838 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.088904:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c883f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.088933:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c883f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.088946:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c883f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788528478.089607:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:1.0:1788528478.089621:0:6508:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 347307066098ns, next at 348307062442ns, rc = 0 00010000:00010000:1.0:1788528478.089690:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8846 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.089702:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8846 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.089712:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8846 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.089722:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8846 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.089729:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8846 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.089736:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8846 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.089789:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788528478.089820:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c883f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.089827:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c883f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.089835:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c883f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.089842:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528478.089847:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c883f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.089856:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c883f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.089880:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a90c87bee00) 00010000:00010000:1.0:1788528478.089884:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788528478.089889:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c883f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.089896:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c883f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.089920:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c8831 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.089926:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c8831 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.089931:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c8831 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.089943:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528478.089946:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c8831 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.089952:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c8831 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.089961:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:1.0:1788528478.089964:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528478.090778:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788528478.090791:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8846 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528478.090800:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17800 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528478.090804:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8846 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528478.090811:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8846 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528478.090824:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a90c87bee00) 00010000:00010000:2.0:1788528478.090827:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788528478.090831:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8846 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528478.090837:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8846 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528478.090852:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528478.090854:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528478.090856:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528478.090958:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c8831 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.091025:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c8831 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788528478.091041:0:6508:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad07da70 reply state 000000009dbcd6cc transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8838 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.091215:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8838 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.091222:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a90c82d0700) 00010000:00010000:1.0:1788528478.091225:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788528478.091229:0:6508:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788528478.091357:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+39:12415:x1875407719723904:12345-192.168.203.38@tcp:36:rm.0 Request processed in 6599us (8402us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788528478.091366:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 214 00000100:00100000:0.0:1788528478.162534:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528478.162926:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719724160 00000100:00100000:1.0:1788528478.162940:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719724160 00000100:00100000:1.0:1788528478.163028:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 215 00000100:00100000:1.0:1788528478.163055:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+39:12421:x1875407719724160:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:1.0:1788528478.163105:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528478.163133:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c884d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bffa1 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.163287:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c8854 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.163308:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c8854 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.163322:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c8854 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.163347:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c885b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.163356:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c885b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.163373:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c885b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788528478.163816:0:8449:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788528478.163998:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8862 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.164008:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8862 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.164016:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8862 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.164059:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c8854 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.164066:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c8854 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.164074:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c8854 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.164080:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528478.164086:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c8854 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.164095:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c8854 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.164109:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:1.0:1788528478.164112:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528478.164118:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c8854 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.164766:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c8854 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788528478.164791:0:8449:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000084a8ba45 reply state 00000000535afbca transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c885b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.164806:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c885b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.164813:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a90c82d0700) 00010000:00010000:1.0:1788528478.164826:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788528478.164830:0:8449:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788528478.165179:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c884d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffa1 expref: 42 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.165199:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8862 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffa1 expref: 41 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.165207:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0900) 00010000:00010000:1.0:1788528478.165209:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788528478.165212:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e17800, rc 0) 00000100:00100000:1.0:1788528478.165485:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+42:12421:x1875407719724160:12345-192.168.203.38@tcp:101:bash.0 Request processed in 2429us (2962us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788528478.165498:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 215 00000100:00100000:3.0:1788528478.171743:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528478.171851:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719724288 00000100:00100000:1.0:1788528478.171863:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719724288 00000100:00100000:1.0:1788528478.171972:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 67 00000100:00100000:1.0:1788528478.171984:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2406:x1875407719724288:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:1.0:1788528478.172008:0:8422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528478.172035:0:8422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042354e26/0x892c60dda91c8870 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bffa8 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788528478.172066:0:8422:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788528478.172092:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=347s v=(0 0) 00010000:00010000:1.0:1788528478.172097:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788528478.172107:0:8422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042354e26/0x892c60dda91c8870 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffa8 expref: 8 pid: 8422 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.172149:0:8422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042354e26/0x892c60dda91c8870 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffa8 expref: 8 pid: 8422 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.172166:0:8422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e16200, rc 0) 00000100:00100000:1.0:1788528478.172249:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:2406:x1875407719724288:12345-192.168.203.38@tcp:101:bash.0 Request processed in 267us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528478.172257:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 67 00000100:00080000:2.0:1788528478.172316:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788528478.177816:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528478.177933:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719724416 00000100:00100000:0.0:1788528478.177944:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719724416 00000100:00100000:0.0:1788528478.178012:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 68 00000100:00100000:0.0:1788528478.178023:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:12421:x1875407719724416:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:0.0:1788528478.178041:0:8725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528478.178059:0:8725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000090b2947/0x892c60dda91c8877 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bffaf expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.178091:0:8725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042354e26/0x892c60dda91c8870 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffa8 expref: 9 pid: 8422 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.178101:0:8725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788528478.178106:0:8725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788528478.178128:0:8725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000090b2947/0x892c60dda91c8877 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffaf expref: 9 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.178327:0:8725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000042354e26/0x892c60dda91c8870 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffa8 expref: 9 pid: 8422 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.178342:0:8725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000042354e26/0x892c60dda91c8870 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffa8 expref: 9 pid: 8422 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528478.178354:0:8725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4674380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8725:1875407735506304:192.168.203.38@tcp:104: 00000100:00100000:0.0:1788528478.178654:0:8725:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ef8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788528478.185442:0:8725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4674380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8725:1875407735506304:192.168.203.38@tcp:104: 00010000:00010000:0.0:1788528478.185482:0:8725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000090b2947/0x892c60dda91c8877 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffaf expref: 9 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.185503:0:8725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0030200, rc 0) 00000100:00100000:0.0:1788528478.185597:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+9:12421:x1875407719724416:12345-192.168.203.38@tcp:101:bash.0 Request processed in 7574us (7788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528478.185606:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 68 00000100:00100000:3.0:1788528478.187029:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528478.187228:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719724544 00000100:00100000:2.0:1788528478.187251:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719724544 00010000:00010000:2.0:1788528478.187289:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000042354e26/0x892c60dda91c8870 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffa8 expref: 9 pid: 8422 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528478.187330:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 100 00000100:00100000:2.0:1788528478.187340:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4541c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+9:2404:x1875407719724544:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528478.187356:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528478.187378:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000042354e26/0x892c60dda91c8870 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffa8 expref: 9 pid: 8422 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528478.187471:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000042354e26/0x892c60dda91c8870 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffa8 expref: 9 pid: 8422 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528478.187496:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042354e26/0x892c60dda91c8870 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffa8 expref: 9 pid: 8422 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528478.187513:0:10330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528478.187518:0:10330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528478.187525:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000090b2947/0x892c60dda91c8877 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffaf expref: 8 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528478.187536:0:10330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000090b2947/0x892c60dda91c8877 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffaf expref: 8 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528478.187690:0:10330:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000090b2947/0x892c60dda91c8877 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffaf expref: 8 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528478.187718:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10330:1875407735506432:192.168.203.38@tcp:105: 00000100:00100000:2.0:1788528478.187799:0:10330:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c96fec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788528478.193694:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528478.193889:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719724800 00000100:00100000:1.0:1788528478.193899:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719724800 00000100:00100000:1.0:1788528478.193953:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 55 00000100:00100000:1.0:1788528478.193964:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+42:12421:x1875407719724800:12345-192.168.203.38@tcp:35:bash.0 00000100:00100000:1.0:1788528478.194417:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+43:12421:x1875407719724800:12345-192.168.203.38@tcp:35:bash.0 Request processed in 454us (731us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1788528478.194425:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 55 00000100:00100000:0.0:1788528478.194602:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10330:1875407735506432:192.168.203.38@tcp:105: 00010000:00010000:0.0:1788528478.194622:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528478.194646:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4541c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:2404:x1875407719724544:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 7308us (7624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528478.194654:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 100 00010000:00010000:1.0:1788528478.336905:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528478.398943:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735506560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788528478.399012:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528478.399123:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735506560 00000100:00100000:0.0:1788528478.399140:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735506560 00000100:00100000:0.0:1788528478.399188:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788528478.399197:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735506560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788528478.399238:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:0.0:1788528478.401259:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735506560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2054us (2238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528478.401274:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788528478.401826:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735506560:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788528478.430862:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528478.431133:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719724928 00000100:00100000:1.0:1788528478.431143:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719724928 00000100:00100000:1.0:1788528478.431240:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 216 00000100:00100000:1.0:1788528478.431250:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+43:12437:x1875407719724928:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1788528478.431273:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528478.431307:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c887e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bffb6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.431375:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c8885 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.431389:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c8885 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.431411:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c8885 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528478.431453:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788528478.431457:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788528478.431478:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c8885 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.431502:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c887e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffb6 expref: 45 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.431520:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c8885 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffb6 expref: 44 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.431528:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:1.0:1788528478.431531:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788528478.431536:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e16e00, rc 0) 00000100:00100000:1.0:1788528478.431755:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+44:12437:x1875407719724928:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 506us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528478.431763:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 216 00000100:00100000:3.0:1788528478.438650:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528478.438749:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719725184 00000100:00100000:1.0:1788528478.438775:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719725184 00000100:00100000:1.0:1788528478.438888:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 217 00000100:00100000:1.0:1788528478.438899:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+44:12437:x1875407719725184:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1788528478.438919:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528478.438938:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c888c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bffbd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.439064:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8893 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.439078:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8893 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.439090:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8893 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528478.439101:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788528478.439196:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c888c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffbd expref: 47 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.439213:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8893 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffbd expref: 46 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.439222:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0900) 00010000:00010000:1.0:1788528478.439224:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788528478.439228:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e17200, rc 0) 00000100:00100000:1.0:1788528478.439289:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+46:12437:x1875407719725184:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 392us (649us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1788528478.439296:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 217 00000100:00100000:3.0:1788528478.446302:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528478.446393:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719725568 00000100:00100000:2.0:1788528478.446403:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719725568 00000100:00100000:2.0:1788528478.446465:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:2.0:1788528478.446474:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4540000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+46:2406:x1875407719725568:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528478.446489:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528478.446512:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c8893 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffbd expref: 46 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528478.446529:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0900) 00010000:00010000:2.0:1788528478.446535:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528478.446631:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4540000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+45:2406:x1875407719725568:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 157us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528478.446639:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:0.0:1788528478.448660:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528478.448753:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719725440 00000100:00100000:1.0:1788528478.448763:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719725440 00000100:00100000:1.0:1788528478.448821:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 218 00000100:00100000:1.0:1788528478.448831:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4674a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+45:12437:x1875407719725440:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1788528478.448854:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528478.448885:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c88a1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bffc4 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.449148:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c88a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.449164:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c88a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.449176:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c88a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528478.449188:0:8449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788528478.449285:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c88a1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffc4 expref: 48 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.449302:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c88a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffc4 expref: 47 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.449312:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0900) 00010000:00010000:1.0:1788528478.449315:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788528478.449318:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e16200, rc 0) 00000100:00100000:1.0:1788528478.449379:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4674a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+47:12437:x1875407719725440:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 550us (726us total) trans 4294967488 rc 0/0 00000100:00100000:1.0:1788528478.449404:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 218 00000100:00100000:0.0:1788528478.465945:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528478.466154:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719725696 00000100:00100000:1.0:1788528478.466163:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719725696 00000100:00100000:1.0:1788528478.466219:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 69 00000100:00100000:1.0:1788528478.466228:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4674e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:2404:x1875407719725696:12345-192.168.203.38@tcp:1:lfs.0 00010000:00010000:1.0:1788528478.466436:0:8422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d809a420/0x892c60dda91c88b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.466455:0:8422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000090b2947/0x892c60dda91c8877 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffaf expref: 8 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.466465:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788528478.466469:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788528478.466473:0:8422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d809a420/0x892c60dda91c88b6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.466507:0:8422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000090b2947/0x892c60dda91c8877 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffaf expref: 8 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.466522:0:8422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000090b2947/0x892c60dda91c8877 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffaf expref: 8 pid: 8725 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528478.466536:0:8422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8422:1875407735506688:192.168.203.38@tcp:104: 00000100:00100000:1.0:1788528478.466669:0:8422:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3922300 going to sleep for 11 seconds 00000100:00100000:3.0:1788528478.477686:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528478.477836:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719725824 00000100:00100000:2.0:1788528478.477846:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719725824 00002000:00100000:2.0:1788528478.477912:0:8427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8a8fc4540a80 x1875407719725824/t0(0) o4->80304108-f3b9-46ea-888c-b2a7ec20e3e2@192.168.203.38@tcp:684/0 lens 504/0 e 0 to 0 dl 1788528489 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788528478.477923:0:8427:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a8fc4540a80 with x1875407719725824 ext(0->8) 00010000:00010000:2.0:1788528478.477935:0:8427:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000090b2947/0x892c60dda91c8877 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffaf expref: 9 pid: 8725 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528478.477973:0:8427:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000090b2947/0x892c60dda91c8877 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffaf expref: 9 pid: 8725 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788528478.477982:0:8427:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a8fc4540a80 00000100:00100000:2.0:1788528478.478026:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:2.0:1788528478.478036:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+9:2404:x1875407719725824:12345-192.168.203.38@tcp:4:lfs.0 00000100:00100000:1.0:1788528478.479704:0:8422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8422:1875407735506688:192.168.203.38@tcp:104: 00010000:00010000:1.0:1788528478.479741:0:8422:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d809a420/0x892c60dda91c88b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528478.480785:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+11:2404:x1875407719725824:12345-192.168.203.38@tcp:4:lfs.0 Request processed in 2746us (3103us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788528478.480798:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 3 00002000:00100000:1.0:1788528478.480810:0:8427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8a8fc4540a80 x1875407719725824/t4294967309(0) o4->80304108-f3b9-46ea-888c-b2a7ec20e3e2@192.168.203.38@tcp:684/0 lens 504/448 e 0 to 0 dl 1788528489 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788528478.480819:0:8427:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a8fc4540a80 with x1875407719725824 ext(0->8) 00010000:00010000:1.0:1788528478.480829:0:8427:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000090b2947/0x892c60dda91c8877 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffaf expref: 11 pid: 8725 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.480846:0:8427:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000090b2947/0x892c60dda91c8877 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffaf expref: 11 pid: 8725 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788528478.480854:0:8427:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a8fc4540a80 00000001:00080000:1.0:1788528478.485623:0:8416:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1788528478.485644:0:8416:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1788528478.496066:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528478.497283:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719725952 00000100:00100000:3.0:1788528478.497295:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719725952 00010000:00010000:3.0:1788528478.497337:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000090b2947/0x892c60dda91c8877 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffaf expref: 7 pid: 8725 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528478.497388:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 101 00000100:00100000:3.0:1788528478.497398:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4472d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2403:x1875407719725952:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788528478.497412:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788528478.497428:0:6493:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788528478.497432:0:6493:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788528478 00002000:00010000:3.0:1788528478.497434:0:6493:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788528478 00002000:00010000:3.0:1788528478.497437:0:6493:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788528478 00002000:00010000:3.0:1788528478.497439:0:6493:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788528478.497446:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000090b2947/0x892c60dda91c8877 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffaf expref: 7 pid: 8725 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528478.497460:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000090b2947/0x892c60dda91c8877 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffaf expref: 7 pid: 8725 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528478.497482:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000090b2947/0x892c60dda91c8877 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffaf expref: 7 pid: 8725 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528478.497516:0:6493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788528478.497520:0:6493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788528478.497526:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d809a420/0x892c60dda91c88b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528478.497535:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d809a420/0x892c60dda91c88b6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528478.497615:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528478.497667:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4472d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+6:2403:x1875407719725952:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 270us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528478.497674:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 101 00010000:00010000:1.0:1788528478.498063:0:8422:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d809a420/0x892c60dda91c88b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.498075:0:8422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d809a420/0x892c60dda91c88b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.498095:0:8422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d809a420/0x892c60dda91c88b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.498115:0:8422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d809a420/0x892c60dda91c88b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.498133:0:8422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d809a420/0x892c60dda91c88b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.498141:0:8422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16800 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528478.498145:0:8422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d809a420/0x892c60dda91c88b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.498154:0:8422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d809a420/0x892c60dda91c88b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.498166:0:8422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d809a420/0x892c60dda91c88b6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.498174:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d809a420/0x892c60dda91c88b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528478.498235:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4674e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2404:x1875407719725696:12345-192.168.203.38@tcp:1:lfs.0 Request processed in 32007us (32300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528478.498244:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 69 00000100:00100000:0.0:1788528478.503994:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528478.504146:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719726208 00000100:00100000:3.0:1788528478.504156:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719726208 00000100:00100000:3.0:1788528478.504220:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:3.0:1788528478.504230:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e14050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+47:12437:x1875407719726208:12345-192.168.203.38@tcp:35:lfs.0 00000004:00010000:3.0:1788528478.504292:0:6511:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c88a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffc4 expref: 47 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788528478.504518:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1788528478.504547:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:2.0:1788528478.510345:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:2.0:1788528478.510428:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850c00/0x892c60dda91c88bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528478.510449:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8862 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffa1 expref: 51 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528478.510459:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850c00/0x892c60dda91c88bd lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528478.510496:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8862 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffa1 expref: 51 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528478.510513:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8862 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffa1 expref: 51 pid: 8449 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528478.510526:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6511:1875407735506816:192.168.203.38@tcp:104: 00000100:00100000:2.0:1788528478.510641:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c96fed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788528478.517960:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6511:1875407735506816:192.168.203.38@tcp:104: 00010000:00010000:2.0:1788528478.518008:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850c00/0x892c60dda91c88bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528478.519801:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528478.520200:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719726336 00000100:00100000:2.0:1788528478.520209:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719726336 00010000:00010000:2.0:1788528478.520248:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8862 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffa1 expref: 52 pid: 8449 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528478.520288:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 102 00000100:00100000:2.0:1788528478.520299:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4471500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+52:2403:x1875407719726336:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528478.520313:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528478.520320:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8862 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffa1 expref: 52 pid: 8449 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528478.520333:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8862 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffa1 expref: 52 pid: 8449 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528478.520355:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c8862 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffa1 expref: 52 pid: 8449 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528478.520372:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0900) 00010000:00010000:2.0:1788528478.520434:0:10330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850c00/0x892c60dda91c88bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528478.520444:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850c00/0x892c60dda91c88bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528478.520452:0:10330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850c00/0x892c60dda91c88bd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528478.520537:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528478.520632:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4471500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+51:2403:x1875407719726336:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 333us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528478.520639:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 102 00010000:00010000:0.0:1788528478.528108:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850c00/0x892c60dda91c88bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.528125:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850c00/0x892c60dda91c88bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788528478.528306:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:0.0:1788528478.528761:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:0.0:1788528478.528854:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4472680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6511:1875407735506944:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788528478.529482:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528478.529600:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ef89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528478.533304:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735506944 00000100:00100000:1.0:1788528478.533316:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735506944 00000100:00100000:1.0:1788528478.533436:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788528478.533457:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6511:x1875407735506944:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788528478.533599:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6511:x1875407735506944:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 143us (4118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528478.533606:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788528478.533695:0:6511:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:0.0:1788528478.533702:0:6511:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:0.0:1788528478.534900:0:6511:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a8fc45e9f80, transno 4294967308 00000100:00100000:0.0:1788528478.534929:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4472680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6511:1875407735506944:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788528478.535090:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:0.0:1788528478.535304:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4472680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6511:1875407735507072:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788528478.535356:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528478.553302:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735507072 00000100:00100000:3.0:1788528478.553318:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735507072 00000100:00100000:0.0:1788528478.553514:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ef8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528478.553720:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788528478.553732:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4470700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6511:x1875407735507072:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788528478.553978:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4470700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6511:x1875407735507072:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 248us (18621us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788528478.553993:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788528478.554162:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4472680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6511:1875407735507072:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788528478.554226:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:0.0:1788528478.554268:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850c00/0x892c60dda91c88bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.554279:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850c00/0x892c60dda91c88bd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.554287:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850c00/0x892c60dda91c88bd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.554294:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850c00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528478.554298:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850c00/0x892c60dda91c88bd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.554307:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850c00/0x892c60dda91c88bd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.554324:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0900) 00010000:00010000:0.0:1788528478.554327:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788528478.554331:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850c00/0x892c60dda91c88bd lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.554337:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850c00/0x892c60dda91c88bd lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788528478.554449:0:6511:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788528478.554511:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1788528478.554520:0:6511:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 347771966201ns, next at 348771964078ns, rc = 0 00000001:00080000:0.0:1788528478.554526:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:0.0:1788528478.554547:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0900) 00010000:00010000:0.0:1788528478.554550:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788528478.554590:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c88a8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffc4 expref: 55 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528478.554681:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e14050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+54:12437:x1875407719726208:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 50452us (50696us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788528478.554690:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 56 00000020:00080000:0.0:1788528478.554694:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788528478.561952:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528478.562099:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719726464 00000100:00100000:1.0:1788528478.562108:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719726464 00000100:00100000:1.0:1788528478.562169:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 219 00000100:00100000:1.0:1788528478.562181:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+54:12437:x1875407719726464:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1788528478.562204:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528478.562224:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c88c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bffcb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.562279:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c88c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffcb expref: 55 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.562292:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c88c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffcb expref: 55 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.562309:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:1.0:1788528478.562313:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788528478.562316:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e16800, rc 0) 00000100:00100000:1.0:1788528478.562375:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+55:12437:x1875407719726464:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 196us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528478.562383:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 219 00000100:00100000:3.0:1788528478.572015:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528478.572228:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719726720 00000100:00100000:1.0:1788528478.572237:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719726720 00000100:00100000:1.0:1788528478.572291:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:1.0:1788528478.572310:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+55:12437:x1875407719726720:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:1.0:1788528478.572525:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+56:12437:x1875407719726720:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 216us (518us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1788528478.572533:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:2.0:1788528478.738328:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528478.738448:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719726848 00000100:00100000:1.0:1788528478.738459:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719726848 00000100:00100000:1.0:1788528478.738528:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 220 00000100:00100000:1.0:1788528478.738537:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+56:12447:x1875407719726848:12345-192.168.203.38@tcp:34:lfs.0 00010000:00010000:1.0:1788528478.738635:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c88cb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.738652:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c88cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.738664:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c88cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.738676:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c88d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.738684:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c88d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.738690:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c88d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.738767:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c88d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.738776:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c88d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.738796:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c88d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788528478.738841:0:6508:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c88d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.738853:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c88cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.738859:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c88cb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.738878:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c88cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.738884:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528478.738888:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c88cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.738896:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c88cb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.738907:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:1.0:1788528478.738910:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528478.738914:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c88cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.738921:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c88cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.738932:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c88d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.738944:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c88d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.738949:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c88d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.738953:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528478.738956:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c88d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.738963:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c88d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.738970:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a90c82d0700) 00010000:00010000:1.0:1788528478.738972:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528478.738975:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c88d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.738980:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c88d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.738989:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c88d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.738994:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c88d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.738999:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c88d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.739003:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528478.739010:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c88d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.739016:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c88d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.739024:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:1.0:1788528478.739026:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528478.739029:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c88d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.739034:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c88d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528478.739111:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+56:12447:x1875407719726848:12345-192.168.203.38@tcp:34:lfs.0 Request processed in 574us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528478.739120:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 220 00000100:00100000:0.0:1788528478.807391:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528478.807623:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719727104 00000100:00100000:1.0:1788528478.807634:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719727104 00000100:00100000:1.0:1788528478.807699:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 221 00000100:00100000:1.0:1788528478.807709:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+56:12450:x1875407719727104:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1788528478.807729:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528478.807748:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c88e0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bffd2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.807829:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c88e7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.807844:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c88e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.807885:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c88e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.807899:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c88ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.807906:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c88ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.807913:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c88ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.808270:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c88f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.808279:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c88f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.808286:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c88f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528478.808296:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788528478.808376:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c88e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.808383:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c88e7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.808390:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c88e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.808396:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528478.808407:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c88e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.808415:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c88e7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.808428:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:1.0:1788528478.808431:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528478.808435:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c88e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.808442:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17800/0x892c60dda91c88e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.808456:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c88ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.808462:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c88ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.808467:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c88ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.808472:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528478.808475:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c88ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.808481:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c88ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.808489:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a90c82d0700) 00010000:00010000:1.0:1788528478.808492:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528478.808501:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c88ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.808507:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16200/0x892c60dda91c88ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.808543:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17200/0x892c60dda91c88e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffd2 expref: 59 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.808875:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c88f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffd2 expref: 58 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.808885:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:1.0:1788528478.808887:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788528478.808890:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c1550800, rc 0) 00000100:00100000:0.0:1788528478.809350:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+58:12450:x1875407719727104:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 1640us (1968us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1788528478.809360:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 221 00000100:00100000:3.0:1788528478.815627:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528478.815673:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719727232 00000100:00100000:0.0:1788528478.815683:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719727232 00000100:00100000:0.0:1788528478.815776:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 222 00000100:00100000:0.0:1788528478.815786:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+58:12450:x1875407719727232:12345-192.168.203.38@tcp:54:lfs.0 00010000:00010000:0.0:1788528478.815870:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c8903 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.815890:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c8903 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.815902:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c8903 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.815961:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c8903 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.815969:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c8903 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.815975:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c8903 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.815981:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528478.815986:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c8903 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.815994:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c8903 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.816007:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:0.0:1788528478.816010:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788528478.816014:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c8903 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.816021:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c8903 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528478.816110:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+58:12450:x1875407719727232:12345-192.168.203.38@tcp:54:lfs.0 Request processed in 325us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528478.816118:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 222 00000100:00100000:3.0:1788528478.819296:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528478.819567:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719727488 00000100:00100000:1.0:1788528478.819578:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719727488 00000100:00100000:1.0:1788528478.819633:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:1.0:1788528478.819643:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+58:12450:x1875407719727488:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:1.0:1788528478.819904:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+59:12450:x1875407719727488:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 263us (616us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1788528478.819912:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:3.0:1788528478.960006:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528478.960074:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719727744 00000100:00100000:2.0:1788528478.960085:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719727744 00000100:00100000:2.0:1788528478.960150:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 223 00000100:00100000:2.0:1788528478.960160:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+59:12460:x1875407719727744:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:2.0:1788528478.960184:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528478.960188:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788528478.960214:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c8885 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffb6 expref: 59 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528478.960234:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:2.0:1788528478.960238:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788528478.960251:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c890a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bffd9 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528478.960355:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851800/0x892c60dda91c8911 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528478.960369:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851800/0x892c60dda91c8911 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528478.960380:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851800/0x892c60dda91c8911 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528478.960409:0:8449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788528478.960517:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c890a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffd9 expref: 61 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528478.960530:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851800/0x892c60dda91c8911 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffd9 expref: 60 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528478.960538:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:2.0:1788528478.960541:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788528478.960544:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101851800, rc 0) 00000100:00100000:2.0:1788528478.960656:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+60:12460:x1875407719727744:12345-192.168.203.38@tcp:101:bash.0 Request processed in 497us (668us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1788528478.960664:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 223 00000100:00100000:3.0:1788528478.963481:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528478.963632:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719727872 00000100:00100000:0.0:1788528478.963646:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719727872 00000100:00100000:0.0:1788528478.963718:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:0.0:1788528478.963752:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90efa85850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+60:2403:x1875407719727872:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788528478.963767:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528478.963791:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851800/0x892c60dda91c8911 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffd9 expref: 60 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.963810:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:0.0:1788528478.963815:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528478.963935:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90efa85850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+59:2403:x1875407719727872:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 186us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528478.963942:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:2.0:1788528478.970080:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528478.970469:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719728000 00000100:00100000:0.0:1788528478.970478:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719728000 00000100:00100000:0.0:1788528478.970542:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 224 00000100:00100000:0.0:1788528478.970572:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+59:12460:x1875407719728000:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:0.0:1788528478.970595:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528478.970615:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c891f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bffe0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.970651:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c8926 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.970665:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c8926 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.970677:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c8926 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.970944:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c891f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffe0 expref: 61 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.970970:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c8926 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffe0 expref: 60 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.970978:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:0.0:1788528478.970981:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788528478.971227:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031a00, rc 0) 00000100:00100000:0.0:1788528478.971342:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+60:12460:x1875407719728000:12345-192.168.203.38@tcp:101:bash.0 Request processed in 790us (1272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528478.971349:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 224 00000100:00100000:1.0:1788528478.977737:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528478.977812:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719728256 00000100:00100000:0.0:1788528478.977822:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719728256 00000100:00100000:0.0:1788528478.977891:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 225 00000100:00100000:0.0:1788528478.977901:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+60:12460:x1875407719728256:12345-192.168.203.38@tcp:36:bash.0 00010000:00010000:0.0:1788528478.977952:0:13480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528478.977978:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c88f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffd2 expref: 60 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.978011:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:0.0:1788528478.978017:0:13480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788528478.978197:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c892d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.978212:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c892d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.978223:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c892d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788528478.978283:0:13480:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:0.0:1788528478.978307:0:13480:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a3881bd reply state 00000000898bbf1f transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c892d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.978319:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c892d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528478.978325:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:0.0:1788528478.978328:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788528478.978330:0:13480:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788528478.978436:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+62:12460:x1875407719728256:12345-192.168.203.38@tcp:36:bash.0 Request processed in 535us (717us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1788528478.978444:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 225 00000020:00080000:0.0:1788528478.978448:0:13480:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788528478.992469:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528478.992766:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719728384 00000100:00100000:1.0:1788528478.992777:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719728384 00000100:00100000:1.0:1788528478.992844:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 226 00000100:00100000:1.0:1788528478.992854:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+62:12460:x1875407719728384:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:1.0:1788528478.992888:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528478.992922:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550200/0x892c60dda91c8934 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bffe7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.993146:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550a00/0x892c60dda91c893b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.993163:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550a00/0x892c60dda91c893b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.993174:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550a00/0x892c60dda91c893b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528478.993204:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788528478.993208:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788528478.993227:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550a00/0x892c60dda91c893b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.993256:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550200/0x892c60dda91c8934 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffe7 expref: 64 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.993275:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550a00/0x892c60dda91c893b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffe7 expref: 63 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528478.993285:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:1.0:1788528478.993288:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788528478.993292:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c1550a00, rc 0) 00000100:00100000:1.0:1788528478.993359:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+63:12460:x1875407719728384:12345-192.168.203.38@tcp:101:bash.0 Request processed in 506us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528478.993366:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 226 00000100:00100000:3.0:1788528478.999919:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528479.000044:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719728640 00000100:00100000:2.0:1788528479.000054:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719728640 00000100:00100000:2.0:1788528479.000115:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:2.0:1788528479.000126:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+63:12460:x1875407719728640:12345-192.168.203.38@tcp:35:bash.0 00000100:00100000:2.0:1788528479.000341:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+64:12460:x1875407719728640:12345-192.168.203.38@tcp:35:bash.0 Request processed in 217us (430us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788528479.000351:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:3.0:1788528479.117796:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528479.118645:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719728768 00000100:00100000:0.0:1788528479.118656:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719728768 00000100:00100000:0.0:1788528479.118742:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 227 00000100:00100000:0.0:1788528479.118753:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+64:12466:x1875407719728768:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1788528479.118777:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528479.118798:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c8942 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bffee expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.118870:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8949 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.118886:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8949 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.118898:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8949 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788528479.118955:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788528479.118960:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788528479.118978:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8949 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.120946:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c8942 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffee expref: 66 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.120972:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8949 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffee expref: 65 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.120982:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:0.0:1788528479.120985:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788528479.120999:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031600, rc 0) 00000100:00100000:0.0:1788528479.121087:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+65:12466:x1875407719728768:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 2334us (3298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528479.121096:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 227 00000100:00080000:2.0:1788528479.122468:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788528479.126923:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528479.127020:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719728896 00000100:00100000:2.0:1788528479.127031:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719728896 00000100:00100000:2.0:1788528479.127097:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 228 00000100:00100000:2.0:1788528479.127108:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+65:12466:x1875407719728896:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1788528479.127144:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528479.127179:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c8950 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfff5 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.127245:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c8957 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.127259:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c8957 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.127270:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c8957 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.127282:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c895e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.127289:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c895e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.127295:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c895e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.127372:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c8965 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.127395:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c8965 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.127403:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c8965 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528479.127451:0:8449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788528479.127462:0:8449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788528479.127482:0:8449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c8965 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.127494:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c8965 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.127503:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c8957 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.127509:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c8957 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.127515:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c8957 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.127521:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528479.127525:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c8957 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.127532:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c8957 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.127543:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:2.0:1788528479.127546:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528479.127551:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c8957 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.127589:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c8957 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.127602:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c895e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.127632:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c895e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.127638:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c895e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.127646:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101851400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528479.127651:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c895e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.127656:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c895e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.127664:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a90c82d0700) 00010000:00010000:2.0:1788528479.127666:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528479.127669:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c895e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.127675:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c895e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.127701:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c8950 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfff5 expref: 67 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.127714:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c8965 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfff5 expref: 66 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.127721:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:2.0:1788528479.127723:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788528479.127733:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101850000, rc 0) 00000100:00100000:2.0:1788528479.128071:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+66:12466:x1875407719728896:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 964us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528479.128080:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 228 00000100:00100000:3.0:1788528479.133093:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528479.134256:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528479.134847:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719729280 00000100:00100000:2.0:1788528479.134857:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719729280 00000100:00100000:1.0:1788528479.134916:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719729152 00000100:00100000:2.0:1788528479.134931:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:1.0:1788528479.134935:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719729152 00000100:00100000:2.0:1788528479.134945:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+66:2403:x1875407719729280:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528479.134962:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528479.134996:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c8965 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfff5 expref: 66 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.135016:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:2.0:1788528479.135022:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528479.135085:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+66:2403:x1875407719729280:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 144us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528479.135094:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:1.0:1788528479.135119:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 229 00000100:00100000:1.0:1788528479.135129:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+65:12466:x1875407719729152:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1788528479.135145:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528479.135160:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550200/0x892c60dda91c896c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7bfffc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528479.135266:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c8973 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528479.135281:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550a00/0x892c60dda91c893b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffe7 expref: 66 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528479.135289:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c8973 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528479.135320:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550a00/0x892c60dda91c893b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffe7 expref: 66 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528479.135333:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550a00/0x892c60dda91c893b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffe7 expref: 66 pid: 6510 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528479.135346:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6510:1875407735507200:192.168.203.38@tcp:104: 00000100:00100000:1.0:1788528479.135681:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3ded180 going to sleep for 11 seconds 00000100:00100000:3.0:1788528479.147438:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528479.147512:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719729408 00000100:00100000:2.0:1788528479.147523:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719729408 00010000:00010000:2.0:1788528479.147596:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550a00/0x892c60dda91c893b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffe7 expref: 67 pid: 6510 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528479.147629:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 103 00000100:00100000:2.0:1788528479.147639:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+67:2404:x1875407719729408:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528479.147656:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528479.147663:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550a00/0x892c60dda91c893b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffe7 expref: 67 pid: 6510 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.147695:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550a00/0x892c60dda91c893b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffe7 expref: 67 pid: 6510 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.147720:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:2.0:1788528479.147725:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c8973 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.147735:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c8973 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.147743:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c8973 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.147762:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528479.147809:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+67:2404:x1875407719729408:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 172us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528479.147817:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 103 00010000:00010000:1.0:1788528479.151468:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550a00/0x892c60dda91c893b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffe7 expref: 66 pid: 6510 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528479.151495:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6510:1875407735507200:192.168.203.38@tcp:104: 00010000:00010000:1.0:1788528479.151537:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c8973 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528479.151548:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c8973 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528479.151594:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c8973 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528479.151617:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788528479.151746:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550200/0x892c60dda91c896c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfffc expref: 67 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528479.151763:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c8973 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfffc expref: 66 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528479.151773:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:1.0:1788528479.151776:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788528479.151780:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c1551a00, rc 0) 00000100:00100000:1.0:1788528479.151846:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+66:12466:x1875407719729152:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 16719us (18868us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1788528479.151852:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 229 00000100:00100000:3.0:1788528479.154285:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528479.154526:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719729664 00000100:00100000:0.0:1788528479.154538:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719729664 00000100:00100000:0.0:1788528479.154740:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:0.0:1788528479.154751:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+66:12466:x1875407719729664:12345-192.168.203.38@tcp:103:lfs.0 00010000:00010000:0.0:1788528479.154766:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528479.154790:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16800/0x892c60dda91c88c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffcb expref: 66 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.154810:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:0.0:1788528479.154829:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528479.154899:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+65:12466:x1875407719729664:12345-192.168.203.38@tcp:103:lfs.0 Request processed in 150us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528479.154907:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:3.0:1788528479.156961:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528479.157824:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719729792 00000100:00100000:0.0:1788528479.157838:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719729792 00000100:00100000:0.0:1788528479.157914:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 230 00000100:00100000:0.0:1788528479.157925:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+65:12466:x1875407719729792:12345-192.168.203.38@tcp:58:lfs.0 00010000:00010000:0.0:1788528479.158041:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8981 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.158058:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8981 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.158069:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8981 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788528479.158191:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788528479.158277:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+65:12466:x1875407719729792:12345-192.168.203.38@tcp:58:lfs.0 Request processed in 354us (1322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528479.158286:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 230 00000100:00100000:1.0:1788528479.160291:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528479.160369:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719729920 00000100:00100000:2.0:1788528479.160379:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719729920 00000100:00100000:2.0:1788528479.160432:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 231 00000100:00100000:2.0:1788528479.160442:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+65:12466:x1875407719729920:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1788528479.160461:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528479.160479:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c8988 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0003 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.160585:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8981 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.160607:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c8988 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0003 expref: 66 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.160625:0:8449:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8981 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.160637:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c8988 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0003 expref: 66 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.160654:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:2.0:1788528479.160658:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788528479.160662:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c8988 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0003 expref: 66 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.160669:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101850000, rc 0) 00000100:00100000:2.0:1788528479.160773:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+66:12466:x1875407719729920:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 331us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528479.160781:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 231 00010000:00010000:0.0:1788528479.360377:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788528479.806956:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788528479.806966:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788528479.807603:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1788528479.807613:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788528479.807823:0:13786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1875407735507328:192.168.203.38@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788528479.808111:0:13786:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c96fe300 going to sleep for 11 seconds 00000100:00100000:1.0:1788528479.820128:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528479.820276:0:13786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1875407735507328:192.168.203.38@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788528479.820752:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719730048 00000100:00100000:3.0:1788528479.820761:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719730048 00000100:00100000:3.0:1788528479.821152:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 232 00000100:00100000:3.0:1788528479.821169:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+66:12467:x1875407719730048:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788528479.821214:0:6510:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788528479.821354:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+66:12467:x1875407719730048:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 Request processed in 188us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528479.821363:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 232 00000100:00100000:3.0:1788528479.824307:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528479.824537:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719730176 00000100:00100000:0.0:1788528479.824549:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719730176 00000100:00100000:0.0:1788528479.824691:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 233 00000100:00100000:0.0:1788528479.824704:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+66:12467:x1875407719730176:12345-192.168.203.38@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788528479.824812:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c898f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.824921:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c898f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.824937:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c898f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.824957:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8996 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.824965:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8996 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.824971:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8996 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.825011:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c899d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.825021:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c899d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.825027:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c899d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788528479.825084:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788528479.825089:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788528479.825105:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c899d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.825117:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c898f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.825133:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c898f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.825141:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c898f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.825149:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528479.825154:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c898f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.825162:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c898f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.825177:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a8fc2721c00) 00010000:00010000:0.0:1788528479.825180:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528479.825186:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c898f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.825192:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c898f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.825208:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8996 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.825213:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8996 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.825218:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8996 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.825223:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528479.825231:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8996 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.825238:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8996 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.825246:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8a8fc264fb00) 00010000:00010000:0.0:1788528479.825249:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528479.825252:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8996 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.825257:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8996 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.825274:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c899d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.825280:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c899d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.825284:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c899d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.825288:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528479.825290:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c899d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.825295:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c899d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.825301:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:0.0:1788528479.825304:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528479.825311:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c899d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528479.825317:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c899d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528479.825700:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+66:12467:x1875407719730176:12345-192.168.203.38@tcp:34:lhsmtool_posix.0 Request processed in 996us (1405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528479.825709:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 233 00000100:00100000:0.0:1788528479.828927:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528479.829009:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719730432 00000100:00100000:3.0:1788528479.829021:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719730432 00000100:00100000:3.0:1788528479.829092:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 234 00000100:00100000:3.0:1788528479.829105:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e19450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+66:12467:x1875407719730432:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788528479.829131:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528479.829162:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c89a4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c000a expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528479.829303:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c89ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528479.829321:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c89ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528479.829335:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c89ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528479.829347:0:13480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788528479.829457:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c89ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528479.829467:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c89ab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528479.829476:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c89ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528479.829483:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3429000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528479.829488:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c89ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528479.829515:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c89ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528479.829530:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:3.0:1788528479.829534:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788528479.829540:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c89ab lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528479.829547:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c89ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528479.829621:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c89a4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c000a expref: 68 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528479.829633:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a8fc2721c00) 00010000:00010000:3.0:1788528479.829636:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788528479.829640:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c89a4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c000a expref: 68 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528479.829651:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3428400, rc 0) 00000100:00100000:3.0:1788528479.829730:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e19450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+67:12467:x1875407719730432:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 628us (818us total) trans 4294967506 rc 301/301 00000100:00100000:3.0:1788528479.829738:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 234 00000100:00100000:0.0:1788528479.850304:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528479.850454:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719730560 00000100:00100000:3.0:1788528479.850468:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719730560 00000100:00100000:3.0:1788528479.850544:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 235 00000100:00100000:3.0:1788528479.850597:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+67:12467:x1875407719730560:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788528479.850666:0:6510:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788528479.850810:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+67:12467:x1875407719730560:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 Request processed in 257us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528479.850818:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 235 00000100:00100000:0.0:1788528479.862494:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528479.862628:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719730816 00000100:00100000:2.0:1788528479.862666:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719730816 00000100:00100000:2.0:1788528479.862814:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 236 00000100:00100000:2.0:1788528479.862832:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+67:12467:x1875407719730816:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788528479.862872:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528479.862876:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788528479.862911:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031600/0x892c60dda91c8949 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffee expref: 67 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.862935:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:2.0:1788528479.862941:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788528479.862957:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c89b9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0011 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788528479.863505:0:6509:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:2.0:1788528479.863715:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c89c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.863731:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c89c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.863742:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c89c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.863797:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c89b9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0011 expref: 69 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.863813:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c89c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0011 expref: 68 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.863837:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a8fc2721600) 00010000:00010000:2.0:1788528479.863840:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788528479.863843:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101851400, rc 0) 00000100:00100000:2.0:1788528479.863953:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+68:12467:x1875407719730816:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 1127us (1467us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788528479.863961:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 236 00000100:00100000:0.0:1788528479.873021:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528479.873084:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719731072 00000100:00100000:2.0:1788528479.873098:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719731072 00000100:00100000:2.0:1788528479.873163:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 237 00000100:00100000:2.0:1788528479.873172:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+68:12467:x1875407719731072:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788528479.873249:0:13480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528479.873277:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c89c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0011 expref: 68 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.873296:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a8fc2721600) 00010000:00010000:2.0:1788528479.873307:0:13480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788528479.873329:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c89ce lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.873343:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c89ce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.873352:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c89ce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.873784:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c89d5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xf9632bba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.873826:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c89d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xf9632bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.873839:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c89d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xf9632bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.873905:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c89ce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.873913:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c89ce lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.873920:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c89ce lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.873926:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850e00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528479.873931:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c89ce lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.873937:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c89ce lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.873950:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:2.0:1788528479.873953:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528479.873957:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c89ce lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.873963:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c89ce lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.873982:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c89d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xf9632bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.873994:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c89d5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xf9632bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.873999:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c89d5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xf9632bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.874004:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528479.874007:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c89d5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xf9632bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.874013:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c89d5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xf9632bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.874020:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xf9632bba (ffff8a8fc2721f00) 00010000:00010000:2.0:1788528479.874023:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528479.874026:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c89d5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xf9632bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.874032:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c89d5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xf9632bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528479.874596:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+67:12467:x1875407719731072:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 1380us (1546us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788528479.874607:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 237 00000100:00100000:0.0:1788528479.888151:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528479.888286:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719731200 00000100:00100000:2.0:1788528479.888297:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719731200 00000100:00100000:2.0:1788528479.888348:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 238 00000100:00100000:2.0:1788528479.888358:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+67:12467:x1875407719731200:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788528479.888376:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528479.888413:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c89dc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0018 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.888451:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c89e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.888464:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c89e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.888475:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c89e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.888606:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c89dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0018 expref: 69 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.888624:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c89e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0018 expref: 68 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.888633:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a8fc2721f00) 00010000:00010000:2.0:1788528479.888636:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788528479.888640:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101850e00, rc 0) 00000100:00100000:2.0:1788528479.888703:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+68:12467:x1875407719731200:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 345us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528479.888710:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 238 00000100:00100000:0.0:1788528479.897439:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528479.897740:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719731456 00000100:00100000:2.0:1788528479.897751:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719731456 00000100:00100000:2.0:1788528479.897806:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 239 00000100:00100000:2.0:1788528479.897817:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+68:12467:x1875407719731456:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788528479.897907:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c89ea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.897937:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c89ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.897949:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c89ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788528479.898116:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1788528479.898126:0:6509:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 349115572306ns, next at 350115569700ns, rc = 0 00000004:00010000:2.0:1788528479.898174:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a93ee83b reply state 00000000bb0c79c9 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c89ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.898187:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c89ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.898195:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a8fc2721f00) 00010000:00010000:2.0:1788528479.898197:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788528479.898201:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788528479.898289:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+70:12467:x1875407719731456:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 473us (859us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1788528479.898296:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 239 00000100:00100000:0.0:1788528479.908926:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528479.909081:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719731584 00000100:00100000:2.0:1788528479.909091:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719731584 00000100:00100000:2.0:1788528479.909208:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 240 00000100:00100000:2.0:1788528479.909219:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+70:12467:x1875407719731584:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788528479.909241:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528479.909274:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c89f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c001f expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.909354:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c89f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c001f expref: 71 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.909368:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c89f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c001f expref: 71 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528479.909386:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a8fc2721f00) 00010000:00010000:2.0:1788528479.909390:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788528479.909394:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101851400, rc 0) 00000100:00100000:2.0:1788528479.909453:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+71:12467:x1875407719731584:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 234us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528479.909460:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 240 00000100:00100000:0.0:1788528479.937737:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528479.938078:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719731712 00000100:00100000:1.0:1788528479.938089:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719731712 00000100:00100000:1.0:1788528479.938171:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 70 00000100:00100000:1.0:1788528479.938182:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4472300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+9:2404:x1875407719731712:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788528479.938426:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4472300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+10:2404:x1875407719731712:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 Request processed in 245us (705us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788528479.938435:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 70 00000100:00080000:2.0:1788528479.939507:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788528479.942050:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528479.943849:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719731968 00000100:00100000:1.0:1788528479.943875:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719731968 00000100:00100000:1.0:1788528479.943944:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:1.0:1788528479.943955:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+71:12467:x1875407719731968:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788528479.944194:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+72:12467:x1875407719731968:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 240us (2154us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1788528479.944202:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:3.0:1788528479.959189:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528479.959590:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719732224 00000100:00100000:1.0:1788528479.959600:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719732224 00000100:00100000:1.0:1788528479.959662:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 241 00000100:00100000:1.0:1788528479.959672:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+72:12467:x1875407719732224:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788528479.959945:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+72:12467:x1875407719732224:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 274us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528479.959954:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 241 00000100:00100000:0.0:1788528479.966388:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528479.967030:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719732352 00000100:00100000:3.0:1788528479.967039:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719732352 00000100:00100000:3.0:1788528479.967209:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 242 00000100:00100000:3.0:1788528479.967221:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+72:12467:x1875407719732352:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788528479.967242:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528479.967333:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c89f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0026 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528479.967406:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c89ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528479.967421:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c89ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528479.967432:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c89ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528479.967476:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788528479.967497:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c89ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528479.967523:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428400/0x892c60dda91c89f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0026 expref: 74 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528479.967597:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c89ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0026 expref: 73 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528479.967605:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a8fc2721f00) 00010000:00010000:3.0:1788528479.967609:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788528479.967612:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3429000, rc 0) 00000100:00100000:3.0:1788528479.967669:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+73:12467:x1875407719732352:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 451us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528479.967676:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 242 00000100:00100000:0.0:1788528479.980637:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528479.981016:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719732480 00000100:00100000:3.0:1788528479.981026:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719732480 00000100:00100000:3.0:1788528479.981073:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 71 00000100:00100000:3.0:1788528479.981081:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+10:2404:x1875407719732480:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788528479.981112:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528479.981133:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3bb4113/0x892c60dda91c8a06 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c002d expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788528479.981159:0:8421:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ac760, blocks: 0x0 00010000:00010000:3.0:1788528479.981179:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=349s v=(0 0) 00010000:00010000:3.0:1788528479.981184:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528479.981193:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3bb4113/0x892c60dda91c8a06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c002d expref: 11 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528479.981212:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a3bb4113/0x892c60dda91c8a06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c002d expref: 11 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528479.981245:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3428400, rc 0) 00000100:00100000:3.0:1788528479.981318:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+11:2404:x1875407719732480:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 236us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528479.981325:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 71 00000100:00100000:0.0:1788528480.014198:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528480.014585:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719732736 00000100:00100000:2.0:1788528480.014595:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719732736 00000100:00100000:2.0:1788528480.014658:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 243 00000100:00100000:2.0:1788528480.014669:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+73:12467:x1875407719732736:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788528480.014795:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+73:12467:x1875407719732736:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 127us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528480.014804:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 243 00000100:00100000:0.0:1788528480.018520:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528480.019164:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719732864 00000100:00100000:1.0:1788528480.019174:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719732864 00000100:00100000:1.0:1788528480.019234:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 72 00000100:00100000:1.0:1788528480.019244:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4471f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+11:12467:x1875407719732864:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788528480.019270:0:8423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528480.019288:0:8423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e371e986/0x892c60dda91c8a0d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0034 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.019340:0:8423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a3bb4113/0x892c60dda91c8a06 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c002d expref: 12 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.019349:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788528480.019353:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788528480.019359:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e371e986/0x892c60dda91c8a0d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0034 expref: 12 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.019393:0:8423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a3bb4113/0x892c60dda91c8a06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c002d expref: 12 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.019407:0:8423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a3bb4113/0x892c60dda91c8a06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c002d expref: 12 pid: 8421 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528480.019421:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8423:1875407735507456:192.168.203.38@tcp:104: 00000100:00100000:1.0:1788528480.019535:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3ded180 going to sleep for 11 seconds 00000100:00100000:0.0:1788528480.030675:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528480.031104:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719732992 00000100:00100000:3.0:1788528480.031114:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719732992 00010000:00010000:3.0:1788528480.031154:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a3bb4113/0x892c60dda91c8a06 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c002d expref: 13 pid: 8421 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528480.031201:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 104 00000100:00100000:3.0:1788528480.031210:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4472a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+13:2403:x1875407719732992:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788528480.031224:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528480.031245:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a3bb4113/0x892c60dda91c8a06 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c002d expref: 13 pid: 8421 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.031270:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a3bb4113/0x892c60dda91c8a06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c002d expref: 13 pid: 8421 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.031294:0:10330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528480.031298:0:10330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528480.031306:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e371e986/0x892c60dda91c8a0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0034 expref: 13 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.031315:0:10330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e371e986/0x892c60dda91c8a0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0034 expref: 13 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.031373:0:10330:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e371e986/0x892c60dda91c8a0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0034 expref: 13 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528480.031388:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10330:1875407735507584:192.168.203.38@tcp:105: 00000100:00100000:3.0:1788528480.031468:0:10330:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c82e20c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788528480.033313:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3bb4113/0x892c60dda91c8a06 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c002d expref: 13 pid: 8421 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528480.033336:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8423:1875407735507456:192.168.203.38@tcp:104: 00010000:00010000:1.0:1788528480.033364:0:8423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e371e986/0x892c60dda91c8a0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0034 expref: 12 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.033377:0:8423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c1550a00, rc 0) 00000100:00100000:1.0:1788528480.033457:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4471f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+12:12467:x1875407719732864:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 14214us (14946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528480.033466:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 72 00000100:00100000:2.0:1788528480.035891:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10330:1875407735507584:192.168.203.38@tcp:105: 00010000:00010000:2.0:1788528480.035917:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528480.035973:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4472a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+11:2403:x1875407719732992:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 4764us (5307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528480.035992:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 104 00000100:00100000:3.0:1788528480.055773:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528480.056384:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719733120 00000100:00100000:0.0:1788528480.056395:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719733120 00002000:00100000:0.0:1788528480.056452:0:8426:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8a8fc44c4a80 x1875407719733120/t0(0) o4->80304108-f3b9-46ea-888c-b2a7ec20e3e2@192.168.203.38@tcp:686/0 lens 504/0 e 0 to 0 dl 1788528491 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788528480.056464:0:8426:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a8fc44c4a80 with x1875407719733120 ext(0->12) 00002000:00010000:0.0:1788528480.056471:0:8426:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a8fc44c4a80 00000100:00100000:0.0:1788528480.056521:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:0.0:1788528480.056531:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+11:2404:x1875407719733120:12345-192.168.203.38@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788528480.061190:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528480.061529:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719733248 00000100:00100000:2.0:1788528480.061540:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719733248 00000100:00100000:2.0:1788528480.061633:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 244 00000100:00100000:2.0:1788528480.061645:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+73:12467:x1875407719733248:12345-192.168.203.38@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788528480.062215:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+13:2404:x1875407719733120:12345-192.168.203.38@tcp:4:lhsmtool_posix.0 Request processed in 1728us (2494us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788528480.062227:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6 00002000:00100000:0.0:1788528480.062240:0:8426:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8a8fc44c4a80 x1875407719733120/t4294967321(0) o4->80304108-f3b9-46ea-888c-b2a7ec20e3e2@192.168.203.38@tcp:686/0 lens 504/448 e 0 to 0 dl 1788528491 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788528480.062252:0:8426:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a8fc44c4a80 with x1875407719733120 ext(0->12) 00002000:00010000:0.0:1788528480.062323:0:8426:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a8fc44c4a80 00000001:00080000:3.0:1788528480.067655:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:3.0:1788528480.067678:0:6487:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00010000:00010000:0.0:1788528480.067690:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c8712 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.067705:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c8712 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.067713:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c8712 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528480.067894:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735507840:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1788528480.067923:0:6487:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788528480.067943:0:6487:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a90f6ef89c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788528480.067947:0:6487:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a90f6f0c800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a90f6ef8900 00000020:00080000:3.0:1788528480.067951:0:6487:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a90f6f0c400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a8fc3040c00 00000100:00100000:1.0:1788528480.067960:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788528480.067990:0:6487:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000100:00100000:1.0:1788528480.068019:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000020:00080000:3.0:1788528480.068024:0:6487:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a8fc3eef480 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788528480.068029:0:6487:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a91018c3300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a8fc3eef900 00000100:00100000:1.0:1788528480.068030:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735507712:0@lo:6:osp-syn-1-0.0 00000020:00080000:3.0:1788528480.068032:0:6487:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a91018c3e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a8fc341ae00 00000020:00080000:3.0:1788528480.068051:0:6487:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:1.0:1788528480.068066:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788528480.068209:0:6540:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1788528480.068280:0:6540:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788528480.068396:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+27:12467:x1875407719733248:12345-192.168.203.38@tcp:44:lhsmtool_posix.0 Request processed in 6751us (7212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528480.068406:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 244 00000100:00100000:1.0:1788528480.068527:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735507840 00000100:00100000:1.0:1788528480.068534:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735507840 00010000:00010000:0.0:1788528480.068603:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030a00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528480.068610:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c8712 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068619:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c8712 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068635:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a8fc1fa8500) 00010000:00010000:0.0:1788528480.068639:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528480.068645:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c8712 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068665:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c8712 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068695:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c87ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068702:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c87ba lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068708:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c87ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068713:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17c00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528480.068716:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c87ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068722:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c87ba lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068730:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a90c87bee00) 00010000:00010000:0.0:1788528480.068732:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528480.068736:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c87ba lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068741:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c87ba lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068756:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8838 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068762:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8838 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068774:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8838 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068779:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528480.068782:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8838 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068789:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8838 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068797:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a90c82d0700) 00010000:00010000:0.0:1788528480.068800:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528480.068803:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8838 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068809:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16600/0x892c60dda91c8838 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068821:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c885b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068827:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c885b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068832:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c885b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068838:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17a00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528480.068841:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c885b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068872:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c885b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068880:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a90c82d0700) 00010000:00010000:0.0:1788528480.068882:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528480.068884:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c885b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068889:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17a00/0x892c60dda91c885b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068906:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c892d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068912:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c892d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068917:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c892d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068922:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528480.068925:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c892d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068931:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c892d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068939:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:0.0:1788528480.068941:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528480.068943:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c892d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068959:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c892d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068972:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c89ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068978:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c89ea lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068983:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c89ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068988:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528480.068991:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c89ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.068996:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c89ea lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.069004:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a8fc2721f00) 00010000:00010000:0.0:1788528480.069006:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788528480.069009:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c89ea lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.069014:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c89ea lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528480.076898:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735507712 00000100:00100000:2.0:1788528480.076913:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735507712 00000100:00100000:2.0:1788528480.077070:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788528480.077099:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3637:x1875407735507712:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788528480.077131:0:8422:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:2.0:1788528480.077156:0:8422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd730657/0x892c60dda91c8a14 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.077177:0:8422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000003f3db7e/0x892c60dda91c87c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff8c expref: 12 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.077186:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1788528480.077190:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788528480.077194:0:8422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd730657/0x892c60dda91c8a14 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.077230:0:8422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000003f3db7e/0x892c60dda91c87c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff8c expref: 12 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.077274:0:8422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000003f3db7e/0x892c60dda91c87c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff8c expref: 12 pid: 8423 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528480.077292:0:8422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8422:1875407735508096:192.168.203.38@tcp:104: 00000100:00100000:2.0:1788528480.077373:0:8422:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c96fe840 going to sleep for 11 seconds 00000100:00080000:2.0:1788528480.077390:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788528480.077405:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4473480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735507968:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788528480.077449:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528480.091768:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528480.092188:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735507968 00000100:00100000:3.0:1788528480.092197:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735507968 00000100:00100000:3.0:1788528480.092249:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788528480.092269:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3639:x1875407735507840:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788528480.092400:0:8725:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788528480.092404:0:8725:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788528480 00002000:00010000:3.0:1788528480.092417:0:8725:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788528480.092419:0:8725:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788528480 -> 1788528480 00002000:00010000:3.0:1788528480.092422:0:8725:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788528480.092480:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3639:x1875407735507840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 223us (24521us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1788528480.092487:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788528480.092503:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788528480.092509:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3640:x1875407735507968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788528480.092522:0:8725:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:3.0:1788528480.092546:0:8725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9ac75e, atime: 0x6a9ac75e, ctime: 0x6a9ac75e, blocks: 0x8 00010000:00010000:3.0:1788528480.092569:0:8725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e29adc87/0x892c60dda91c8a1b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.092586:0:8725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=349s v=(0 0) 00010000:00010000:3.0:1788528480.092591:0:8725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528480.092597:0:8725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e29adc87/0x892c60dda91c8a1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.092613:0:8725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e29adc87/0x892c60dda91c8a1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.092625:0:8725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e29adc87/0x892c60dda91c8a1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.092633:0:8725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e29adc87/0x892c60dda91c8a1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.092662:0:8725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788528480.092778:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3640:x1875407735507968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 268us (15328us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788528480.092785:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1788528480.093919:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788528480.102230:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a8fc4473480/2, rc 0, transno 4294967311 00000100:00100000:3.0:1788528480.102245:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4473480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735507968:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788528480.102706:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a8fc455f480/2, rc 0, transno 4294967322 00000100:00100000:1.0:1788528480.102714:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735507840:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788528480.102754:0:6496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528480.102762:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e29adc87/0x892c60dda91c8a1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.102774:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428c00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528480.102779:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e29adc87/0x892c60dda91c8a1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.102791:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e29adc87/0x892c60dda91c8a1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.102810:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e29adc87/0x892c60dda91c8a1b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.102818:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e29adc87/0x892c60dda91c8a1b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.102866:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528480.102869:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528480.102870:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528480.110816:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719733376 00000100:00100000:3.0:1788528480.110831:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719733376 00000100:00100000:3.0:1788528480.110898:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 76 00000100:00100000:3.0:1788528480.110910:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+13:2404:x1875407719733376:12345-192.168.203.38@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788528480.111665:0:8422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8422:1875407735508096:192.168.203.38@tcp:104: 00010000:00010000:2.0:1788528480.111703:0:8422:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bd730657/0x892c60dda91c8a14 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528480.111904:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528480.112059:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719733504 00000100:00100000:3.0:1788528480.112065:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719733504 00010000:00010000:3.0:1788528480.112094:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000003f3db7e/0x892c60dda91c87c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff8c expref: 14 pid: 8423 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528480.112121:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 105 00000100:00100000:3.0:1788528480.112128:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+14:2403:x1875407719733504:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788528480.112140:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528480.112146:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000003f3db7e/0x892c60dda91c87c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff8c expref: 14 pid: 8423 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.112158:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000003f3db7e/0x892c60dda91c87c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff8c expref: 14 pid: 8423 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.112193:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003f3db7e/0x892c60dda91c87c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff8c expref: 14 pid: 8423 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.112207:0:6494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788528480.112212:0:6494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788528480.112217:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd730657/0x892c60dda91c8a14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.112227:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd730657/0x892c60dda91c8a14 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.112269:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528480.112319:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+13:2403:x1875407719733504:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 191us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528480.112327:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 105 00010000:00010000:0.0:1788528480.112629:0:8422:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bd730657/0x892c60dda91c8a14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.112651:0:8422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd730657/0x892c60dda91c8a14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.112660:0:8422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd730657/0x892c60dda91c8a14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.112668:0:8422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd730657/0x892c60dda91c8a14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.112754:0:8422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788528480.113624:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528480.113633:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd730657/0x892c60dda91c8a14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.113643:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850600 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528480.113649:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd730657/0x892c60dda91c8a14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.113659:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd730657/0x892c60dda91c8a14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.113702:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd730657/0x892c60dda91c8a14 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.113710:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd730657/0x892c60dda91c8a14 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.113730:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528480.113732:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528480.113734:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528480.114768:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3637:x1875407735507712:12345-0@lo:6:osp-syn-1-0.0 Request processed in 37684us (46698us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788528480.114778:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:2.0:1788528480.114875:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a8fc455c700/2, rc 0, transno 4294967323 00000100:00100000:2.0:1788528480.114891:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735507712:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1788528480.116166:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:1.0:1788528480.116181:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:2.0:1788528480.128794:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2404:x1875407719733376:12345-192.168.203.38@tcp:16:lhsmtool_posix.0 Request processed in 17868us (37015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528480.128812:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 76 00000100:00100000:3.0:1788528480.133908:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528480.134040:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719733760 00000100:00100000:1.0:1788528480.134059:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719733760 00000100:00100000:1.0:1788528480.134150:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 245 00000100:00100000:1.0:1788528480.134163:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+21:12467:x1875407719733760:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788528480.134238:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528480.134271:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429000/0x892c60dda91c89ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0026 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.134295:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a8fc2721f00) 00010000:00010000:1.0:1788528480.134301:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788528480.134341:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550200/0x892c60dda91c8a22 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.134358:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550200/0x892c60dda91c8a22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.134371:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550200/0x892c60dda91c8a22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788528480.134717:0:6510:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016f0d982 reply state 00000000535afbca transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550200/0x892c60dda91c8a22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.134733:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550200/0x892c60dda91c8a22 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.134757:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a8fc2721f00) 00010000:00010000:1.0:1788528480.134760:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788528480.134763:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788528480.135237:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+22:12467:x1875407719733760:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 1072us (1336us total) trans 4294967510 rc 0/0 00000100:00100000:1.0:1788528480.135247:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 245 00000100:00100000:3.0:1788528480.144831:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528480.144910:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719733888 00000100:00100000:1.0:1788528480.144925:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719733888 00000100:00100000:1.0:1788528480.145009:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:1.0:1788528480.145021:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2403:x1875407719733888:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788528480.145211:0:8421:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788528480.145215:0:8421:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1788528480 -> 1788528479 00002000:00010000:1.0:1788528480.145218:0:8421:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788528478 00002000:00010000:1.0:1788528480.145221:0:8421:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788528480 -> 1788528479 00002000:00010000:1.0:1788528480.145223:0:8421:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788528480.145294:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:2403:x1875407719733888:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 Request processed in 274us (476us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788528480.145302:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:2.0:1788528480.152919:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528480.154828:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719734144 00000100:00100000:1.0:1788528480.154847:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719734144 00000100:00100000:2.0:1788528480.155159:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 246 00000100:00100000:2.0:1788528480.155175:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+22:12467:x1875407719734144:12345-192.168.203.38@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788528480.155268:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8a29 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.155310:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c89e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0018 expref: 22 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.155321:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8a29 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.155365:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c89e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0018 expref: 22 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.155382:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c89e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0018 expref: 22 pid: 8449 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528480.155399:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8449:1875407735508224:192.168.203.38@tcp:104: 00000100:00100000:2.0:1788528480.155533:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c96fe840 going to sleep for 11 seconds 00000100:00100000:3.0:1788528480.158819:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528480.159042:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8449:1875407735508224:192.168.203.38@tcp:104: 00010000:00010000:2.0:1788528480.159085:0:8449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8a29 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528480.159313:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719734272 00000100:00100000:0.0:1788528480.159322:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719734272 00010000:00010000:0.0:1788528480.159442:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c89e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0018 expref: 23 pid: 8449 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528480.159487:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 106 00000100:00100000:0.0:1788528480.159498:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+23:2404:x1875407719734272:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788528480.159515:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528480.159523:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c89e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0018 expref: 23 pid: 8449 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.159537:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c89e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0018 expref: 23 pid: 8449 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.159603:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850e00/0x892c60dda91c89e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0018 expref: 23 pid: 8449 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.159622:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a8fc2721f00) 00010000:00010000:0.0:1788528480.159627:0:6493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8a29 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.159640:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8a29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.159649:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8a29 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.159677:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528480.159811:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+22:2404:x1875407719734272:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 314us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528480.159820:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 106 00010000:00010000:1.0:1788528480.160592:0:8449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8a29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.160607:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8a29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.160659:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8a29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.160680:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8a29 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.160687:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8a29 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.160694:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528480.160700:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8a29 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.160709:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8a29 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.160738:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a8fc2721f00) 00010000:00010000:1.0:1788528480.160741:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788528480.160746:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8a29 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.160754:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8a29 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528480.160829:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+21:12467:x1875407719734144:12345-192.168.203.38@tcp:55:lhsmtool_posix.0 Request processed in 5657us (7925us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788528480.160838:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 246 00000100:00100000:3.0:1788528480.165445:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528480.165637:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719734400 00000100:00100000:0.0:1788528480.165651:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719734400 00000100:00100000:0.0:1788528480.165715:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 78 00000100:00100000:0.0:1788528480.165738:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:2403:x1875407719734400:12345-192.168.203.38@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788528480.165799:0:8422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000c38c4d5/0x892c60dda91c8a30 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.165820:0:8422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e371e986/0x892c60dda91c8a0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0034 expref: 8 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.165851:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788528480.165866:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788528480.165872:0:8422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c38c4d5/0x892c60dda91c8a30 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.165927:0:8422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e371e986/0x892c60dda91c8a0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0034 expref: 8 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.165944:0:8422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e371e986/0x892c60dda91c8a0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0034 expref: 8 pid: 8423 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528480.165967:0:8422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8422:1875407735508352:192.168.203.38@tcp:104: 00000100:00100000:0.0:1788528480.166335:0:8422:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ef8480 going to sleep for 11 seconds 00000100:00100000:3.0:1788528480.172300:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528480.172612:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719734528 00000100:00100000:2.0:1788528480.172626:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719734528 00010000:00010000:2.0:1788528480.172681:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e371e986/0x892c60dda91c8a0d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0034 expref: 9 pid: 8423 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528480.172728:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 107 00000100:00100000:2.0:1788528480.172741:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16fd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+9:2403:x1875407719734528:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528480.172760:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528480.172808:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e371e986/0x892c60dda91c8a0d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0034 expref: 9 pid: 8423 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.172825:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e371e986/0x892c60dda91c8a0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0034 expref: 9 pid: 8423 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.172870:0:10330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788528480.172876:0:10330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788528480.172884:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000c38c4d5/0x892c60dda91c8a30 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.172896:0:10330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c38c4d5/0x892c60dda91c8a30 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.172924:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528480.173006:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16fd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+9:2403:x1875407719734528:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 267us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528480.173014:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 107 00010000:00010000:0.0:1788528480.173702:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e371e986/0x892c60dda91c8a0d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0034 expref: 8 pid: 8423 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528480.173737:0:8422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8422:1875407735508352:192.168.203.38@tcp:104: 00010000:00010000:0.0:1788528480.173762:0:8422:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000c38c4d5/0x892c60dda91c8a30 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.173774:0:8422:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000c38c4d5/0x892c60dda91c8a30 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.173782:0:8422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c38c4d5/0x892c60dda91c8a30 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.173820:0:8422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000c38c4d5/0x892c60dda91c8a30 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.173829:0:8422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c38c4d5/0x892c60dda91c8a30 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.173838:0:8422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c38c4d5/0x892c60dda91c8a30 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.173845:0:8422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c13fce00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528480.173850:0:8422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c38c4d5/0x892c60dda91c8a30 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.173871:0:8422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c38c4d5/0x892c60dda91c8a30 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.173888:0:8422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c38c4d5/0x892c60dda91c8a30 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.173896:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c38c4d5/0x892c60dda91c8a30 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528480.173962:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2403:x1875407719734400:12345-192.168.203.38@tcp:1:lhsmtool_posix.0 Request processed in 8226us (8532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528480.173971:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 78 00000100:00100000:2.0:1788528480.180238:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528480.180361:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719734784 00000100:00100000:0.0:1788528480.180375:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719734784 00000100:00100000:0.0:1788528480.180453:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 247 00000100:00100000:0.0:1788528480.180466:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+21:12467:x1875407719734784:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788528480.180871:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fce00/0x892c60dda91c8a37 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.180896:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c8926 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffe0 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.180908:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fce00/0x892c60dda91c8a37 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.180958:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c8926 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffe0 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.180975:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c8926 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffe0 expref: 21 pid: 6509 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528480.180996:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6509:1875407735508480:192.168.203.38@tcp:104: 00000100:00100000:0.0:1788528480.181114:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ef8480 going to sleep for 11 seconds 00000100:00100000:1.0:1788528480.199062:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528480.200633:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719734912 00000100:00100000:2.0:1788528480.200654:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719734912 00010000:00010000:2.0:1788528480.200735:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c8926 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffe0 expref: 22 pid: 6509 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528480.200796:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 108 00000100:00100000:2.0:1788528480.200809:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+22:2403:x1875407719734912:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528480.200828:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528480.201168:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c8926 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffe0 expref: 22 pid: 6509 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.201185:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c8926 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffe0 expref: 22 pid: 6509 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.201216:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:2.0:1788528480.201223:0:8441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c8988 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0003 expref: 22 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.201236:0:8441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fce00/0x892c60dda91c8a37 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.201245:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fce00/0x892c60dda91c8a37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.201255:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fce00/0x892c60dda91c8a37 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.201281:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528480.201377:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+22:2403:x1875407719734912:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 570us (2329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528480.201387:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 108 00010000:00010000:0.0:1788528480.201632:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c8926 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bffe0 expref: 21 pid: 6509 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528480.201653:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6509:1875407735508480:192.168.203.38@tcp:104: 00010000:00010000:0.0:1788528480.201678:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fce00/0x892c60dda91c8a37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.201702:0:6509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fce00/0x892c60dda91c8a37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.201709:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fce00/0x892c60dda91c8a37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.201948:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fda00/0x892c60dda91c8a3e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.201963:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c89f1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c001f expref: 21 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.201972:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fda00/0x892c60dda91c8a3e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.202676:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c89f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c001f expref: 21 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.202697:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c89f1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c001f expref: 21 pid: 13480 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528480.202746:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6509:1875407735508608:192.168.203.38@tcp:104: 00000100:00100000:0.0:1788528480.202871:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3922300 going to sleep for 11 seconds 00000100:00100000:3.0:1788528480.205597:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528480.205788:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6509:1875407735508608:192.168.203.38@tcp:104: 00010000:00010000:0.0:1788528480.205827:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fda00/0x892c60dda91c8a3e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528480.205961:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719735040 00000100:00100000:2.0:1788528480.205970:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719735040 00010000:00010000:2.0:1788528480.206033:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c89f1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c001f expref: 22 pid: 13480 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528480.206078:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 109 00000100:00100000:2.0:1788528480.206089:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+22:2404:x1875407719735040:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528480.206124:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528480.206134:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c89f1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c001f expref: 22 pid: 13480 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.206147:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c89f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c001f expref: 22 pid: 13480 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.206173:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c89f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c001f expref: 22 pid: 13480 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.206190:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a8fc2721f00) 00010000:00010000:2.0:1788528480.206195:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fda00/0x892c60dda91c8a3e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.206205:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fda00/0x892c60dda91c8a3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.206213:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fda00/0x892c60dda91c8a3e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.206423:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528480.206494:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+21:2404:x1875407719735040:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 405us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528480.206503:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 109 00010000:00010000:0.0:1788528480.208876:0:6509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fda00/0x892c60dda91c8a3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528480.208919:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fda00/0x892c60dda91c8a3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788528480.209176:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1788528480.209324:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:2.0:1788528480.209362:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1788528480.209476:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6509:1875407735508736:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788528480.209605:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528480.209724:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c96fe240 going to sleep for 11 seconds 00000100:00100000:3.0:1788528480.209812:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735508736 00000100:00100000:3.0:1788528480.209822:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735508736 00000100:00100000:3.0:1788528480.209948:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788528480.209959:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6509:x1875407735508736:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788528480.210069:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6509:x1875407735508736:12345-0@lo:1000:mdt00_001.0 Request processed in 112us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528480.210078:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788528480.210150:0:6509:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1788528480.210157:0:6509:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:2.0:1788528480.210195:0:6509:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a8fc455f480, transno 4294967322 00000100:00100000:2.0:1788528480.210222:0:6509:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8a8fc455c700 x1875407735507712/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788528496 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528480.210236:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6509:1875407735508736:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788528480.210378:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:2.0:1788528480.210434:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6509:1875407735508864:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788528480.210464:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528480.210770:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c96feb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788528480.210834:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735508864 00000100:00100000:1.0:1788528480.210841:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735508864 00000100:00100000:1.0:1788528480.210890:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788528480.210897:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6509:x1875407735508864:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788528480.211071:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6509:x1875407735508864:12345-0@lo:1000:mdt00_001.0 Request processed in 173us (604us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788528480.211079:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788528480.211211:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6509:1875407735508864:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788528480.211259:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fda00/0x892c60dda91c8a3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.211271:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fda00/0x892c60dda91c8a3e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.211280:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fda00/0x892c60dda91c8a3e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.211287:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c13fda00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528480.211293:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fda00/0x892c60dda91c8a3e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.211302:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fda00/0x892c60dda91c8a3e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.211322:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a8fc2721f00) 00010000:00010000:2.0:1788528480.211333:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788528480.211340:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fda00/0x892c60dda91c8a3e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.211348:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fda00/0x892c60dda91c8a3e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.211380:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8981 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.211387:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8981 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.211393:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8981 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.211398:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031e00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528480.211401:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8981 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.211407:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8981 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.211416:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:2.0:1788528480.211418:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788528480.211428:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c8988 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0003 expref: 24 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.211440:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c8988 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0003 expref: 24 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.211450:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c8988 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0003 expref: 24 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.211489:0:6509:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c8988 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0003 expref: 24 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528480.211502:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6509:1875407735508992:192.168.203.38@tcp:105: 00000100:00100000:2.0:1788528480.211749:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c96feb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788528480.214383:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528480.214471:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6509:1875407735508992:192.168.203.38@tcp:105: 00010000:00010000:2.0:1788528480.214509:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8981 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.214522:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031e00/0x892c60dda91c8981 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.214610:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c8a45 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.214628:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c8a45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.214642:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c8a45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.214654:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c8a45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.214660:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c8a45 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.214668:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c8a45 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.214697:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101851400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528480.214702:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c8a45 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.214710:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c8a45 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.214723:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:2.0:1788528480.214727:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528480.214731:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c8a45 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.214737:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851400/0x892c60dda91c8a45 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.214748:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fce00/0x892c60dda91c8a37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.214754:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fce00/0x892c60dda91c8a37 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.214761:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fce00/0x892c60dda91c8a37 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.214771:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c13fce00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528480.214773:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fce00/0x892c60dda91c8a37 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.214779:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fce00/0x892c60dda91c8a37 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.214799:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:2.0:1788528480.214802:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788528480.214805:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fce00/0x892c60dda91c8a37 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528480.214810:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c13fce00/0x892c60dda91c8a37 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528480.215038:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+24:12467:x1875407719734784:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 34571us (34813us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788528480.215049:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 247 00000020:00080000:2.0:1788528480.215057:0:6509:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788528480.215368:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719735168 00000100:00100000:0.0:1788528480.215378:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719735168 00000100:00100000:0.0:1788528480.215438:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 61 00000100:00100000:0.0:1788528480.215450:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+24:12466:x1875407719735168:12345-192.168.203.38@tcp:49:lfs.0 00000100:00100000:0.0:1788528480.215609:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+24:12466:x1875407719735168:12345-192.168.203.38@tcp:49:lfs.0 Request processed in 162us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528480.215617:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 61 00000040:00080000:3.0:1788528480.216234:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788528480.216241:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788528480.216776:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788528480.216803:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788528480.220124:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528480.220187:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528480.220311:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719735424 00000100:00100000:3.0:1788528480.220324:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719735424 00000100:00100000:3.0:1788528480.220403:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 62 00000100:00100000:3.0:1788528480.220415:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8dee050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+24:12467:x1875407719735424:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788528480.220803:0:14211:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788528480.220847:0:14211:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:3.0:1788528480.220903:0:14211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8a4c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.220925:0:14211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8a4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.220940:0:14211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8a4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.220950:0:14211:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8a4c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.220957:0:14211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8a4c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.220964:0:14211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8a4c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.220985:0:14211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788528480.221098:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8dee050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+26:12467:x1875407719735424:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 683us (983us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788528480.221108:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 62 00000020:00080000:3.0:1788528480.221114:0:14211:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788528480.221176:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528480.221201:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8a4c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.221208:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428e00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528480.221214:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8a4c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.221223:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8a4c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.221238:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a8fc2721f00) 00010000:00010000:3.0:1788528480.221240:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788528480.221246:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8a4c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.221253:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8a4c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.221268:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528480.221270:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528480.221271:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528480.221703:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719735680 00000100:00100000:0.0:1788528480.221712:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719735680 00000100:00100000:0.0:1788528480.221773:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 248 00000100:00100000:0.0:1788528480.221782:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+26:12466:x1875407719735680:12345-192.168.203.38@tcp:58:lfs.0 00000040:00080000:0.0:1788528480.221945:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788528480.222012:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+26:12466:x1875407719735680:12345-192.168.203.38@tcp:58:lfs.0 Request processed in 231us (1823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528480.222020:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 248 00000100:00100000:0.0:1788528480.260333:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528480.260577:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719735808 00000100:00100000:1.0:1788528480.260592:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719735808 00000100:00100000:1.0:1788528480.260676:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 249 00000100:00100000:1.0:1788528480.260689:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+26:12469:x1875407719735808:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1788528480.260847:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528480.260887:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551800/0x892c60dda91c8a53 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c003b expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.261044:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c8a5a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.261063:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c8a5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.261078:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c8a5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.261097:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551400/0x892c60dda91c8a61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.261106:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551400/0x892c60dda91c8a61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.261113:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551400/0x892c60dda91c8a61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.261208:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550a00/0x892c60dda91c8a68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.261237:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c8973 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfffc expref: 27 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.261247:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550a00/0x892c60dda91c8a68 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.261288:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c8973 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfffc expref: 27 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.261303:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c8973 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfffc expref: 27 pid: 6510 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528480.261318:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8449:1875407735509120:192.168.203.38@tcp:104: 00000100:00100000:1.0:1788528480.261803:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3ded840 going to sleep for 11 seconds 00000100:00100000:0.0:1788528480.265393:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528480.265546:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719736064 00000100:00100000:2.0:1788528480.265603:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719736064 00000100:00100000:2.0:1788528480.265680:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:2.0:1788528480.265693:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+28:6170:x1875407719736064:12345-192.168.203.38@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788528480.266226:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+29:6170:x1875407719736064:12345-192.168.203.38@tcp:35:ldlm_bl.0 Request processed in 532us (843us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788528480.266237:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:1.0:1788528480.267145:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8449:1875407735509120:192.168.203.38@tcp:104: 00010000:00010000:1.0:1788528480.267180:0:8449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550a00/0x892c60dda91c8a68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528480.269371:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528480.269463:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719736192 00000100:00100000:3.0:1788528480.269475:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719736192 00010000:00010000:3.0:1788528480.269524:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c8973 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfffc expref: 29 pid: 6510 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528480.269605:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 110 00000100:00100000:3.0:1788528480.269617:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+29:2404:x1875407719736192:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788528480.269634:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528480.269642:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c8973 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfffc expref: 29 pid: 6510 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.269678:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c8973 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfffc expref: 29 pid: 6510 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.269706:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c8973 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfffc expref: 29 pid: 6510 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.269739:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:3.0:1788528480.269745:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550a00/0x892c60dda91c8a68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.269755:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550a00/0x892c60dda91c8a68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.269763:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550a00/0x892c60dda91c8a68 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528480.269789:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528480.269870:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+28:2404:x1875407719736192:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 254us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528480.269878:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 110 00010000:00010000:1.0:1788528480.270365:0:8449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550a00/0x892c60dda91c8a68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.270375:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550a00/0x892c60dda91c8a68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528480.270443:0:8449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788528480.270449:0:8449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788528480.270472:0:8449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550a00/0x892c60dda91c8a68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.270502:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550a00/0x892c60dda91c8a68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.270514:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c8a5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.270521:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c8a5a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.270527:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c8a5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.270534:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c1550800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528480.270539:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c8a5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.270548:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c8a5a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.270591:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:1.0:1788528480.270595:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528480.270599:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c8a5a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.270608:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c8a5a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.270622:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551400/0x892c60dda91c8a61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.270628:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551400/0x892c60dda91c8a61 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.270639:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551400/0x892c60dda91c8a61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.270644:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c1551400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528480.270647:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551400/0x892c60dda91c8a61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.270653:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551400/0x892c60dda91c8a61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.270662:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a90c82d0900) 00010000:00010000:1.0:1788528480.270664:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528480.270667:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551400/0x892c60dda91c8a61 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.270673:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551400/0x892c60dda91c8a61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.270777:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551800/0x892c60dda91c8a53 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c003b expref: 28 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.270796:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550a00/0x892c60dda91c8a68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c003b expref: 27 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528480.270804:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:1.0:1788528480.270806:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788528480.270809:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c1550a00, rc 0) 00000100:00100000:1.0:1788528480.270871:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+27:12469:x1875407719735808:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 10186us (10556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528480.270889:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 249 00010000:00010000:1.0:1788528480.382840:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528480.454167:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528480.454223:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528480.454260:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528480.454286:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528480.454312:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528480.454362:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719736832 00000100:00100000:2.0:1788528480.454375:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719736832 00000100:00100000:2.0:1788528480.454447:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719736448 00000100:00100000:2.0:1788528480.454451:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719736448 00000100:00100000:2.0:1788528480.454477:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719736704 00000100:00100000:2.0:1788528480.454481:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719736704 00000100:00100000:2.0:1788528480.454503:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 317 00000100:00100000:2.0:1788528480.454515:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719736832:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528480.454637:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719736832:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 122us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528480.454646:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 317 00000100:00100000:2.0:1788528480.454666:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 318 00000100:00100000:2.0:1788528480.454673:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719736448:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528480.454701:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719736448:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528480.454706:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 318 00000100:00100000:2.0:1788528480.454718:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 319 00000100:00100000:2.0:1788528480.454724:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719736704:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528480.454748:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719736704:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 24us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528480.454754:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 319 00000100:00080000:2.0:1788528480.454775:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788528480.454780:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788528480.456144:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719736576 00000100:00100000:1.0:1788528480.456160:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719736576 00000100:00100000:1.0:1788528480.456226:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 124 00000100:00100000:1.0:1788528480.456236:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719736576:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528480.456322:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719736576:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 87us (2097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528480.456330:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 124 00000100:00100000:0.0:1788528480.456747:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719736320 00000100:00100000:0.0:1788528480.456754:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719736320 00000100:00100000:0.0:1788528480.456803:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 415 00000100:00100000:0.0:1788528480.456811:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2403:x1875407719736320:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528480.456869:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2403:x1875407719736320:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 58us (2718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528480.456889:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 415 00000100:00080000:2.0:1788528480.457081:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788528481.293908:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788528481.293923:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788528481.293955:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788528481.293973:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788528481.294156:0:13786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1875407735509248:192.168.203.38@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788528481.295545:0:13786:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c96feb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788528481.307604:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528481.307646:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719736960 00000100:00100000:1.0:1788528481.307658:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719736960 00000100:00100000:1.0:1788528481.307740:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 250 00000100:00100000:1.0:1788528481.307751:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+28:12480:x1875407719736960:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788528481.307799:0:6509:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788528481.307962:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+28:12480:x1875407719736960:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 Request processed in 213us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528481.307971:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 250 00000100:00080000:1.0:1788528481.308008:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788528481.308239:0:13786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1875407735509248:192.168.203.38@tcp:107:hsm_cdtr.0 00000040:00080000:0.0:1788528481.309263:0:14698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788528481.309272:0:14698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788528481.309311:0:14698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788528481.309319:0:14698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788528481.316372:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528481.316533:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719737216 00000100:00100000:3.0:1788528481.316546:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719737216 00000100:00100000:3.0:1788528481.316687:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 251 00000100:00100000:3.0:1788528481.316700:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+27:12480:x1875407719737216:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788528481.316729:0:13480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528481.316768:0:13480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c8a6f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0042 expref: -99 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528481.316924:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8a76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528481.316943:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8a76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528481.316960:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8a76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528481.316972:0:13480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788528481.317488:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429e00/0x892c60dda91c8a6f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0042 expref: 30 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528481.317511:0:13480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8a76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0042 expref: 29 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528481.317521:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:3.0:1788528481.317524:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788528481.317528:0:13480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3428e00, rc 0) 00000100:00100000:3.0:1788528481.317641:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+29:12480:x1875407719737216:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 943us (1285us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788528481.317649:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 251 00000100:00100000:3.0:1788528481.320476:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528481.320610:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719737472 00000100:00100000:2.0:1788528481.320624:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719737472 00000100:00100000:2.0:1788528481.320702:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 252 00000100:00100000:2.0:1788528481.320715:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+29:12480:x1875407719737472:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788528481.320817:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8a84 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528481.320839:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8a84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528481.320863:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8a84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528481.321089:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8a84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528481.321097:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8a84 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528481.321105:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8a84 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528481.321111:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528481.321116:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8a84 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528481.321126:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8a84 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528481.321154:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:2.0:1788528481.321157:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788528481.321164:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8a84 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528481.321171:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c8a84 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528481.321325:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+30:12480:x1875407719737472:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 611us (863us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788528481.321334:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 252 00000100:00100000:2.0:1788528481.321513:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000040:00080000:3.0:1788528481.321542:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000100:00100000:2.0:1788528481.321543:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719737600 00000040:00080000:3.0:1788528481.321550:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1788528481.321551:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719737600 00000100:00100000:2.0:1788528481.321613:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:2.0:1788528481.321621:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+30:2403:x1875407719737600:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528481.321634:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528481.321650:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428e00/0x892c60dda91c8a76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0042 expref: 30 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528481.321662:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:2.0:1788528481.321666:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528481.321697:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+29:2403:x1875407719737600:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 76us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528481.321704:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 18 00000040:00080000:3.0:1788528481.325962:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788528481.325986:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788528481.345248:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528481.345300:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719737856 00000100:00100000:2.0:1788528481.345320:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719737856 00000100:00100000:2.0:1788528481.345397:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:2.0:1788528481.345408:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+29:12480:x1875407719737856:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788528481.345718:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+30:12480:x1875407719737856:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 311us (483us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788528481.345727:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 64 00010000:00010000:2.0:1788528481.408967:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528481.470784:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735509376:0@lo:400:kworker.0 00000100:00100000:2.0:1788528481.470908:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528481.470972:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735509632:0@lo:400:kworker.0 00000100:00100000:2.0:1788528481.470987:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735509888:0@lo:400:kworker.0 00000100:00100000:3.0:1788528481.471038:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528481.471077:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735509376 00000100:00100000:3.0:1788528481.471078:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735510144:0@lo:400:kworker.0 00000100:00100000:2.0:1788528481.471088:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735509376 00000100:00100000:3.0:1788528481.471111:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528481.471134:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735510656:0@lo:400:kworker.0 00000100:00100000:2.0:1788528481.471152:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:3.0:1788528481.471159:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528481.471166:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735509376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528481.471186:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735511168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788528481.471217:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528481.471342:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735509504:0@lo:400:kworker.0 00000100:00100000:3.0:1788528481.471392:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788528481.471399:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735509760:0@lo:400:kworker.0 00000100:00100000:3.0:1788528481.471423:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528481.471443:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735510272:0@lo:400:kworker.0 00000100:00100000:3.0:1788528481.471469:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528481.471488:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735510784:0@lo:400:kworker.0 00000100:00100000:3.0:1788528481.471510:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528481.471545:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735509632 00000100:00100000:3.0:1788528481.471549:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735509632 00000100:00100000:3.0:1788528481.471612:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788528481.471619:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735509632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528481.471664:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735509632:12345-0@lo:400:kworker.0 Request processed in 45us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528481.471671:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788528481.471699:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735510144 00000100:00100000:3.0:1788528481.471702:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735510144 00000100:00100000:3.0:1788528481.471740:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735510656 00000100:00100000:3.0:1788528481.471743:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735510656 00000100:00100000:3.0:1788528481.471782:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735509760 00000100:00100000:3.0:1788528481.471785:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735509760 00000100:00100000:3.0:1788528481.471799:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788528481.471804:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735510144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528481.471836:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735510144:12345-0@lo:400:kworker.0 Request processed in 33us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528481.471855:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788528481.471870:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788528481.471875:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735510656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528481.471902:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735510656:12345-0@lo:400:kworker.0 Request processed in 27us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528481.471907:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788528481.471918:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788528481.471925:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735509760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528481.471948:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735509760:12345-0@lo:400:kworker.0 Request processed in 25us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528481.471954:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00080000:3.0:1788528481.471978:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788528481.472015:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735509760:0@lo:400:kworker.0 00000100:00100000:3.0:1788528481.475273:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735509632:0@lo:400:kworker.0 00010000:00080000:3.0:1788528481.475309:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f58c1500 x1875407735510144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528481.475322:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735510144:0@lo:400:kworker.0 00010000:00080000:3.0:1788528481.475336:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f58c1180 x1875407735510656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528481.475363:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735510656:0@lo:400:kworker.0 00000100:00100000:3.0:1788528481.475957:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735511168 00000100:00100000:3.0:1788528481.475971:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735511168 00000100:00100000:3.0:1788528481.476288:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788528481.476301:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1875407735511168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788528481.476341:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923509248 avail 3691958272 00000100:00100000:3.0:1788528481.476453:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1875407735511168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (5234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528481.476460:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788528481.476514:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528481.476599:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735510400:0@lo:400:kworker.0 00000100:00100000:3.0:1788528481.476645:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528481.476669:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735510912:0@lo:400:kworker.0 00000100:00100000:3.0:1788528481.476692:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528481.476732:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735510272 00000100:00100000:3.0:1788528481.476737:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735510272 00000100:00100000:3.0:1788528481.476774:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735510784 00000100:00100000:3.0:1788528481.476778:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735510784 00000100:00100000:3.0:1788528481.476794:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735510400 00000100:00100000:3.0:1788528481.476797:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735510400 00000100:00100000:3.0:1788528481.476808:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735510912 00000100:00100000:3.0:1788528481.476811:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735510912 00000100:00100000:3.0:1788528481.476824:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788528481.476831:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735510272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528481.476880:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735510272:12345-0@lo:400:kworker.0 Request processed in 50us (5410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528481.476904:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788528481.476918:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788528481.476924:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735510784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528481.476955:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735510784:12345-0@lo:400:kworker.0 Request processed in 31us (5444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528481.476960:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788528481.476971:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788528481.477585:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3637:x1875407735510400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528481.477638:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3637:x1875407735510400:12345-0@lo:400:kworker.0 Request processed in 86us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528481.477645:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788528481.477661:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788528481.477668:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3637:x1875407735510912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528481.477696:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3637:x1875407735510912:12345-0@lo:400:kworker.0 Request processed in 29us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528481.477702:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:3.0:1788528481.477723:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788528481.477728:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788528481.477766:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735510400:0@lo:400:kworker.0 00000100:00100000:3.0:1788528481.477780:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735510912:0@lo:400:kworker.0 00000100:00100000:3.0:1788528481.477824:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735510272:0@lo:400:kworker.0 00000100:00100000:3.0:1788528481.477837:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735510784:0@lo:400:kworker.0 00000100:00100000:3.0:1788528481.477869:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735511168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788528481.478123:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:3637:x1875407735509376:12345-0@lo:400:kworker.0 Request processed in 6958us (7213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528481.478134:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:2.0:1788528481.478362:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735511296:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788528481.478480:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528481.478528:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735511296 00000100:00100000:2.0:1788528481.478535:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735511296 00000100:00100000:2.0:1788528481.478589:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788528481.478597:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f70bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735511296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788528481.478622:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923509248 avail 3691958272 00000100:00100000:2.0:1788528481.478663:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f70bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735511296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528481.478680:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788528481.478946:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735511296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788528481.482002:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735509376:0@lo:400:kworker.0 00000100:00100000:2.0:1788528481.482651:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735509888 00000100:00100000:2.0:1788528481.482663:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735509888 00000100:00100000:2.0:1788528481.482731:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788528481.482742:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735509888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528481.487689:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735509888:0@lo:400:kworker.0 00000100:00100000:2.0:1788528481.487991:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735509888:12345-0@lo:400:kworker.0 Request processed in 5246us (11473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528481.488005:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788528481.489361:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528481.489478:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735510016:0@lo:400:kworker.0 00000100:00100000:0.0:1788528481.489526:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528481.499647:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735510528:0@lo:400:kworker.0 00000100:00100000:0.0:1788528481.499739:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528481.501588:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735509504 00000100:00100000:3.0:1788528481.501603:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735509504 00000100:00100000:3.0:1788528481.501685:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735510016 00000100:00100000:3.0:1788528481.501688:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735510016 00000100:00100000:3.0:1788528481.501719:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788528481.501729:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735509504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528481.501906:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735509504:12345-0@lo:400:kworker.0 Request processed in 177us (12552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528481.501914:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788528481.501936:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1788528481.501943:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735510016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528481.501974:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735510016:12345-0@lo:400:kworker.0 Request processed in 32us (12447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528481.501980:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00080000:3.0:1788528481.502008:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788528481.507197:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735510528 00000100:00100000:3.0:1788528481.507216:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735510528 00000100:00100000:0.0:1788528481.507220:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735511040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788528481.507307:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528481.507340:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788528481.507346:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735511040 00000100:00100000:0.0:1788528481.507351:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735511040 00000100:00100000:3.0:1788528481.507356:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735510528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528481.507389:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788528481.507397:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735511040:12345-0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788528481.507426:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1788528481.507440:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788528481.507488:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735511040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528481.507496:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788528481.507585:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735511040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788528481.507590:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735510528:12345-0@lo:400:kworker.0 Request processed in 236us (7848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528481.507600:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788528481.507632:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735509504:0@lo:400:kworker.0 00000100:00100000:0.0:1788528481.507647:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735510016:0@lo:400:kworker.0 00000100:00100000:0.0:1788528481.507669:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735510528:0@lo:400:kworker.0 00010000:00010000:1.0:1788528482.431806:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528482.495972:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788528482.496014:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735511424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788528482.496109:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528482.496206:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735511424 00000100:00100000:2.0:1788528482.496217:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735511424 00000100:00100000:2.0:1788528482.496994:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788528482.497008:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735511424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788528482.497047:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528482.497110:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735511424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528482.497116:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788528482.497147:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735511552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788528482.497184:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528482.497246:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735511424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788528482.497279:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735511552 00000100:00100000:2.0:1788528482.497283:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735511552 00000100:00100000:2.0:1788528482.497329:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788528482.497335:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1875407735511552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788528482.497345:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528482.497373:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1875407735511552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528482.497379:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:2.0:1788528482.497397:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788528482.497418:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735511552:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788528483.272660:0:14749:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788528483.272671:0:14749:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788528483.272720:0:14749:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788528483.272729:0:14749:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788528483.390900:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788528483.390911:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788528483.390943:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788528483.390951:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788528483.431188:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528483.431308:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719738112 00000100:00100000:2.0:1788528483.431321:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719738112 00000100:00080000:3.0:1788528483.431425:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788528483.432020:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 253 00000100:00100000:2.0:1788528483.432034:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+30:12502:x1875407719738112:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1788528483.432199:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528483.432294:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c8a8b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0049 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528483.432634:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851800/0x892c60dda91c8a92 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528483.432653:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851800/0x892c60dda91c8a92 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528483.432675:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851800/0x892c60dda91c8a92 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528483.432690:0:8449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788528483.432854:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c8a8b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0049 expref: 33 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528483.432889:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851800/0x892c60dda91c8a92 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0049 expref: 32 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528483.432899:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:2.0:1788528483.432903:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788528483.432908:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101851800, rc 0) 00000100:00100000:2.0:1788528483.432997:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+32:12502:x1875407719738112:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 966us (1825us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788528483.433006:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 253 00000100:00100000:3.0:1788528483.439905:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528483.439997:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719738240 00000100:00100000:2.0:1788528483.440017:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719738240 00000100:00100000:2.0:1788528483.440089:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 254 00000100:00100000:2.0:1788528483.440103:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+32:12502:x1875407719738240:12345-192.168.203.38@tcp:54:lfs.0 00010000:00010000:2.0:1788528483.440310:0:13480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c8aa0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528483.440334:0:13480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c8aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528483.440348:0:13480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c8aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528483.440393:0:13480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c8aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528483.440401:0:13480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c8aa0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528483.440423:0:13480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c8aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528483.440430:0:13480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528483.440435:0:13480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c8aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528483.440444:0:13480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c8aa0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528483.440458:0:13480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:2.0:1788528483.440461:0:13480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788528483.440466:0:13480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c8aa0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528483.440473:0:13480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c8aa0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528483.440598:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:80304108-f3b9-46ea-888c-b2a7ec20e3e2+32:12502:x1875407719738240:12345-192.168.203.38@tcp:54:lfs.0 Request processed in 498us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528483.440607:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 254 00010000:00010000:3.0:1788528483.458923:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528483.521616:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788528483.521724:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735511680:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788528483.521825:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528483.521926:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735511680 00000100:00100000:3.0:1788528483.521936:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735511680 00000100:00100000:3.0:1788528483.521998:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788528483.522010:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735511680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788528483.522054:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788528483.522109:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735511680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528483.522116:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788528483.522964:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735511680:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788528483.584007:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528483.584101:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719738368 00000100:00100000:1.0:1788528483.584129:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719738368 00000100:00080000:3.0:1788528483.584239:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788528483.584287:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 79 00000100:00100000:1.0:1788528483.584300:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2404:x1875407719738368:12345-192.168.203.38@tcp:101:cat.0 00010000:00010000:1.0:1788528483.584324:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528483.584353:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c7d4e3d/0x892c60dda91c8aa7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0050 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788528483.584387:0:8421:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9ac75f, atime: 0x6a9ac75e, ctime: 0x6a9ac75f, blocks: 0x8 00010000:00010000:1.0:1788528483.585600:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=352s v=(0 0) 00010000:00010000:1.0:1788528483.585615:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788528483.585632:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c7d4e3d/0x892c60dda91c8aa7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0050 expref: 8 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528483.588294:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006c7d4e3d/0x892c60dda91c8aa7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0050 expref: 8 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528483.588320:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c1551400, rc 0) 00000100:00100000:1.0:1788528483.588427:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:2404:x1875407719738368:12345-192.168.203.38@tcp:101:cat.0 Request processed in 4127us (4432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528483.588438:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 79 00000100:00100000:3.0:1788528483.604143:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528483.604208:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719738496 00000100:00100000:2.0:1788528483.604221:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719738496 00002000:00100000:2.0:1788528483.604289:0:8427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8a8fc3c7c380 x1875407719738496/t0(0) o3->80304108-f3b9-46ea-888c-b2a7ec20e3e2@192.168.203.38@tcp:689/0 lens 488/0 e 0 to 0 dl 1788528494 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788528483.604303:0:8427:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a8fc3c7c380 with x1875407719738496 ext(0->4095) 00002000:00010000:2.0:1788528483.604310:0:8427:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a8fc3c7c380 00000100:00100000:2.0:1788528483.604349:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:2.0:1788528483.604361:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:2406:x1875407719738496:12345-192.168.203.38@tcp:3:cat.0 00000100:00100000:2.0:1788528483.604590:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+8:2406:x1875407719738496:12345-192.168.203.38@tcp:3:cat.0 Request processed in 230us (461us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788528483.604599:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7 00002000:00100000:2.0:1788528483.604606:0:8427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8a8fc3c7c380 x1875407719738496/t0(0) o3->80304108-f3b9-46ea-888c-b2a7ec20e3e2@192.168.203.38@tcp:689/0 lens 488/4536 e 0 to 0 dl 1788528494 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788528483.604613:0:8427:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a8fc3c7c380 with x1875407719738496 ext(0->4095) 00002000:00010000:2.0:1788528483.604617:0:8427:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a8fc3c7c380 00000040:00080000:0.0:1788528483.968330:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788528484.482705:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788528484.545395:0:8416:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:1.0:1788528485.502929:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788528485.569597:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1788528485.569637:0:6487:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a90c96fe240 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1788528485.569643:0:6487:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a90ce83f500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a90c96fee40 00000020:00080000:2.0:1788528485.569647:0:6487:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a90ce83f700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a90f6f0f400 00000020:00080000:2.0:1788528485.569673:0:6487:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1788528485.569774:0:6540:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1788528485.569873:0:6540:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1788528485.570236:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550200/0x892c60dda91c8a22 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528485.570251:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550200/0x892c60dda91c8a22 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528485.570260:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550200/0x892c60dda91c8a22 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528485.570278:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c1550200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528485.570284:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550200/0x892c60dda91c8a22 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528485.570293:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550200/0x892c60dda91c8a22 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528485.570314:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a8fc2721f00) 00010000:00010000:3.0:1788528485.570317:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528485.570323:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550200/0x892c60dda91c8a22 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528485.570330:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550200/0x892c60dda91c8a22 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788528485.571065:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:1.0:1788528485.571076:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000100:00100000:3.0:1788528485.585239:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528485.585294:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528485.585339:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528485.585378:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528485.585404:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528485.585430:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528485.585471:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528485.585509:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719738880 00000100:00100000:3.0:1788528485.585521:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719738880 00000100:00100000:3.0:1788528485.585638:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719739392 00000100:00100000:3.0:1788528485.585641:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719739392 00000100:00100000:3.0:1788528485.585657:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719738752 00000100:00100000:3.0:1788528485.585660:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719738752 00000100:00100000:3.0:1788528485.585674:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719739264 00000100:00100000:3.0:1788528485.585677:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719739264 00000100:00100000:3.0:1788528485.585728:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 326 00000100:00100000:3.0:1788528485.585738:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2404:x1875407719738880:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528485.585846:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2404:x1875407719738880:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 109us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528485.585855:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 326 00000100:00100000:3.0:1788528485.585879:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 327 00000100:00100000:3.0:1788528485.585885:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2404:x1875407719739392:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528485.585911:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2404:x1875407719739392:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 26us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528485.585918:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 327 00000100:00100000:3.0:1788528485.585929:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 328 00000100:00100000:3.0:1788528485.585935:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+18:2404:x1875407719738752:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528485.585959:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+18:2404:x1875407719738752:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 24us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528485.585965:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 328 00000100:00100000:3.0:1788528485.585975:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 329 00000100:00100000:3.0:1788528485.585981:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2404:x1875407719739264:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528485.586000:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2404:x1875407719739264:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 20us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528485.586007:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 329 00000100:00080000:3.0:1788528485.586032:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788528485.586048:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788528485.586684:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719738624 00000100:00100000:1.0:1788528485.586695:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719738624 00000100:00100000:1.0:1788528485.586749:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 417 00000100:00100000:1.0:1788528485.586770:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2404:x1875407719738624:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528485.586844:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2404:x1875407719738624:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 75us (1618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528485.586852:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 417 00000100:00100000:2.0:1788528485.587254:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719739136 00000100:00100000:2.0:1788528485.587261:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719739136 00000100:00080000:1.0:1788528485.588686:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788528485.589075:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 129 00000100:00100000:2.0:1788528485.589102:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2404:x1875407719739136:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528485.589265:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719739008 00000100:00100000:0.0:1788528485.589277:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719739008 00000100:00080000:1.0:1788528485.589339:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788528485.589348:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 130 00000100:00100000:0.0:1788528485.589356:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fabb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2404:x1875407719739008:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528485.589519:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2404:x1875407719739136:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 430us (4177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528485.589535:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 129 00000100:00100000:0.0:1788528485.589655:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fabb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2404:x1875407719739008:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 300us (4223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528485.589662:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 130 00010000:00010000:2.0:1788528486.528849:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528486.591067:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788528486.591098:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735511808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788528486.591206:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528486.591290:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735511808 00000100:00100000:2.0:1788528486.591320:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735511808 00000100:00100000:2.0:1788528486.591396:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788528486.591406:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735511808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788528486.591444:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788528486.591498:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735511808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528486.591506:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:2.0:1788528486.591533:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788528486.591614:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1788528486.591621:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a8fc455c700, transno 4294967323 00000004:00080000:2.0:1788528486.591635:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:2.0:1788528486.595219:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735511808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788528486.595522:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735511936:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788528486.595631:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528486.596061:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735511936 00000100:00100000:2.0:1788528486.596073:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735511936 00000100:00100000:2.0:1788528486.596205:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788528486.596215:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735511936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788528486.596243:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788528486.596302:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735511936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528486.596310:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788528486.596366:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735511936:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788528486.600487:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735512320:0@lo:400:kworker.0 00000100:00100000:0.0:1788528486.600637:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528486.600691:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1875407735512832:0@lo:400:kworker.0 00000100:00100000:0.0:1788528486.600721:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528486.600742:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735513344:0@lo:400:kworker.0 00000100:00100000:0.0:1788528486.600767:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528486.600798:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788528486.600806:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735512192:0@lo:400:kworker.0 00000100:00100000:0.0:1788528486.600843:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528486.600862:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1875407735512704:0@lo:400:kworker.0 00000100:00100000:0.0:1788528486.600884:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528486.600908:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1875407735513216:0@lo:400:kworker.0 00000100:00100000:0.0:1788528486.600930:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528486.600981:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735512320 00000100:00100000:0.0:1788528486.600991:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735512320 00000100:00100000:0.0:1788528486.601046:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788528486.601055:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735512320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528486.601120:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735512320:12345-0@lo:400:kworker.0 Request processed in 65us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528486.601127:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788528486.601152:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735512832 00000100:00100000:0.0:1788528486.601155:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735512832 00000100:00100000:2.0:1788528486.602851:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735512064:0@lo:400:kworker.0 00000100:00100000:2.0:1788528486.602957:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528486.603041:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735512576:0@lo:400:kworker.0 00000100:00100000:2.0:1788528486.603074:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528486.603102:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735513088:0@lo:400:kworker.0 00000100:00100000:2.0:1788528486.603131:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528486.603354:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788528486.603362:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875407735512448:0@lo:400:kworker.0 00000100:00100000:2.0:1788528486.603395:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528486.603409:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735512960:0@lo:400:kworker.0 00000100:00100000:2.0:1788528486.603430:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528486.603451:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735513472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528486.603474:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528486.603512:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735512576 00000100:00100000:2.0:1788528486.603522:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735512576 00000100:00100000:2.0:1788528486.603593:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735513472 00000100:00100000:2.0:1788528486.603596:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735513472 00000100:00100000:2.0:1788528486.603614:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788528486.603622:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735512576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528486.603701:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735512576:12345-0@lo:400:kworker.0 Request processed in 79us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528486.603710:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788528486.603729:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788528486.603736:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735513472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788528486.603768:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788528486.603801:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735513472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528486.603817:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788528486.603849:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735513088 00000100:00100000:2.0:1788528486.603853:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735513088 00000100:00100000:1.0:1788528486.604067:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735512064 00000100:00100000:1.0:1788528486.604072:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735512064 00000100:00100000:1.0:1788528486.604109:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:1.0:1788528486.604117:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:3638:x1875407735512064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528486.604169:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+27:3638:x1875407735512064:12345-0@lo:400:kworker.0 Request processed in 52us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528486.604176:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:1.0:1788528486.604941:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735512320:0@lo:400:kworker.0 00000100:00100000:1.0:1788528486.606689:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735513344 00000100:00100000:1.0:1788528486.606712:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735513344 00000100:00080000:3.0:1788528486.607913:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788528486.607955:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788528486.607982:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788528486.612122:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735512192 00000100:00100000:0.0:1788528486.612154:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735512192 00000100:00100000:0.0:1788528486.612180:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735512704 00000100:00100000:0.0:1788528486.612184:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735512704 00000100:00100000:0.0:1788528486.612205:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735513216 00000100:00100000:0.0:1788528486.612208:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735513216 00000100:00080000:3.0:1788528486.612219:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788528486.612223:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735512448 00000100:00100000:0.0:1788528486.612226:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735512448 00000100:00100000:0.0:1788528486.612247:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788528486.612258:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875407735512832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528486.612293:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735512960 00000100:00100000:2.0:1788528486.612297:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735512960 00000100:00100000:2.0:1788528486.612327:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788528486.612334:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735513088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528486.612386:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735513088:12345-0@lo:400:kworker.0 Request processed in 52us (9253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528486.612386:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875407735512832:12345-0@lo:400:kworker.0 Request processed in 130us (11663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528486.612395:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788528486.612395:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788528486.612412:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788528486.612419:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735512960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528486.612445:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735512960:12345-0@lo:400:kworker.0 Request processed in 27us (9014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528486.612451:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00010000:00080000:0.0:1788528486.612461:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc455f480 x1875407735512832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528486.612478:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1875407735512832:0@lo:400:kworker.0 00000100:00100000:2.0:1788528486.612507:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735512960:0@lo:400:kworker.0 00000100:00100000:0.0:1788528486.612509:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788528486.612515:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735512192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528486.612530:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735513472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528486.612543:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735512064:0@lo:400:kworker.0 00000100:00100000:0.0:1788528486.612548:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735512192:12345-0@lo:400:kworker.0 Request processed in 35us (11706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528486.612573:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735512576:0@lo:400:kworker.0 00000100:00100000:2.0:1788528486.612583:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1788528486.612590:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000100:00100000:0.0:1788528486.612590:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000004:00080000:2.0:1788528486.612610:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a8fc4473480, transno 4294967311 00000100:00100000:0.0:1788528486.612613:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735512192:0@lo:400:kworker.0 00000100:00100000:2.0:1788528486.612623:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735513088:0@lo:400:kworker.0 00000100:00100000:0.0:1788528486.612630:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788528486.612635:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875407735512704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528486.612668:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875407735512704:12345-0@lo:400:kworker.0 Request processed in 33us (11783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528486.612673:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788528486.612707:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1875407735512704:0@lo:400:kworker.0 00000100:00100000:0.0:1788528486.612724:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1788528486.612731:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875407735513216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528486.612774:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875407735513216:12345-0@lo:400:kworker.0 Request processed in 44us (11843us total) trans 0 rc 0/0 00000100:00080000:3.0:1788528486.612775:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788528486.612780:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1788528486.612804:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1875407735513216:0@lo:400:kworker.0 00000100:00100000:0.0:1788528486.612831:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788528486.612836:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875407735512448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528486.612879:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875407735512448:12345-0@lo:400:kworker.0 Request processed in 43us (9485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528486.612884:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1788528486.612961:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875407735512448:0@lo:400:kworker.0 00000100:00100000:0.0:1788528486.613895:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1788528486.613905:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735513344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528486.614107:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735513344:12345-0@lo:400:kworker.0 Request processed in 204us (13338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528486.614125:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00010000:00080000:0.0:1788528486.614166:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc455f800 x1875407735513344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528486.614180:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735513344:0@lo:400:kworker.0 00010000:00010000:1.0:1788528487.557295:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528487.616147:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788528487.616191:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735513600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788528487.616298:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528487.616413:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735513600 00000100:00100000:2.0:1788528487.616424:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735513600 00000100:00100000:2.0:1788528487.616488:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788528487.616499:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735513600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788528487.616536:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528487.616612:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735513600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528487.616619:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788528487.616673:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735513600:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788528487.617721:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788528487.618142:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735513728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788528487.618410:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528487.619747:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735513728 00000100:00100000:2.0:1788528487.619766:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735513728 00000100:00100000:2.0:1788528487.619852:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788528487.619867:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735513728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788528487.619911:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528487.620500:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735513728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 634us (2088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528487.620511:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788528487.620904:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735513728:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788528488.574712:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528488.640010:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735513856:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788528488.640114:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528488.644334:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735513856 00000100:00100000:3.0:1788528488.644355:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735513856 00000100:00100000:3.0:1788528488.644429:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788528488.644442:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735513856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788528488.644493:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788528488.644968:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735513856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 527us (4852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528488.644977:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788528488.648741:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735513856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788528488.864030:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528488.864269:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719739520 00000100:00100000:3.0:1788528488.864285:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719739520 00000100:00100000:3.0:1788528488.864402:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 255 00000100:00100000:3.0:1788528488.864415:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+18:12146:x1875407719739520:12345-192.168.203.38@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788528488.864612:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+18:12146:x1875407719739520:12345-192.168.203.38@tcp:60:lhsmtool_posix.0 Request processed in 199us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528488.864621:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 255 00000100:00080000:0.0:1788528488.865807:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788528488.880683:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528488.880990:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719739648 00000100:00100000:0.0:1788528488.881004:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719739648 00000100:00080000:3.0:1788528488.881217:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788528488.881514:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 256 00000100:00100000:0.0:1788528488.881531:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:12146:x1875407719739648:12345-192.168.203.38@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788528488.881732:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:12146:x1875407719739648:12345-192.168.203.38@tcp:60:lhsmtool_posix.0 Request processed in 206us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528488.881741:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 256 00000100:00100000:2.0:1788528488.887678:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528488.887808:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719739904 00000100:00100000:3.0:1788528488.887823:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719739904 00000100:00100000:3.0:1788528488.887899:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 65 00000100:00100000:3.0:1788528488.887912:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+18:12146:x1875407719739904:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788528488.888959:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+19:12146:x1875407719739904:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 1040us (1287us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1788528488.888996:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 65 00000100:00100000:3.0:1788528489.093936:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528489.094442:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719740032 00000100:00100000:0.0:1788528489.094457:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719740032 00000100:00100000:0.0:1788528489.094606:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 257 00000100:00100000:0.0:1788528489.094618:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:12959:x1875407719740032:12345-192.168.203.38@tcp:101:lsof.0 00010000:00010000:0.0:1788528489.094644:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528489.094670:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c8aae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0057 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528489.094786:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8ab5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528489.094813:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528489.094831:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788528489.094894:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788528489.094898:0:6508:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788528489.094925:0:6508:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528489.094952:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030800/0x892c60dda91c8aae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0057 expref: 7 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528489.094975:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0057 expref: 6 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528489.094985:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:0.0:1788528489.094988:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788528489.094992:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0030200, rc 0) 00000100:00100000:0.0:1788528489.095065:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:12959:x1875407719740032:12345-192.168.203.38@tcp:101:lsof.0 Request processed in 450us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528489.095072:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 257 00000100:00080000:3.0:1788528489.098370:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788528489.598800:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528490.622877:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528490.697048:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528490.697174:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528490.697223:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528490.697357:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719740416 00000100:00100000:3.0:1788528490.697366:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719740416 00000100:00100000:3.0:1788528490.697442:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 336 00000100:00100000:3.0:1788528490.697464:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719740416:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528490.697535:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719740416:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 85us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528490.697542:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 336 00000100:00080000:3.0:1788528490.697613:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788528490.697919:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528490.697947:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528490.697969:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528490.698012:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719740928 00000100:00100000:3.0:1788528490.698017:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719740928 00000100:00080000:3.0:1788528490.698033:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788528490.698056:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719740288 00000100:00100000:3.0:1788528490.698058:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719740288 00000100:00080000:3.0:1788528490.698070:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788528490.698089:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 337 00000100:00100000:3.0:1788528490.698095:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719740928:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528490.698133:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2403:x1875407719740928:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 38us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528490.698140:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 337 00000100:00100000:3.0:1788528490.698154:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 338 00000100:00100000:3.0:1788528490.698161:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+19:2403:x1875407719740288:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528490.698193:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+19:2403:x1875407719740288:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 33us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528490.698211:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 338 00000100:00100000:0.0:1788528490.703951:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719740160 00000100:00100000:0.0:1788528490.703969:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719740160 00000100:00100000:0.0:1788528490.704066:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 419 00000100:00100000:0.0:1788528490.704079:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2403:x1875407719740160:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528490.704173:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2403:x1875407719740160:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 97us (7134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528490.704181:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 419 00000100:00100000:2.0:1788528490.706692:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528490.706839:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719740800 00000100:00100000:3.0:1788528490.706850:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719740800 00000100:00100000:3.0:1788528490.706916:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 339 00000100:00100000:3.0:1788528490.706927:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:2403:x1875407719740800:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528490.706995:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:2403:x1875407719740800:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 70us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528490.707003:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 339 00000100:00100000:1.0:1788528490.714765:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719740672 00000100:00100000:1.0:1788528490.714789:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719740672 00000100:00100000:1.0:1788528490.714889:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719740544 00000100:00100000:1.0:1788528490.714894:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719740544 00000100:00100000:1.0:1788528490.714932:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 133 00000100:00100000:1.0:1788528490.714957:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4473480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2403:x1875407719740672:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528490.715040:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4473480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2403:x1875407719740672:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 86us (17815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528490.715049:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 133 00000100:00100000:1.0:1788528490.715067:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 134 00000100:00100000:1.0:1788528490.715075:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719740544:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528490.715101:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719740544:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (17131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528490.715107:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 134 00000100:00080000:3.0:1788528490.715641:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788528490.715647:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788528491.647139:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528491.710750:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788528491.710785:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735514368:0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.710826:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735513984:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788528491.710854:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528491.710870:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4470380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735514112:0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.710896:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528491.710910:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735514240:0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.710917:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735514624:0@lo:400:kworker.0 00000100:00100000:1.0:1788528491.710940:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528491.711239:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735514368 00000100:00100000:0.0:1788528491.711248:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735514368 00000100:00100000:0.0:1788528491.711297:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788528491.711305:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735514368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528491.711463:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735514240 00000100:00100000:3.0:1788528491.711467:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735514240 00000100:00100000:3.0:1788528491.711501:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788528491.711508:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735514240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.711820:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528491.711851:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735515136:0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.711883:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528491.711903:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735515648:0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.711924:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528491.712024:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1875407735514752:0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.712056:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528491.712076:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1875407735515264:0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.712095:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528491.712112:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735515776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788528491.712132:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528491.712151:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788528491.712157:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735514880:0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.712180:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528491.712195:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735515392:0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.712215:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528491.712226:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735515904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788528491.712246:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528491.712272:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735514112 00000100:00100000:2.0:1788528491.712276:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735514112 00000100:00100000:2.0:1788528491.712313:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:2.0:1788528491.712330:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:3638:x1875407735514112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.712371:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd052447-840d-4bcc-891b-140c465c7625+27:3638:x1875407735514112:12345-0@lo:400:kworker.0 Request processed in 42us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528491.712378:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:2.0:1788528491.712408:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735515136 00000100:00100000:2.0:1788528491.712412:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735515136 00000100:00100000:2.0:1788528491.712441:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735515648 00000100:00100000:2.0:1788528491.712444:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735515648 00000100:00100000:2.0:1788528491.712463:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788528491.712469:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735515136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.712498:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735515136:12345-0@lo:400:kworker.0 Request processed in 29us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528491.712504:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788528491.712517:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788528491.713130:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735515648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.713172:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735515648:12345-0@lo:400:kworker.0 Request processed in 648us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528491.713178:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788528491.713203:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735515776 00000100:00100000:2.0:1788528491.713207:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735515776 00000100:00100000:2.0:1788528491.713233:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735515904 00000100:00100000:2.0:1788528491.713235:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735515904 00000100:00100000:2.0:1788528491.713254:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788528491.713260:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735515776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788528491.713281:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788528491.713322:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735515776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528491.713341:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788528491.713354:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788528491.713360:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735515904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788528491.713371:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788528491.713397:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735515904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528491.713403:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:2.0:1788528491.713428:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788528491.713432:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788528491.713443:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528491.713467:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735514496:0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.713493:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528491.713504:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735515008:0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.713541:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528491.713576:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735515520:0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.713596:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528491.713626:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735515008 00000100:00100000:2.0:1788528491.713630:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735515008 00000100:00100000:2.0:1788528491.713656:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735515520 00000100:00100000:2.0:1788528491.713659:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735515520 00000100:00100000:2.0:1788528491.713670:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788528491.713675:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735515008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.713711:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735515008:12345-0@lo:400:kworker.0 Request processed in 35us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528491.713717:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788528491.713729:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788528491.713742:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735515520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.713784:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735515520:12345-0@lo:400:kworker.0 Request processed in 31us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528491.713791:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1788528491.713806:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788528491.713816:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735514752 00000100:00100000:2.0:1788528491.713819:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735514752 00000100:00100000:2.0:1788528491.713840:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735515264 00000100:00100000:2.0:1788528491.713843:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735515264 00000100:00100000:2.0:1788528491.713855:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735514880 00000100:00100000:2.0:1788528491.713858:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735514880 00000100:00100000:2.0:1788528491.713868:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735515392 00000100:00100000:2.0:1788528491.713870:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735515392 00000100:00100000:2.0:1788528491.713883:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735514496 00000100:00100000:2.0:1788528491.713886:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735514496 00000100:00100000:2.0:1788528491.713903:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788528491.713909:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875407735514752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.713940:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875407735514752:12345-0@lo:400:kworker.0 Request processed in 32us (1884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528491.713946:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788528491.713958:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788528491.713964:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875407735515264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.713990:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875407735515264:12345-0@lo:400:kworker.0 Request processed in 27us (1894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528491.713997:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788528491.714007:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1788528491.714013:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735514880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.714039:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735514880:12345-0@lo:400:kworker.0 Request processed in 26us (1858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528491.714052:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1788528491.714064:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1788528491.714070:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735515392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.714100:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735515392:12345-0@lo:400:kworker.0 Request processed in 31us (1885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528491.714106:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1788528491.714117:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1788528491.714123:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735514496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.714148:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735514496:12345-0@lo:400:kworker.0 Request processed in 26us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528491.714153:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00080000:2.0:1788528491.714168:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788528491.714171:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788528491.714197:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735514496:0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.714209:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735515008:0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.714218:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735515520:0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.714255:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4470380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735514112:0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.714269:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735515136:0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.714278:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735515648:0@lo:400:kworker.0 00010000:00080000:2.0:1788528491.714307:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6da0a80 x1875407735514880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528491.714317:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735514880:0@lo:400:kworker.0 00010000:00080000:2.0:1788528491.714337:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6da2d80 x1875407735515392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528491.714346:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735515392:0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.714363:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735515904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788528491.714373:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1875407735514752:0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.714383:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1875407735515264:0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.714394:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735515776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788528491.714466:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735514624 00000100:00100000:2.0:1788528491.714471:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735514624 00000100:00100000:2.0:1788528491.714490:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735513984 00000100:00100000:2.0:1788528491.714492:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735513984 00000100:00100000:2.0:1788528491.714504:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788528491.714511:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735514624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528491.714551:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735514624:12345-0@lo:400:kworker.0 Request processed in 40us (2732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528491.714580:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788528491.714593:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788528491.714599:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1875407735513984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788528491.714620:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788528491.714657:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1875407735513984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528491.714664:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788528491.714693:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735513984:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528491.714729:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735514624:0@lo:400:kworker.0 00000100:00100000:0.0:1788528491.715972:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735514368:12345-0@lo:400:kworker.0 Request processed in 4661us (5111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528491.715988:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788528491.715991:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735514368:0@lo:400:kworker.0 00000100:00100000:3.0:1788528491.716071:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735514240:12345-0@lo:400:kworker.0 Request processed in 4561us (5128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528491.716080:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1788528491.717424:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735514240:0@lo:400:kworker.0 00000001:00080000:2.0:1788528491.718846:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:2.0:1788528491.718863:0:6487:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1788528491.719047:0:6540:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1788528491.719061:0:6540:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788528492.670737:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528492.736462:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735516032:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788528492.736533:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528492.736625:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735516032 00000100:00100000:2.0:1788528492.736633:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735516032 00000100:00100000:2.0:1788528492.736679:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788528492.736689:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735516032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788528492.736719:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528492.736762:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735516032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528492.736806:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788528492.736854:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735516032:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788528492.740508:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735516160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788528492.740600:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528492.740917:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735516160 00000100:00100000:1.0:1788528492.740925:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735516160 00000100:00100000:1.0:1788528492.740976:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788528492.740985:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735516160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788528492.741007:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528492.741069:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735516160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528492.741090:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788528492.741135:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735516160:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788528492.803349:0:14947:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 09:28:11 (1788528491) 00000040:00080000:3.0:1788528493.183161:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788528493.632963:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788528493.632972:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788528493.633068:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788528493.633075:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788528493.696635:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528493.759858:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788528493.759882:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735516288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788528493.759956:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528493.760079:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735516288 00000100:00100000:3.0:1788528493.760088:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735516288 00000100:00100000:3.0:1788528493.760138:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788528493.760147:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735516288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788528493.760180:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788528493.760235:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735516288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528493.760251:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788528493.760351:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735516288:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788528494.719493:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528495.743396:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528495.817211:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528495.817332:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528495.817370:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528495.817401:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528495.817422:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528495.817441:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528495.817462:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528495.817489:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719741184 00000100:00100000:2.0:1788528495.817498:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719741184 00000100:00100000:2.0:1788528495.817574:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719741696 00000100:00100000:2.0:1788528495.817588:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719741696 00000100:00100000:2.0:1788528495.817606:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719741312 00000100:00100000:2.0:1788528495.817608:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719741312 00000100:00100000:2.0:1788528495.817621:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719741824 00000100:00100000:2.0:1788528495.817622:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719741824 00000100:00100000:2.0:1788528495.817650:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 346 00000100:00100000:2.0:1788528495.817659:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+18:2403:x1875407719741184:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528495.817724:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+18:2403:x1875407719741184:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 66us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528495.817732:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 346 00000100:00100000:2.0:1788528495.817759:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 347 00000100:00100000:2.0:1788528495.817766:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:2403:x1875407719741696:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528495.817789:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:2403:x1875407719741696:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 24us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528495.817795:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 347 00000100:00100000:2.0:1788528495.817806:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 348 00000100:00100000:2.0:1788528495.817812:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2404:x1875407719741312:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528495.817834:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2404:x1875407719741312:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 23us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528495.817841:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 348 00000100:00100000:2.0:1788528495.817853:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 349 00000100:00100000:2.0:1788528495.817859:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2404:x1875407719741824:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528495.817883:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2404:x1875407719741824:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 24us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528495.817888:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 349 00000100:00100000:2.0:1788528495.817917:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719741440 00000100:00100000:2.0:1788528495.817920:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719741440 00000100:00100000:2.0:1788528495.817944:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719741568 00000100:00100000:2.0:1788528495.817947:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719741568 00000100:00100000:2.0:1788528495.817973:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 139 00000100:00100000:2.0:1788528495.817991:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719741440:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528495.818019:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2403:x1875407719741440:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528495.818026:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 139 00000100:00100000:2.0:1788528495.818036:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 140 00000100:00100000:2.0:1788528495.818043:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2404:x1875407719741568:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528495.818065:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2404:x1875407719741568:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 23us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528495.818070:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 140 00000100:00080000:2.0:1788528495.818087:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788528495.818091:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788528495.818093:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788528495.818095:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788528495.826325:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719741056 00000100:00100000:3.0:1788528495.826338:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719741056 00000100:00100000:3.0:1788528495.826406:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 421 00000100:00100000:3.0:1788528495.826416:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2404:x1875407719741056:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528495.826501:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2404:x1875407719741056:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 85us (9300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528495.826509:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 421 00010000:00010000:2.0:1788528496.767022:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528496.833547:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735516416:0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.833691:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528496.833755:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735516928:0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.833783:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528496.833799:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735517440:0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.833820:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528496.833835:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735517952:0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.833877:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528496.833898:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788528496.833903:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4470380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735516800:0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.833922:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528496.833934:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735517312:0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.833950:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528496.833962:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735517824:0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.833976:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528496.833999:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735516544:0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.834018:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528496.834031:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735517056:0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.834046:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528496.834057:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1875407735517568:0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.834072:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528496.834085:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788528496.834090:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735516672:0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.834106:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528496.834118:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735517184:0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.834134:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528496.834147:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1875407735517696:0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.834167:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528496.834201:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735516416 00000100:00100000:2.0:1788528496.834208:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735516416 00000100:00100000:2.0:1788528496.834249:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:2.0:1788528496.834258:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+27:3640:x1875407735516416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.834315:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+27:3640:x1875407735516416:12345-0@lo:400:kworker.0 Request processed in 58us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528496.834322:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:2.0:1788528496.834354:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735517440 00000100:00100000:2.0:1788528496.834357:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735517440 00000100:00100000:2.0:1788528496.834386:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735517952 00000100:00100000:2.0:1788528496.834389:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735517952 00000100:00100000:2.0:1788528496.834403:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735517312 00000100:00100000:2.0:1788528496.834405:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735517312 00000100:00100000:2.0:1788528496.834414:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735517824 00000100:00100000:2.0:1788528496.834417:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735517824 00000100:00100000:2.0:1788528496.834427:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788528496.834433:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735517440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.834463:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735517440:12345-0@lo:400:kworker.0 Request processed in 31us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528496.834469:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788528496.834481:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788528496.834487:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735517952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.834512:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735517952:12345-0@lo:400:kworker.0 Request processed in 26us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528496.834517:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788528496.834528:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788528496.834533:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735517312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.834584:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735517312:12345-0@lo:400:kworker.0 Request processed in 51us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528496.834590:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788528496.834600:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788528496.834611:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735517824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.834636:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735517824:12345-0@lo:400:kworker.0 Request processed in 25us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528496.834641:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788528496.834661:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735516800 00000100:00100000:2.0:1788528496.834664:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735516800 00000100:00100000:2.0:1788528496.834679:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735516544 00000100:00100000:2.0:1788528496.834681:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735516544 00000100:00100000:2.0:1788528496.834689:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735517056 00000100:00100000:2.0:1788528496.834691:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735517056 00000100:00100000:2.0:1788528496.834699:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735517568 00000100:00100000:2.0:1788528496.834701:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735517568 00000100:00100000:2.0:1788528496.834709:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735517184 00000100:00100000:2.0:1788528496.834711:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735517184 00000100:00100000:2.0:1788528496.834720:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735517696 00000100:00100000:2.0:1788528496.834722:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735517696 00000100:00100000:2.0:1788528496.834733:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788528496.834749:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735516800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.834775:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735516800:12345-0@lo:400:kworker.0 Request processed in 38us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528496.834781:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788528496.834792:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788528496.834798:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735516544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.834828:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735516544:12345-0@lo:400:kworker.0 Request processed in 31us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528496.834833:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788528496.834845:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788528496.834851:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735517056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.834890:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735517056:12345-0@lo:400:kworker.0 Request processed in 39us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528496.834897:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788528496.834909:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788528496.834914:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875407735517568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.834939:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875407735517568:12345-0@lo:400:kworker.0 Request processed in 26us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528496.834945:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788528496.834955:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788528496.834960:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735517184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.834984:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735517184:12345-0@lo:400:kworker.0 Request processed in 23us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528496.834989:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788528496.834999:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1788528496.835004:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875407735517696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.835028:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875407735517696:12345-0@lo:400:kworker.0 Request processed in 24us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528496.835032:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00080000:2.0:1788528496.835054:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788528496.835058:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788528496.835060:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788528496.835063:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788528496.835093:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6da0000 x1875407735517184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528496.835106:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735517184:0@lo:400:kworker.0 00010000:00080000:2.0:1788528496.835124:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6da3800 x1875407735517696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528496.835132:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1875407735517696:0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.835142:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735516544:0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.835151:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735517056:0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.835159:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1875407735517568:0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.835203:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4470380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735516800:0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.835212:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735517312:0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.835220:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735517824:0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.835229:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735516416:0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.835237:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735517440:0@lo:400:kworker.0 00000100:00100000:2.0:1788528496.835246:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735517952:0@lo:400:kworker.0 00000100:00100000:0.0:1788528496.835624:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735516928 00000100:00100000:0.0:1788528496.835629:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735516928 00000100:00100000:0.0:1788528496.835664:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735516672 00000100:00100000:0.0:1788528496.835667:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735516672 00000100:00100000:0.0:1788528496.835681:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788528496.835699:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735516928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528496.835759:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735516928:12345-0@lo:400:kworker.0 Request processed in 62us (1975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528496.835765:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788528496.835778:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788528496.835784:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735516672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528496.835813:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735516672:12345-0@lo:400:kworker.0 Request processed in 29us (1706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528496.835818:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788528496.835868:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735516928:0@lo:400:kworker.0 00000100:00100000:1.0:1788528496.838759:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735518208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788528496.838827:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528496.838886:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788528496.838894:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735518080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788528496.838919:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528496.838957:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735518080 00000100:00100000:1.0:1788528496.838964:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735518080 00000100:00100000:1.0:1788528496.839009:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788528496.839018:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735518080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788528496.839045:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788528496.839090:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735518080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528496.839097:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788528496.839149:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735518080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788528496.839348:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735518208 00000100:00100000:3.0:1788528496.839352:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735518208 00000100:00100000:3.0:1788528496.839383:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788528496.839390:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735518208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788528496.839415:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788528496.839454:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735518208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528496.839459:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788528496.839822:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788528496.839835:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735518336:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788528496.839886:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528496.840015:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735518336 00000100:00100000:3.0:1788528496.840021:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735518336 00000100:00100000:3.0:1788528496.840057:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788528496.840065:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735518336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788528496.840078:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788528496.840111:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735518336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528496.840117:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788528496.840203:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735518208:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528496.840364:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735516672:0@lo:400:kworker.0 00000100:00100000:0.0:1788528496.840445:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735518336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788528496.858970:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528496.859222:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719742080 00000100:00100000:0.0:1788528496.859232:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719742080 00000100:00100000:0.0:1788528496.859298:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 66 00000100:00100000:0.0:1788528496.859310:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+18:13182:x1875407719742080:12345-192.168.203.38@tcp:35:umount.0 00000100:00100000:0.0:1788528496.859613:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+19:13182:x1875407719742080:12345-192.168.203.38@tcp:35:umount.0 Request processed in 305us (651us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788528496.859623:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 66 00000100:00100000:1.0:1788528496.863098:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528496.870410:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719742336 00000100:00100000:3.0:1788528496.870426:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719742336 00000100:00100000:3.0:1788528496.870503:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 67 00000100:00100000:3.0:1788528496.870514:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+19:13182:x1875407719742336:12345-192.168.203.38@tcp:35:umount.0 00000100:00100000:3.0:1788528496.870883:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+20:13182:x1875407719742336:12345-192.168.203.38@tcp:35:umount.0 Request processed in 369us (7793us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1788528496.870891:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 67 00000100:00100000:3.0:1788528496.873037:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528496.873136:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719742592 00000100:00100000:1.0:1788528496.873146:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719742592 00000100:00100000:1.0:1788528496.873198:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 68 00000100:00100000:1.0:1788528496.873208:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8def050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+20:13182:x1875407719742592:12345-192.168.203.38@tcp:35:umount.0 00000100:00100000:1.0:1788528496.873438:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8def050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:80304108-f3b9-46ea-888c-b2a7ec20e3e2+21:13182:x1875407719742592:12345-192.168.203.38@tcp:35:umount.0 Request processed in 230us (408us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1788528496.873447:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 68 00000100:00100000:1.0:1788528496.878413:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528496.878509:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719742848 00000100:00100000:0.0:1788528496.878519:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719742848 00000100:00100000:0.0:1788528496.878606:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 69 00000100:00100000:0.0:1788528496.878617:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+21:13182:x1875407719742848:12345-192.168.203.38@tcp:35:umount.0 00000100:00100000:0.0:1788528496.879076:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+22:13182:x1875407719742848:12345-192.168.203.38@tcp:35:umount.0 Request processed in 459us (672us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1788528496.879084:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 69 00000100:00100000:0.0:1788528496.886894:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528496.887434:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719742976 00000100:00100000:1.0:1788528496.887449:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719742976 00000100:00100000:1.0:1788528496.887544:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:0.0:1788528496.887652:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528496.887684:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2405:x1875407719742976:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788528496.887705:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528496.887729:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c14aa400/0x892c60dda91c7a85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfba3 expref: 14 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528496.887757:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528496.887883:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+13:2405:x1875407719742976:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 329us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528496.887901:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:2.0:1788528496.891082:0:8725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719743360 00000100:00100000:2.0:1788528496.891096:0:8725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719743360 00000100:00100000:2.0:1788528496.891175:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 80 00000100:00100000:2.0:1788528496.891186:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+7:2402:x1875407719743360:12345-192.168.203.38@tcp:9:umount.0 00000020:00000080:2.0:1788528496.891217:0:8725:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8019 00000020:00010000:2.0:1788528496.891225:0:8725:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a90d0051000: total 0 00000100:00080000:2.0:1788528496.891230:0:8725:0:(import.c:65:import_set_state_nolock()) ffff8a90d0054000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788528496.891283:0:8725:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788528496.891460:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2402:x1875407719743360:12345-192.168.203.38@tcp:9:umount.0 Request processed in 273us (3808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528496.891469:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 80 00000100:00100000:3.0:1788528496.892854:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528496.893019:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719743488 00000100:00100000:2.0:1788528496.893032:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719743488 00000100:00100000:3.0:1788528496.893350:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000020:00010000:1.0:1788528496.893358:0:6496:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a90d0051000: total 0 00010000:00010000:1.0:1788528496.893430:0:6496:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a90d0051000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788528496.893496:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092d51e51/0x892c60dda91c83d8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe6d expref: 4 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528496.893541:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c7d4e3d/0x892c60dda91c8aa7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0050 expref: 3 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528496.893613:0:6496:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a90d0051000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788528496.893627:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528496.893642:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528496.893645:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528496.895453:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719743616 00000100:00100000:2.0:1788528496.895470:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719743616 00000100:00100000:2.0:1788528496.895601:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:2.0:1788528496.895614:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+14:2406:x1875407719743488:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528496.895635:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528496.895661:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101850a00/0x892c60dda91c799e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfb64 expref: 14 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528496.895682:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528496.895770:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:2.0:1788528496.895772:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+13:2406:x1875407719743488:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 158us (2928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528496.895786:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:0.0:1788528496.895804:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16ff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+12:2406:x1875407719743616:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788528496.895827:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528496.895850:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc26e2800/0x892c60dda91c7a8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbaa expref: 12 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528496.895881:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528496.895929:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16ff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+11:2406:x1875407719743616:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 144us (2583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528496.895939:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:2.0:1788528496.896076:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528496.896533:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719743744 00000100:00100000:3.0:1788528496.896667:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719743744 00000100:00100000:3.0:1788528496.896724:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:3.0:1788528496.896733:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+11:2403:x1875407719743744:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788528496.896759:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528496.896775:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90f6f3aa00/0x892c60dda91c7ca7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc83 expref: 11 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528496.896790:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528496.896834:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:2403:x1875407719743744:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 102us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528496.896842:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:0.0:1788528496.911721:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528496.911851:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719743872 00000100:00100000:2.0:1788528496.911940:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719743872 00000100:00100000:2.0:1788528496.912041:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 81 00000100:00100000:2.0:1788528496.912053:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2402:x1875407719743872:12345-192.168.203.38@tcp:9:umount.0 00000020:00000080:2.0:1788528496.912083:0:8421:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c7daa 00000100:00080000:2.0:1788528496.912093:0:8421:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3fda000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788528496.912152:0:8421:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1788528496.912314:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+2:2402:x1875407719743872:12345-192.168.203.38@tcp:9:umount.0 Request processed in 263us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528496.912336:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 81 00010000:00010000:3.0:1788528496.915197:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528496.922887:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528496.923027:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719744896 00000100:00100000:0.0:1788528496.923037:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719744896 00000100:00100000:0.0:1788528496.923093:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 258 00000100:00100000:0.0:1788528496.923103:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+22:2402:x1875407719744896:12345-192.168.203.38@tcp:39:umount.0 00000020:00000080:0.0:1788528496.923145:0:6510:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c79ac 00000020:00010000:0.0:1788528496.923161:0:6510:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a8fc3d1d000: total 0 00000100:00080000:0.0:1788528496.923167:0:6510:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d1a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788528496.923291:0:6510:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:0.0:1788528496.923453:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:80304108-f3b9-46ea-888c-b2a7ec20e3e2+21:2402:x1875407719744896:12345-192.168.203.38@tcp:39:umount.0 Request processed in 350us (574us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1788528496.923476:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 258 00000020:00010000:3.0:1788528496.927923:0:6497:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a8fc3d1d000: total 0 00010000:00010000:2.0:1788528496.928633:0:6497:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a8fc3d1d000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788528496.928675:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:2.0:1788528496.928679:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788528496.928690:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851800/0x892c60dda91c8a92 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0049 expref: 20 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528496.928713:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:2.0:1788528496.928715:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788528496.928719:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031800/0x892c60dda91c7d80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfcad expref: 19 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528496.928732:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:2.0:1788528496.928735:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788528496.928747:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550a00/0x892c60dda91c8a68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c003b expref: 18 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528496.928764:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:2.0:1788528496.928767:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788528496.928770:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3428600/0x892c60dda91c8399 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe58 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528496.928783:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:2.0:1788528496.928785:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788528496.928788:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17e00/0x892c60dda91c874a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bff69 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528496.928821:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:2.0:1788528496.928824:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788528496.928829:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c8441 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe89 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528496.928840:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:2.0:1788528496.928842:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788528496.928846:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b400/0x892c60dda91c807b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfd86 expref: 14 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528496.928879:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a8fc2721c00) 00010000:00010000:2.0:1788528496.928882:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528496.928886:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b200/0x892c60dda91c7d25 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc98 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528496.928900:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a90c82d0e00) 00010000:00010000:2.0:1788528496.928902:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788528496.928906:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c8988 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0003 expref: 12 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528496.928920:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:2.0:1788528496.928923:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788528496.928926:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a400/0x892c60dda91c83c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe66 expref: 11 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528496.928937:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a8fc2721700) 00010000:00010000:2.0:1788528496.928939:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788528496.928951:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b000/0x892c60dda91c7d09 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc91 expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528496.928966:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a8fc1fa8000) 00010000:00010000:2.0:1788528496.928968:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788528496.928972:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a800/0x892c60dda91c845d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe90 expref: 9 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528496.928985:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a8fc3770300) 00010000:00010000:2.0:1788528496.928987:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788528496.928991:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc3429200/0x892c60dda91c82b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfe20 expref: 8 pid: 13480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528496.929002:0:6497:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a8fc3d1d000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1788528496.929016:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528496.929018:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528496.929020:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528496.934931:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528496.935049:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719745024 00000100:00100000:2.0:1788528496.935060:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719745024 00000100:00100000:2.0:1788528496.935127:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 259 00000100:00100000:2.0:1788528496.935137:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+5:2402:x1875407719745024:12345-192.168.203.38@tcp:39:umount.0 00000020:00000080:2.0:1788528496.935174:0:6508:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c79b3 00000100:00080000:2.0:1788528496.935193:0:6508:0:(import.c:65:import_set_state_nolock()) ffff8a90fe6b9000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788528496.935223:0:6508:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788528496.935384:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:80304108-f3b9-46ea-888c-b2a7ec20e3e2+3:2402:x1875407719745024:12345-192.168.203.38@tcp:39:umount.0 Request processed in 248us (461us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788528496.935392:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 259 00010000:00010000:1.0:1788528496.935530:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528497.792603:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528497.854762:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788528497.854773:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788528497.854788:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735518592:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788528497.854789:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735518464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788528497.857128:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528497.857373:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735518592 00000100:00100000:0.0:1788528497.857383:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735518592 00000100:00100000:0.0:1788528497.857441:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788528497.857451:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735518592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788528497.857485:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528497.857546:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735518592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528497.857594:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788528497.857942:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735518592:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788528497.862445:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528497.862664:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735518464 00000100:00100000:0.0:1788528497.862674:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735518464 00000100:00100000:0.0:1788528497.862743:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788528497.862754:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735518464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788528497.862779:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528497.862838:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735518464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528497.862844:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788528497.863055:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735518464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788528498.707192:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528498.707238:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528498.707308:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719745152 00000100:00100000:2.0:1788528498.707319:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719745152 00000100:00100000:2.0:1788528498.707377:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719745280 00000100:00100000:2.0:1788528498.707381:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719745280 00000100:00100000:2.0:1788528498.707417:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:2.0:1788528498.707427:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+11:2406:x1875407719745152:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528498.707441:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528498.707460:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc3428800/0x892c60dda91c7ae7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbf0 expref: 11 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528498.707477:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528498.707527:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+10:2406:x1875407719745152:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 102us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528498.707534:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:2.0:1788528498.707602:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:2.0:1788528498.707611:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+9:2406:x1875407719745280:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528498.707620:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528498.707629:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90f6f3ac00/0x892c60dda91c7ca0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfc7c expref: 9 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528498.707638:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528498.707656:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+8:2406:x1875407719745280:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 47us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528498.707678:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:3.0:1788528498.711960:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528498.712102:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528498.714415:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719745408 00000100:00100000:1.0:1788528498.714433:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719745408 00000100:00100000:1.0:1788528498.714524:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719745536 00000100:00100000:1.0:1788528498.714528:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719745536 00000100:00100000:1.0:1788528498.714582:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:1.0:1788528498.714595:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+9:2404:x1875407719745408:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788528498.714615:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528498.714639:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc3429600/0x892c60dda91c7ae0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbbf expref: 9 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528498.714660:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528498.714747:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+8:2404:x1875407719745408:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 154us (2800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528498.714755:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:1.0:1788528498.714775:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:1.0:1788528498.714782:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+7:2405:x1875407719745536:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788528498.714790:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528498.714799:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc3428a00/0x892c60dda91c7ad9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7bfbb8 expref: 7 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528498.714828:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528498.715030:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+6:2405:x1875407719745536:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 67us (2746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528498.715037:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:0.0:1788528498.725697:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528498.729046:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719745792 00000100:00100000:3.0:1788528498.729101:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719745792 00000100:00100000:3.0:1788528498.729226:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 260 00000100:00100000:3.0:1788528498.729241:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+6:2402:x1875407719745792:12345-192.168.203.38@tcp:39:umount.0 00000020:00000080:3.0:1788528498.729301:0:13480:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c7af5 00000020:00010000:3.0:1788528498.729312:0:13480:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a8fc3d2f000: total 0 00000100:00080000:3.0:1788528498.729317:0:13480:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d29800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788528498.729348:0:13480:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:3.0:1788528498.730288:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2402:x1875407719745792:12345-192.168.203.38@tcp:39:umount.0 Request processed in 1042us (4599us total) trans 4294967529 rc 0/0 00000100:00100000:3.0:1788528498.730302:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 260 00000020:00010000:1.0:1788528498.730600:0:6496:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a8fc3d2f000: total 0 00010000:00010000:1.0:1788528498.730674:0:6496:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a8fc3d2f000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788528498.730718:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:1.0:1788528498.730723:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788528498.730745:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030200/0x892c60dda91c8ab5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0057 expref: 4 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528498.730775:0:6496:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a8fc3d2f000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788528498.730787:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528498.730790:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528498.730791:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788528498.731303:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1788528498.735335:0:6487:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689 00000001:00080000:1.0:1788528498.735351:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:1.0:1788528498.735356:0:6487:0:(genops.c:885:class_export_put()) final put ffff8a8fc3d2f000/287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689 00000001:00100000:1.0:1788528498.735380:0:6487:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 80304108-f3b9-46ea-888c-b2a7ec20e3e2 00000001:00080000:1.0:1788528498.735387:0:6487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1788528498.735396:0:6487:0:(genops.c:885:class_export_put()) final put ffff8a8fc3d1d000/80304108-f3b9-46ea-888c-b2a7ec20e3e2 00000020:00000080:0.0:1788528498.735807:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3d2f000/287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689 for lustre-MDT0000 00000020:00000080:0.0:1788528498.735902:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3d1d000/80304108-f3b9-46ea-888c-b2a7ec20e3e2 for lustre-MDT0000 00000020:00000080:0.0:1788528498.735942:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc3d29800 for lustre-MDT0000 00000020:00000080:0.0:1788528498.735948:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc3d1a800 for lustre-MDT0000 00000100:00100000:1.0:1788528498.743787:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528498.744039:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719745920 00000100:00100000:0.0:1788528498.744059:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719745920 00000100:00100000:0.0:1788528498.744175:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 261 00000100:00100000:0.0:1788528498.744210:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+5:2402:x1875407719745920:12345-192.168.203.38@tcp:39:umount.0 00000020:00000080:0.0:1788528498.744266:0:6510:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c7afc 00000100:00080000:0.0:1788528498.744279:0:6510:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d2e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788528498.744310:0:6510:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788528498.744536:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689+3:2402:x1875407719745920:12345-192.168.203.38@tcp:39:umount.0 Request processed in 330us (758us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788528498.744546:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 261 00010000:00010000:0.0:1788528498.744622:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788528498.744884:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788528498.789260:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528498.789488:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719746048 00000100:00100000:2.0:1788528498.789502:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719746048 00000100:00100000:2.0:1788528498.789622:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 423 00000100:00100000:2.0:1788528498.789634:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+6:2402:x1875407719746048:12345-192.168.203.38@tcp:251:umount.0 00000020:00000080:2.0:1788528498.789694:0:6500:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c7989 00000100:00080000:2.0:1788528498.789707:0:6500:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d19000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788528498.789807:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:834ce1d3-c286-4bf4-af56-ae8f56d93ddf+1:2402:x1875407719746048:12345-192.168.203.38@tcp:251:umount.0 Request processed in 174us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528498.789816:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 423 00000020:00000080:2.0:1788528498.789829:0:6500:0:(genops.c:885:class_export_put()) final put ffff8a8fc3d19800/834ce1d3-c286-4bf4-af56-ae8f56d93ddf 00000020:00000080:2.0:1788528498.789874:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3d19800/834ce1d3-c286-4bf4-af56-ae8f56d93ddf for MGS 00000020:00000080:2.0:1788528498.789922:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc3d19000 for MGS 00010000:00010000:3.0:1788528498.790589:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528498.815532:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528498.878871:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788528498.878903:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735518720:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788528498.879012:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528498.879224:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735518720 00000100:00100000:3.0:1788528498.879235:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735518720 00000100:00100000:3.0:1788528498.879302:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788528498.879314:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735518720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788528498.879371:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788528498.879434:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735518720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528498.879441:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788528498.879761:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735518720:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788528499.839762:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528500.867931:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788528500.990665:0:15144:0:(tgt_mount.c:2269:server_umount_begin()) umount -f 00000020:01000004:2.0:1788528501.026729:0:15144:0:(tgt_mount.c:2125:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788528501.026807:0:15144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c14abe00/0x892c60dda91c7a5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a62 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528501.026825:0:15144:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c14abe00/0x892c60dda91c7a5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7a62 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528501.026834:0:15144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c14abe00/0x892c60dda91c7a5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c7a62 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528501.026843:0:15144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a90c14abe00/0x892c60dda91c7a5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c7a62 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528501.026900:0:15144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788528501.026908:0:15144:0:(mgc_request.c:650:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788528501.026949:0:15144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788528501.026955:0:15144:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788528501.026962:0:15144:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788528501.026996:0:15144:0:(import.c:65:import_set_state_nolock()) ffff8a90f58ad800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788528501.027043:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875407735518848:0@lo:39:umount.0 00000100:00100000:2.0:1788528501.027134:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528501.027469:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735518848 00000100:00100000:0.0:1788528501.027480:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735518848 00000100:00100000:0.0:1788528501.027544:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788528501.027576:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875407735518848:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788528501.027610:0:8449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c757d 00000100:00080000:0.0:1788528501.027629:0:8449:0:(import.c:65:import_set_state_nolock()) ffff8a90f5ace800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788528501.027702:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3636:x1875407735518848:12345-0@lo:39:umount.0 Request processed in 148us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528501.027720:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:0.0:1788528501.027733:0:8449:0:(genops.c:885:class_export_put()) final put ffff8a90f5aca000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1788528501.027759:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528501.027767:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c14abe00/0x892c60dda91c7a5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c7a62 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528501.027777:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c14abe00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:0.0:1788528501.027791:0:6497:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c14abe00/0x892c60dda91c7a5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c7a62 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528501.027802:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c14abe00/0x892c60dda91c7a5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c7a62 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528501.027810:0:6497:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c14abe00/0x892c60dda91c7a5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c7a62 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528501.027816:0:6497:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788528501.027819:0:6497:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:0.0:1788528501.027822:0:6497:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788528501.027880:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c14abe00/0x892c60dda91c7a5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c7a62 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528501.027888:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788528501.027914:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c14abe00/0x892c60dda91c7a5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c7a62 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528501.027923:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c14abe00/0x892c60dda91c7a5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c7a62 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528501.027937:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528501.027939:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528501.027940:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788528501.027951:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90f5aca000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788528501.028006:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90f5ace800 for lustre-MDT0000 00000100:00100000:0.0:1788528501.028020:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788528501.028033:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735518976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788528501.028068:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528501.028115:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735518976 00000100:00100000:0.0:1788528501.028125:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735518976 00000100:00100000:0.0:1788528501.028161:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788528501.028167:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4674e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+27:3640:x1875407735518976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788528501.028179:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528501.028195:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c14ab200/0x892c60dda91c7a62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c7a5b expref: 27 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528501.028208:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528501.028250:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4674e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd052447-840d-4bcc-891b-140c465c7625+26:3640:x1875407735518976:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528501.028260:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788528501.028321:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:3640:1875407735518976:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788528501.028471:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90f58ad800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788528501.028481:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875407735518848:0@lo:39:umount.0 00000100:00080000:2.0:1788528501.029365:0:15144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788528501.029372:0:15144:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788528501.029380:0:15144:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788528501.030341:0:15144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c7a69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a70 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528501.030360:0:15144:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c7a69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7a70 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528501.030369:0:15144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c7a69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c7a70 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528501.030376:0:15144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c7a69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c7a70 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528501.030403:0:15144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788528501.030411:0:15144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851c00/0x892c60dda91c7943 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c794a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528501.030418:0:15144:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851c00/0x892c60dda91c7943 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c794a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528501.030442:0:15144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851c00/0x892c60dda91c7943 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c794a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528501.030448:0:15144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a9101851c00/0x892c60dda91c7943 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c794a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528501.030461:0:15144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788528501.030468:0:15144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3200/0x892c60dda91c7cd8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7cdf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528501.030474:0:15144:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3200/0x892c60dda91c7cd8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7cdf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528501.030480:0:15144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3200/0x892c60dda91c7cd8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c7cdf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528501.030486:0:15144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3200/0x892c60dda91c7cd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c7cdf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528501.030500:0:15144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788528501.030507:0:15144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c13fd000/0x892c60dda91c74d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c74dc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528501.030513:0:15144:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c13fd000/0x892c60dda91c74d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c74dc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528501.030520:0:15144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c13fd000/0x892c60dda91c74d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c74dc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528501.030537:0:15144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a90c13fd000/0x892c60dda91c74d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c74dc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528501.030544:0:8438:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788528501.030550:0:15144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788528501.030584:0:15144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2600/0x892c60dda91c7a77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a7e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528501.030589:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c7a69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c7a70 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528501.030598:0:15144:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2600/0x892c60dda91c7a77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7a7e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528501.030606:0:15144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2600/0x892c60dda91c7a77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c7a7e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528501.030612:0:15144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2600/0x892c60dda91c7a77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c7a7e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528501.030621:0:15144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1788528501.030624:0:15144:0:(mgc_request.c:650:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788528501.030662:0:15144:0:(tgt_mount.c:2175:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788528501.030667:0:15144:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788528501.030672:0:15144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788528501.030678:0:15144:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:2.0:1788528501.030686:0:15144:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a8fc34cf000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788528501.030692:0:15144:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a8fc2401800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788528501.030696:0:15144:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a90fa76d000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788528501.030701:0:15144:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a9101943800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00010000:00010000:1.0:1788528501.030718:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c14ab000 already unused, calling callback (ffffffffc11e0e00) 00000020:00080000:2.0:1788528501.030721:0:15144:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8a90f8e28000) has exports, disconnecting them 10000000:00010000:1.0:1788528501.030725:0:8438:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c7a69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c7a70 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788528501.030737:0:15144:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a8fc34cf000), last request at 1788528496 00010000:00010000:1.0:1788528501.030742:0:8438:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c7a69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c7a70 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788528501.030748:0:15144:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c7894 10000000:00010000:1.0:1788528501.030752:0:8438:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c7a69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c7a70 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528501.030761:0:8438:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788528501.030764:0:8438:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-MDT0000: stale lock, won't requeue 10000000:01000000:1.0:1788528501.030767:0:8438:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000100:00080000:2.0:1788528501.030771:0:15144:0:(import.c:65:import_set_state_nolock()) ffff8a8fc34cc000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788528501.030828:0:15144:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a8fc34cf000): rc 0 00000020:00000080:2.0:1788528501.030831:0:15144:0:(genops.c:885:class_export_put()) final put ffff8a8fc34cf000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788528501.030841:0:15144:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a8fc2401800), last request at 1788528496 00000020:00000080:2.0:1788528501.030844:0:15144:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c7760 00000100:00080000:2.0:1788528501.030849:0:15144:0:(import.c:65:import_set_state_nolock()) ffff8a8fc2407000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788528501.030856:0:15144:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a8fc2401800): rc 0 00000020:00000080:2.0:1788528501.030858:0:15144:0:(genops.c:885:class_export_put()) final put ffff8a8fc2401800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1788528501.030861:0:15144:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a90fa76d000), last request at 1788528276 00000020:00000080:2.0:1788528501.030864:0:15144:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c765d 00000100:00080000:2.0:1788528501.030872:0:15144:0:(import.c:65:import_set_state_nolock()) ffff8a90fa769000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788528501.030879:0:15144:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a90fa76d000): rc 0 00000020:00000080:2.0:1788528501.030880:0:15144:0:(genops.c:885:class_export_put()) final put ffff8a90fa76d000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1788528501.030883:0:15144:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a9101943800), last request at 1788528276 00000020:00000080:2.0:1788528501.030887:0:15144:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c761e 00000100:00080000:2.0:1788528501.030890:0:15144:0:(import.c:65:import_set_state_nolock()) ffff8a9101940800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788528501.030895:0:15144:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000020:00080000:2.0:1788528501.031000:0:15144:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a9101943800): rc 0 00000004:00000080:2.0:1788528501.031008:0:15144:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9b7a01c0bae0 00000100:00080000:2.0:1788528501.031029:0:15144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788528501.031033:0:15144:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:1.0:1788528501.031206:0:8438:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c7a69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c7a70 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528501.031215:0:8438:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528501.031247:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c7a69 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c7a70 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528501.031256:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab000/0x892c60dda91c7a69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c7a70 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528501.031272:0:8438:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788528501.031276:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a9101851c00/0x892c60dda91c7943 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c794a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528501.031283:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101851c00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528501.031293:0:8438:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a9101851c00/0x892c60dda91c7943 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c794a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528501.031301:0:8438:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a9101851c00/0x892c60dda91c7943 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c794a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528501.031307:0:8438:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a9101851c00/0x892c60dda91c7943 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c794a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528501.031314:0:8438:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788528501.031316:0:8438:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-mdtir: stale lock, won't requeue 10000000:01000000:1.0:1788528501.031318:0:8438:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788528501.031349:0:8438:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a9101851c00/0x892c60dda91c7943 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c794a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528501.031356:0:8438:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528501.031375:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a9101851c00/0x892c60dda91c7943 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c794a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528501.031383:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a9101851c00/0x892c60dda91c7943 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c794a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528501.031394:0:8438:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788528501.031398:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3200/0x892c60dda91c7cd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c7cdf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528501.031405:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e3200 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528501.031407:0:8438:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3200/0x892c60dda91c7cd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c7cdf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528501.031415:0:8438:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3200/0x892c60dda91c7cd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c7cdf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528501.031429:0:8438:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3200/0x892c60dda91c7cd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c7cdf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528501.031434:0:8438:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788528501.031436:0:8438:0:(mgc_request.c:1180:mgc_blocking_ast()) log params: stale lock, won't requeue 10000000:01000000:1.0:1788528501.031438:0:8438:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788528501.031468:0:8438:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3200/0x892c60dda91c7cd8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c7cdf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528501.031473:0:8438:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528501.031482:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3200/0x892c60dda91c7cd8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c7cdf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528501.031489:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3200/0x892c60dda91c7cd8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c7cdf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528501.031500:0:8438:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788528501.031504:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c13fd000/0x892c60dda91c74d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c74dc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528501.031510:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c13fd000 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528501.031513:0:8438:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c13fd000/0x892c60dda91c74d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c74dc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528501.031520:0:8438:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c13fd000/0x892c60dda91c74d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c74dc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528501.031527:0:8438:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c13fd000/0x892c60dda91c74d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c74dc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528501.031545:0:8438:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788528501.031547:0:8438:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-barrier: stale lock, won't requeue 10000000:01000000:1.0:1788528501.031550:0:8438:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:2.0:1788528501.031908:0:15144:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788528501.031928:0:15144:0:(import.c:65:import_set_state_nolock()) ffff8a90d635c800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788528501.032040:0:6496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528501.032047:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2600/0x892c60dda91c7a77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c7a7e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528501.032055:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e2600 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:0.0:1788528501.032058:0:6496:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2600/0x892c60dda91c7a77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c7a7e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528501.032066:0:6496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2600/0x892c60dda91c7a77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c7a7e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528501.032073:0:6496:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2600/0x892c60dda91c7a77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c7a7e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528501.032093:0:6496:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788528501.032095:0:6496:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 10000000:01000000:0.0:1788528501.032098:0:6496:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788528501.032135:0:6496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2600/0x892c60dda91c7a77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c7a7e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528501.032141:0:6496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788528501.032148:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2600/0x892c60dda91c7a77 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c7a7e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528501.032156:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2600/0x892c60dda91c7a77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c7a7e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528501.032168:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528501.032170:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528501.032172:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528501.032453:0:8438:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c13fd000/0x892c60dda91c74d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c74dc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528501.032460:0:8438:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528501.032467:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c13fd000/0x892c60dda91c74d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c74dc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528501.032473:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c13fd000/0x892c60dda91c74d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c74dc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528501.032488:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528501.032490:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528501.032494:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528501.032504:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528501.032524:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735519616:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1788528501.032900:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc34cf000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788528501.032944:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc2401800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788528501.032967:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90fa76d000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788528501.032991:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc34cc000 for lustre-MDT0000 00000020:00000080:0.0:1788528501.032996:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc2407000 for lustre-MDT0000 00000020:00000080:0.0:1788528501.033000:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90fa769000 for lustre-MDT0000 00010000:00010000:0.0:1788528501.033041:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528501.033055:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735519488:0@lo:39:umount.0 00010000:00010000:3.0:1788528501.033142:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528501.034377:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528501.034451:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788528501.034463:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735519104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528501.034507:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528501.034528:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735519744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528501.034549:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528501.034609:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735519232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528501.034633:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528501.034653:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788528501.034679:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735519360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528501.034702:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528501.034751:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735519616 00000100:00100000:1.0:1788528501.034760:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735519616 00000100:00100000:1.0:1788528501.034810:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735519104 00000100:00100000:1.0:1788528501.034812:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735519104 00000100:00100000:1.0:1788528501.034823:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735519744 00000100:00100000:1.0:1788528501.034825:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735519744 00000100:00100000:1.0:1788528501.034835:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735519232 00000100:00100000:1.0:1788528501.034837:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735519232 00000100:00100000:1.0:1788528501.034849:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735519360 00000100:00100000:1.0:1788528501.034851:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735519360 00000100:00100000:1.0:1788528501.034865:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788528501.034873:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16fe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd052447-840d-4bcc-891b-140c465c7625+30:3639:x1875407735519616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788528501.034889:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528501.034911:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101851600/0x892c60dda91c7a7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c7a77 expref: 30 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528501.034930:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528501.034967:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16fe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd052447-840d-4bcc-891b-140c465c7625+29:3639:x1875407735519616:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528501.034975:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788528501.035024:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788528501.035030:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd052447-840d-4bcc-891b-140c465c7625+28:3639:x1875407735519104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788528501.035036:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528501.035044:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc26e2a00/0x892c60dda91c7a70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c7a69 expref: 28 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528501.035054:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528501.035218:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788528501.035228:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd052447-840d-4bcc-891b-140c465c7625+27:3639:x1875407735519744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788528501.035237:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528501.035246:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c1551c00/0x892c60dda91c74dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c74d5 expref: 27 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528501.035257:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528501.035289:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd052447-840d-4bcc-891b-140c465c7625+26:3639:x1875407735519744:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528501.035296:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788528501.035311:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788528501.035317:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd052447-840d-4bcc-891b-140c465c7625+25:3637:x1875407735519232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788528501.035325:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528501.035333:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90f6e16400/0x892c60dda91c794a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c7943 expref: 25 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528501.035341:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528501.035368:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd052447-840d-4bcc-891b-140c465c7625+24:3637:x1875407735519232:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528501.035374:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788528501.035387:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788528501.035394:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd052447-840d-4bcc-891b-140c465c7625+23:3637:x1875407735519360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788528501.035406:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528501.035415:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc26e3600/0x892c60dda91c7cdf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c7cd8 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528501.035424:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528501.035445:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd052447-840d-4bcc-891b-140c465c7625+22:3637:x1875407735519360:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528501.035451:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788528501.035631:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528501.035758:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735519488 00000100:00100000:3.0:1788528501.035765:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735519488 00000100:00100000:3.0:1788528501.035808:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788528501.035815:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90de364c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875407735519488:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788528501.035849:0:9268:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c76b8 00000100:00080000:3.0:1788528501.035867:0:9268:0:(import.c:65:import_set_state_nolock()) ffff8a90f58da800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788528501.035892:0:9268:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1788528501.036054:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90de364c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3636:x1875407735519488:12345-0@lo:39:umount.0 Request processed in 239us (423us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788528501.036062:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00010000:00010000:0.0:1788528501.038101:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788528501.038174:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90d635c800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788528501.038189:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735519488:0@lo:39:umount.0 00000100:00100000:1.0:1788528501.038544:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd052447-840d-4bcc-891b-140c465c7625+21:3639:x1875407735519104:12345-0@lo:103:ldlm_bl.0 Request processed in 3510us (4031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528501.038575:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788528501.038644:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735519104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528501.038656:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735519744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528501.038666:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735519616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528501.038718:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735519360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528501.038729:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:3637:1875407735519232:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788528501.038902:0:15144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788528501.038907:0:15144:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1788528501.043296:0:15144:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788528501.043395:0:15144:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788528501.043436:0:15144:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1f91000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788528501.043472:0:15144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788528501.043478:0:15144:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1788528501.043502:0:15144:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788528501.043515:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735519872:0@lo:9:umount.0 00000100:00080000:2.0:1788528501.043582:0:15144:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788528501.043594:0:15144:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3c51800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788528501.043640:0:15144:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8a90f8e28000) has no exports 00000100:00100000:1.0:1788528501.043655:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528501.043695:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735519872 00000100:00100000:2.0:1788528501.043705:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735519872 00000100:00100000:1.0:1788528501.043727:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735520000:0@lo:9:umount.0 00000100:00100000:1.0:1788528501.043766:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788528501.044893:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788528501.045247:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735520000 00000100:00100000:2.0:1788528501.045258:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735520000 00000100:00100000:1.0:1788528501.045264:0:8725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788528501.045281:0:8725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875407735519872:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788528501.045320:0:8725:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c7816 00000100:00100000:2.0:1788528501.045321:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788528501.045334:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875407735520000:12345-0@lo:9:umount.0 00000100:00080000:1.0:1788528501.045335:0:8725:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3027000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788528501.045355:0:8423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c7974 00000100:00080000:2.0:1788528501.045364:0:8423:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3021000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788528501.045399:0:8725:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000001:00000004:2.0:1788528501.045409:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00080000:3.0:1788528501.045465:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788528501.045647:0:8725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3636:x1875407735519872:12345-0@lo:9:umount.0 Request processed in 371us (1993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528501.045655:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3636:x1875407735520000:12345-0@lo:9:umount.0 Request processed in 323us (1887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528501.045659:0:8725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788528501.045669:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:1.0:1788528501.045691:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528501.045701:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788528501.045753:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3c51800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788528501.045773:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788528501.045776:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788528501.045779:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735520000:0@lo:9:umount.0 00000100:00080000:3.0:1788528501.045794:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1f91000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788528501.045802:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788528501.045804:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788528501.045807:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735519872:0@lo:9:umount.0 00000020:00080000:3.0:1788528501.060824:0:15144:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8a90f8e28000) has no exports 00000020:00000080:3.0:1788528501.135536:0:15144:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c7530 00000020:00000080:3.0:1788528501.135579:0:15144:0:(genops.c:885:class_export_put()) final put ffff8a90c498f800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788528501.135601:0:15144:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788528501.135739:0:15144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788528501.135752:0:15144:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788528501.135757:0:15144:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8a90ce96e600) has no exports 00000020:00000080:2.0:1788528501.136071:0:15144:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c7529 00000020:00000080:2.0:1788528501.136077:0:15144:0:(genops.c:885:class_export_put()) final put ffff8a90f58a9000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788528501.136157:0:15144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788528501.136469:0:15144:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788528501.137307:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90c498f800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788528501.137322:0:469:0:(genops.c:885:class_export_put()) final put ffff8a90f58aa000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788528501.137325:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90f58aa000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788528501.137337:0:469:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788528501.137574:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90f58a9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1788528501.891851:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528501.952377:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788528501.952405:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735520128:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788528501.952676:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528501.952793:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735520128 00000100:00100000:1.0:1788528501.952803:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735520128 00000100:00100000:1.0:1788528501.952856:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788528501.952868:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1875407735520128:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1788528501.952878:0:6514:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788528501.952952:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1875407735520128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (281us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788528501.952959:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788528501.952980:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735520384:0@lo:400:kworker.0 00000100:00100000:1.0:1788528501.952996:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4676680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1875407735520512:0@lo:400:kworker.0 00000100:00100000:0.0:1788528501.953041:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528501.953072:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735520256:0@lo:400:kworker.0 00000100:00100000:0.0:1788528501.953101:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1875407735520896:0@lo:400:kworker.0 00000100:00100000:1.0:1788528501.953122:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528501.953155:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528501.953173:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735520768:0@lo:400:kworker.0 00000100:00100000:0.0:1788528501.953206:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735520384 00000100:00100000:1.0:1788528501.953214:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528501.953217:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735520384 00000100:00100000:0.0:1788528501.953261:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735520896 00000100:00100000:0.0:1788528501.953264:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735520896 00000100:00100000:0.0:1788528501.953282:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788528501.953289:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875407735520384:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788528501.953297:0:6510:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:02020000:1.0:1788528501.953327:0:3638:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:0.0:1788528501.953348:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875407735520384:12345-0@lo:400:kworker.0 Request processed in 53us (306us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788528501.953356:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788528501.953372:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788528501.953376:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875407735520896:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788528501.953381:0:6510:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788528501.953402:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875407735520896:12345-0@lo:400:kworker.0 Request processed in 24us (251us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788528501.953408:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:0.0:1788528501.953458:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788528501.953464:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8a90f6c00800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788528501.953469:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1788528501.953571:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735520640:0@lo:400:kworker.0 00000100:00100000:2.0:1788528501.953615:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528501.953661:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4676300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735521152:0@lo:400:kworker.0 00000100:00100000:2.0:1788528501.953698:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528501.953732:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735520640 00000100:00100000:3.0:1788528501.953739:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735520640 00000100:00100000:2.0:1788528501.953749:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788528501.953762:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735521280:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788528501.953795:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528501.953801:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788528501.953814:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735520640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528501.953846:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735520768 00000100:00100000:2.0:1788528501.953854:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735520768 00000100:00100000:3.0:1788528501.953887:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735520640:12345-0@lo:400:kworker.0 Request processed in 75us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528501.953898:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788528501.953904:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735521152 00000100:00100000:2.0:1788528501.953910:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735521152 00000100:00100000:3.0:1788528501.953935:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735520256 00000100:00100000:3.0:1788528501.953942:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735520256 00000100:00100000:2.0:1788528501.953949:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788528501.953966:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735520768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528501.953990:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:3.0:1788528501.954002:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+21:3638:x1875407735520256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528501.954023:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735520768:12345-0@lo:400:kworker.0 Request processed in 63us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528501.954031:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788528501.954065:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd052447-840d-4bcc-891b-140c465c7625+21:3638:x1875407735520256:12345-0@lo:400:kworker.0 Request processed in 64us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528501.954072:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788528501.954089:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:2.0:1788528501.954099:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735521152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528501.954143:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735521152:12345-0@lo:400:kworker.0 Request processed in 58us (448us total) trans 0 rc 0/0 00000100:00080000:3.0:1788528501.954147:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788528501.954153:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:3.0:1788528501.954155:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788528501.954161:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788528501.954181:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735521280 00000100:00100000:3.0:1788528501.954186:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735521280 00000100:00100000:3.0:1788528501.954223:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788528501.954232:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735521280:12345-0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788528501.954250:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc4674000 x1875407735520640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:3.0:1788528501.954260:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788528501.954267:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735520640:0@lo:400:kworker.0 00000100:00100000:2.0:1788528501.954285:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4676300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735521152:0@lo:400:kworker.0 00000100:00100000:3.0:1788528501.954312:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735521280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528501.954322:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788528501.954342:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735521280:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788528501.954396:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528501.954450:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735521024:0@lo:400:kworker.0 00000100:00100000:3.0:1788528501.954469:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735520512 00000100:00100000:3.0:1788528501.954476:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735520512 00000100:00100000:2.0:1788528501.954492:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528501.954510:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735521024 00000100:00100000:3.0:1788528501.954525:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735521024 00000100:00100000:2.0:1788528501.954542:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788528501.954551:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875407735520512:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788528501.954602:0:6509:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788528501.954615:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788528501.954626:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735521024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528501.954648:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875407735520512:12345-0@lo:400:kworker.0 Request processed in 94us (249us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788528501.954657:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788528501.954685:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735521024:12345-0@lo:400:kworker.0 Request processed in 60us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528501.954696:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00080000:2.0:1788528501.954723:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788528501.954729:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8a8fc2400800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00080000:3.0:1788528501.954732:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:02000400:2.0:1788528501.954734:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788528501.954744:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8a8fc2400800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788528501.954748:0:3640:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 162 00000100:00080000:2.0:1788528501.954757:0:3640:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a8fc2400800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1788528501.954782:0:3640:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90ffa67b80 x1875407735521408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788528501.954808:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4676680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1875407735520512:0@lo:400:kworker.0 00010000:00080000:2.0:1788528501.954823:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc4675880 x1875407735521024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528501.954832:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735521024:0@lo:400:kworker.0 00000100:00100000:3.0:1788528501.954945:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1875407735521408:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788528501.954984:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528501.959908:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735521408 00000100:00100000:2.0:1788528501.959926:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735521408 00000100:00100000:2.0:1788528501.959998:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788528501.960007:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3636:x1875407735521408:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788528501.960045:0:8449:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788528501.960141:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3636:x1875407735521408:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 133us (5156us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788528501.960148:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:1.0:1788528501.961531:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788528501.961538:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8a90fa5f9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788528501.961542:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788528501.961548:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8a90fa5f9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788528501.961583:0:3638:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 145 00000100:00080000:1.0:1788528501.961593:0:3638:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a90fa5f9800 using connection 192.168.203.138@tcp/0@lo 00000100:00080000:3.0:1788528501.963414:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc2400800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788528501.963439:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788528501.963444:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1875407735521408:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788528501.963970:0:3638:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc44c6300 x1875407735521536/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788528501.964019:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735520256:0@lo:400:kworker.0 00000100:00100000:1.0:1788528501.964045:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735520768:0@lo:400:kworker.0 00000100:00100000:3.0:1788528501.964217:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735521536:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788528501.964295:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528501.966696:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735521536 00000100:00100000:1.0:1788528501.966722:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735521536 00000100:00100000:1.0:1788528501.966776:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788528501.966785:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1875407735521536:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1788528501.966803:0:6513:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788528501.967154:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1875407735521536:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 367us (2857us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788528501.967174:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:2.0:1788528501.974642:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90fa5f9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788528501.974656:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788528501.974662:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735521536:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1788528501.994718:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8a90f6c00800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788528501.994734:0:3639:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 145 00000100:00080000:0.0:1788528501.994745:0:3639:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a90f6c00800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528501.995389:0:3639:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90f58c1500 x1875407735521664/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788528501.995414:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735520384:0@lo:400:kworker.0 00000100:00080000:3.0:1788528501.995448:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788528501.995452:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8a8fc34cd800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788528501.995455:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788528501.995459:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8a8fc34cd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788528501.995462:0:3639:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 182 00000100:00080000:3.0:1788528501.995467:0:3639:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a8fc34cd800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528501.995480:0:3639:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90f58c1f80 x1875407735521792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788528501.995491:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1875407735520896:0@lo:400:kworker.0 00000100:00100000:2.0:1788528501.996316:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875407735521664:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788528501.996383:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528501.996438:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1875407735521792:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788528501.996460:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528501.997499:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735521664 00000100:00100000:3.0:1788528501.997510:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735521664 00000100:00100000:3.0:1788528501.997585:0:13480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735521792 00000100:00100000:3.0:1788528501.997589:0:13480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735521792 00000100:00100000:3.0:1788528501.997611:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788528501.997618:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3636:x1875407735521664:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1788528501.997639:0:13480:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788528501.997699:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3636:x1875407735521664:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 79us (1315us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788528501.997731:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788528501.997751:0:13480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788528501.997756:0:13480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3636:x1875407735521792:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1788528501.997763:0:13480:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788528501.997790:0:13480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3636:x1875407735521792:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 33us (1330us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788528501.997795:0:13480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:2.0:1788528501.998885:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90f6c00800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788528501.998894:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788528501.998898:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875407735521664:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1788528501.998910:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc34cd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788528501.998914:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788528501.998916:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1875407735521792:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1788528502.910885:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528502.978280:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788528502.978301:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735521920:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788528502.978370:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528502.979057:0:9546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735521920 00000100:00100000:1.0:1788528502.979067:0:9546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735521920 00000100:00100000:1.0:1788528502.979115:0:9546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788528502.979125:0:9546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735521920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788528502.979153:0:9546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528502.979212:0:9546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735521920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528502.979220:0:9546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788528502.979477:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735521920:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1788528502.980675:0:7440:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788528502.980687:0:7440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1788528502.980692:0:7440:0:(genops.c:885:class_export_put()) final put ffff8a90f58db800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788528502.980710:0:7440:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689 00000001:00080000:0.0:1788528502.980716:0:7440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1788528502.980718:0:7440:0:(genops.c:885:class_export_put()) final put ffff8a8fc3d2b800/287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689 00000001:00100000:0.0:1788528502.980724:0:7440:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 80304108-f3b9-46ea-888c-b2a7ec20e3e2 00000001:00080000:0.0:1788528502.980729:0:7440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1788528502.980730:0:7440:0:(genops.c:885:class_export_put()) final put ffff8a90fe6ba000/80304108-f3b9-46ea-888c-b2a7ec20e3e2 00000020:00000080:2.0:1788528502.982104:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90f58db800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788528502.982158:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3d2b800/287bdb36-f1d0-4e2e-a4bb-8c8d0d2db689 for lustre-MDT0001 00000020:00000080:2.0:1788528502.982181:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90fe6ba000/80304108-f3b9-46ea-888c-b2a7ec20e3e2 for lustre-MDT0001 00000020:00000080:2.0:1788528502.982211:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90f58da800 for lustre-MDT0001 00000020:00000080:2.0:1788528502.982224:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc3d2e800 for lustre-MDT0001 00000020:00000080:2.0:1788528502.982228:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90fe6b9000 for lustre-MDT0001 00000001:00100000:1.0:1788528502.982667:0:8416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788528502.982671:0:8416:0:(genops.c:885:class_export_put()) final put ffff8a8fc3024000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788528502.982684:0:8416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 80304108-f3b9-46ea-888c-b2a7ec20e3e2 00000020:00000080:1.0:1788528502.982686:0:8416:0:(genops.c:885:class_export_put()) final put ffff8a8fc3fdc800/80304108-f3b9-46ea-888c-b2a7ec20e3e2 00000020:00000080:0.0:1788528502.982760:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3024000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788528502.982796:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3fdc800/80304108-f3b9-46ea-888c-b2a7ec20e3e2 for lustre-OST0000 00000020:00000080:0.0:1788528502.982821:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc3027000 for lustre-OST0000 00000020:00000080:0.0:1788528502.982825:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc3fda000 for lustre-OST0000 00000001:00100000:1.0:1788528502.982915:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788528502.982919:0:9506:0:(genops.c:885:class_export_put()) final put ffff8a8fc3020800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788528502.982934:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 80304108-f3b9-46ea-888c-b2a7ec20e3e2 00000020:00000080:1.0:1788528502.982936:0:9506:0:(genops.c:885:class_export_put()) final put ffff8a90d0051000/80304108-f3b9-46ea-888c-b2a7ec20e3e2 00000020:00000080:2.0:1788528502.982978:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3020800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788528502.982998:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90d0051000/80304108-f3b9-46ea-888c-b2a7ec20e3e2 for lustre-OST0001 00000020:00000080:2.0:1788528502.983015:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc3021000 for lustre-OST0001 00000020:00000080:2.0:1788528502.983018:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90d0054000 for lustre-OST0001 00000040:00080000:0.0:1788528503.423412:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788528503.934870:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528504.959250:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528505.982981:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788528506.562112:0:6487:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788528506.562121:0:6487:0:(genops.c:885:class_export_put()) final put ffff8a9101943800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788528506.562362:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9101943800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788528506.562523:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a9101940800 for lustre-MDT0000 00010000:00010000:0.0:1788528507.007169:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788528507.070888:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788528507.070895:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788528507.070898:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a90fa5f9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788528507.070907:0:469:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 371 00000100:00100000:3.0:1788528507.070912:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735522176:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788528507.070916:0:469:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788528507.070926:0:469:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a90fa5f9800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1788528507.070951:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc4472a00 x1875407735522304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788528507.070968:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788528507.070972:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788528507.070973:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a90f6c00800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788528507.070977:0:469:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 371 00000100:00080000:2.0:1788528507.070979:0:469:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788528507.070982:0:469:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a90f6c00800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528507.070988:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528507.070995:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc4470380 x1875407735522432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788528507.071005:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788528507.071024:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788528507.071026:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a8fc2400800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788528507.071030:0:469:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 371 00000100:00080000:2.0:1788528507.071033:0:469:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788528507.071037:0:469:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a8fc2400800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1788528507.071053:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc4470000 x1875407735522560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788528507.071058:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735522176 00000100:00100000:3.0:1788528507.071066:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735522176 00000100:00080000:2.0:1788528507.071092:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788528507.071096:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788528507.071098:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a8fc34cd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788528507.071102:0:469:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 371 00000100:00080000:2.0:1788528507.071105:0:469:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788528507.071109:0:469:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a8fc34cd800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528507.071119:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788528507.071123:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90f6da1180 x1875407735522944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788528507.071132:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735522176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788528507.071162:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788528507.071201:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735522176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528507.071209:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788528507.071214:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735522816:0@lo:400:kworker.0 00000100:00080000:3.0:1788528507.071235:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788528507.071252:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528507.071258:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735522304:0@lo:38:kworker.0 00000100:00100000:2.0:1788528507.071279:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788528507.071287:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735522048:0@lo:400:kworker.0 00000100:00100000:3.0:1788528507.071310:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528507.071319:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528507.071341:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4470380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875407735522432:0@lo:38:kworker.0 00000100:00100000:2.0:1788528507.071350:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735523072:0@lo:400:kworker.0 00000100:00100000:3.0:1788528507.071375:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528507.071388:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735522816 00000100:00100000:2.0:1788528507.071393:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735522816 00000100:00100000:3.0:1788528507.071402:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1875407735522560:0@lo:38:kworker.0 00000100:00100000:3.0:1788528507.071433:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528507.071436:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788528507.071446:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735522816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528507.071465:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1875407735522944:0@lo:38:kworker.0 00000100:00100000:2.0:1788528507.071496:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735522816:12345-0@lo:400:kworker.0 Request processed in 51us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528507.071503:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528507.071510:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788528507.071542:0:9268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735522304 00000100:00100000:3.0:1788528507.071547:0:9268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735522304 00000100:00100000:2.0:1788528507.071551:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735522432 00000100:00100000:2.0:1788528507.071576:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735522432 00000100:00100000:3.0:1788528507.071595:0:9268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788528507.071601:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735522560 00000100:00100000:3.0:1788528507.071602:0:9268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3636:x1875407735522304:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788528507.071606:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735522560 00010000:02000000:3.0:1788528507.071618:0:9268:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788528507.071620:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735522944 00000100:00100000:2.0:1788528507.071624:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735522944 00000100:00100000:2.0:1788528507.071637:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788528507.071643:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1875407735522432:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788528507.071652:0:6510:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788528507.071696:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1875407735522432:12345-0@lo:38:kworker.0 Request processed in 52us (322us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788528507.071703:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788528507.071717:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788528507.071721:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1875407735522560:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788528507.071728:0:6510:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788528507.071749:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1875407735522560:12345-0@lo:38:kworker.0 Request processed in 27us (318us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788528507.071755:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788528507.071774:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788528507.071778:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1875407735522944:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788528507.071785:0:6510:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788528507.071805:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1875407735522944:12345-0@lo:38:kworker.0 Request processed in 25us (306us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788528507.071811:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:2.0:1788528507.071830:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788528507.071866:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735522176:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788528507.071882:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788528507.071887:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735522688:0@lo:400:kworker.0 00000100:00100000:2.0:1788528507.071912:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528507.071939:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528507.071958:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735522816:0@lo:400:kworker.0 00000100:00100000:2.0:1788528507.071977:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735522688 00000100:00100000:2.0:1788528507.071980:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735522688 00000100:00100000:2.0:1788528507.072003:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735523072 00000100:00100000:2.0:1788528507.072006:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735523072 00000100:00100000:2.0:1788528507.072018:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788528507.072023:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735522688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528507.072055:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735522688:12345-0@lo:400:kworker.0 Request processed in 32us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528507.072061:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788528507.072075:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788528507.072080:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735523072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528507.072109:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735523072:12345-0@lo:400:kworker.0 Request processed in 29us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528507.072114:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00080000:2.0:1788528507.072128:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788528507.072144:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6da3100 x1875407735523072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528507.072154:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735523072:0@lo:400:kworker.0 00010000:00080000:2.0:1788528507.072174:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f6da1f80 x1875407735522688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528507.072195:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735522688:0@lo:400:kworker.0 00000100:00080000:2.0:1788528507.072223:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90f6c00800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788528507.072228:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788528507.072231:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4470380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875407735522432:0@lo:38:kworker.0 00000100:00080000:2.0:1788528507.072239:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc2400800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788528507.072242:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788528507.072245:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1875407735522560:0@lo:38:kworker.0 00000100:00080000:2.0:1788528507.072253:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc34cd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788528507.072256:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788528507.072259:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1875407735522944:0@lo:38:kworker.0 00000100:00100000:0.0:1788528507.072566:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735522048 00000100:00100000:0.0:1788528507.072577:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735522048 00000100:00100000:0.0:1788528507.072616:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1788528507.072623:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d1fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+21:3639:x1875407735522048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528507.072662:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d1fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd052447-840d-4bcc-891b-140c465c7625+21:3639:x1875407735522048:12345-0@lo:400:kworker.0 Request processed in 41us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528507.072678:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1788528507.072716:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735522048:0@lo:400:kworker.0 00000100:00100000:3.0:1788528507.084594:0:9268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3636:x1875407735522304:12345-0@lo:38:kworker.0 Request processed in 12982us (13290us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788528507.084609:0:9268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:2.0:1788528507.085292:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90fa5f9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788528507.085300:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788528507.085304:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735522304:0@lo:38:kworker.0 00000020:01000000:0.0:1788528507.200820:0:15144:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a90c2ba1780 - data ffff8a90f0ec20d8/ffff8a90f6da7400 00000020:01000000:0.0:1788528507.200991:0:15144:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a90f8f38180 - data ffff8a90f0d571b0/ffff8a90f5ac4400 00000001:00000004:0.0:1788528507.211886:0:15144:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:1.0:1788528507.274518:0:15144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788528507.274526:0:15144:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1788528507.274543:0:15144:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8a90ffa68380 x1875407735519488/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788528511 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528507.274587:0:15144:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788528507.277774:0:15144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788528507.277781:0:15144:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:1.0:1788528507.278156:0:15144:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788528507.278159:0:15144:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788528507.281655:0:8723:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788528507.281675:0:8723:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1788528507.281689:0:8723:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788528507.282504:0:15144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788528507.282510:0:15144:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:1.0:1788528507.282526:0:15144:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788528507.282529:0:15144:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788528507.282943:0:9979:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788528507.282948:0:9979:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1788528507.282957:0:9979:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788528507.292458:0:15144:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c74f8 00000020:00000080:2.0:1788528507.292471:0:15144:0:(genops.c:885:class_export_put()) final put ffff8a90de60d800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788528507.293291:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90de60d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788528507.295539:0:15144:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c750d 00000020:00000080:2.0:1788528507.295570:0:15144:0:(genops.c:885:class_export_put()) final put ffff8a90c49fa800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788528507.295586:0:15144:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788528507.295592:0:15144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788528507.295594:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90c49fa800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788528507.295609:0:15144:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788528507.295614:0:15144:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8a90f8e2cc80) has no exports 00000004:01000000:2.0:1788528507.296300:0:15144:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788528507.296312:0:15144:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c796d 00000020:00000080:2.0:1788528507.296320:0:15144:0:(genops.c:885:class_export_put()) final put ffff8a8fc3d1f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788528507.296340:0:15144:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788528507.296345:0:15144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788528507.296356:0:15144:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788528507.296359:0:15144:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff8a8fc35e3300) has no exports 00000020:00000080:2.0:1788528507.296367:0:15144:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c7966 00000020:00000080:2.0:1788528507.296371:0:15144:0:(genops.c:885:class_export_put()) final put ffff8a8fc3c55000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788528507.296591:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3d1f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788528507.296602:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3c55000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788528507.296886:0:15144:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788528507.296890:0:15144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788528507.296895:0:15144:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:2.0:1788528507.296901:0:15144:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788528507.296904:0:15144:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788528507.296951:0:15144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788528507.296965:0:15144:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788528507.296971:0:15144:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c780f 00000020:00000080:2.0:1788528507.296977:0:15144:0:(genops.c:885:class_export_put()) final put ffff8a8fc1fe1800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788528507.296980:0:15144:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788528507.296984:0:15144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788528507.296990:0:15144:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00000080:3.0:1788528507.296991:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc3c51800 for lustre-OST0001-osc-MDT0000 00000020:00080000:2.0:1788528507.296993:0:15144:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8a910195cc80) has no exports 00000020:00000080:2.0:1788528507.296999:0:15144:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c7808 00000020:00000080:3.0:1788528507.297002:0:36:0:(genops.c:885:class_export_put()) final put ffff8a8fc3c54800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788528507.297003:0:15144:0:(genops.c:885:class_export_put()) final put ffff8a8fc1f95000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788528507.297006:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3c54800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788528507.297013:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788528507.297213:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc1fe1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788528507.297221:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc1f95000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788528507.297393:0:15144:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788528507.297396:0:15144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788528507.297399:0:15144:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:2.0:1788528507.297403:0:15144:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788528507.297404:0:15144:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788528507.297441:0:15144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788528507.297455:0:15144:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1788528507.297465:0:15144:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788528507.297470:0:15144:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c76b1 00000020:00000080:2.0:1788528507.297475:0:15144:0:(genops.c:885:class_export_put()) final put ffff8a90f58db000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788528507.297479:0:15144:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1788528507.297482:0:15144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788528507.297486:0:15144:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788528507.297488:0:15144:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8a90ce969980) has no exports 00000020:00000080:2.0:1788528507.297492:0:15144:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c76aa 00000020:00000080:2.0:1788528507.297495:0:15144:0:(genops.c:885:class_export_put()) final put ffff8a90d635b800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788528507.297512:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc1f91000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788528507.297520:0:36:0:(genops.c:885:class_export_put()) final put ffff8a8fc1fe6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788528507.297522:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc1fe6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788528507.297530:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788528507.297643:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90f58db000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788528507.297651:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90d635b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788528507.302017:0:15144:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1788528507.302025:0:15144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788528507.302029:0:15144:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1788528507.302038:0:15144:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788528507.302094:0:15144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788528507.302108:0:15144:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788528507.302135:0:15144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788528507.302139:0:15144:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788528507.302144:0:15144:0:(genops.c:885:class_export_put()) final put ffff8a90d63e2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788528507.302148:0:15144:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90d63e2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788528507.302156:0:15144:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788528507.302291:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90d635c800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788528507.302299:0:36:0:(genops.c:885:class_export_put()) final put ffff8a90f58dd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788528507.302302:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90f58dd800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788528507.302312:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788528507.302478:0:15144:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c7514 00000020:00000080:3.0:1788528507.302485:0:15144:0:(genops.c:885:class_export_put()) final put ffff8a90c49fc000/lustre-MDD0000_UUID 00000020:01000000:3.0:1788528507.302501:0:15144:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788528507.302506:0:15144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788528507.302511:0:15144:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788528507.302515:0:15144:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8a90f8e2b300) has no exports 00000020:00000080:3.0:1788528507.302547:0:15144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788528507.302572:0:15144:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788528507.302578:0:15144:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c751b 00000020:00000080:3.0:1788528507.302582:0:15144:0:(genops.c:885:class_export_put()) final put ffff8a90c49ff000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788528507.302590:0:15144:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8a90c7f88000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788528507.302593:0:15144:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a90c7f88000 3 00000020:01000004:3.0:1788528507.302596:0:15144:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff8a90c7f88000 from lustre-MDT0000 00000020:00000080:3.0:1788528507.302619:0:15144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788528507.302624:0:15144:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788528507.302627:0:15144:0:(genops.c:885:class_export_put()) final put ffff8a90de60d000/lustre-MDT0000_UUID 00000020:00000080:3.0:1788528507.302628:0:15144:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90de60d000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788528507.302636:0:15144:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788528507.302679:0:15144:0:(obd_mount.c:580:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1788528507.302682:0:15144:0:(tgt_mount.c:284:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788528507.302694:0:15144:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788528507.302696:0:15144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788528507.302699:0:15144:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788528507.302706:0:15144:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8a90efac6000 dd052447-840d-4bcc-891b-140c465c7625 0@lo 20 (0 0 15) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788528507.302712:0:15144:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8a90ce96b300) has exports, disconnecting them 00000020:00080000:3.0:1788528507.302715:0:15144:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8a90efac6000), last request at 1788528258 00000020:00000080:3.0:1788528507.302729:0:15144:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c74b9 00000020:00010000:3.0:1788528507.302733:0:15144:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a90efac6000: total 2 00000100:00080000:3.0:1788528507.302737:0:15144:0:(import.c:65:import_set_state_nolock()) ffff8a90efac2000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788528507.302750:0:15144:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a90efac6000): rc 0 00000020:00080000:3.0:1788528507.302754:0:15144:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8a90ce96b300) has no exports 00000020:00010000:3.0:1788528507.302765:0:8439:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a90efac6000: total 2 00010000:00010000:3.0:1788528507.302788:0:8439:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a90efac6000, canceled 0 locks, left on hash table 15. 00010000:00010000:3.0:1788528507.302829:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc26e2400/0x892c60dda91c79e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c79dd expref: 16 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528507.302846:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90f6f3b800/0x892c60dda91c7cd1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c7cca expref: 15 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528507.302856:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c14aa000/0x892c60dda91c78f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c78ef expref: 14 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528507.302869:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c14aba00/0x892c60dda91c7a46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c7a3f expref: 13 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528507.302878:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90f6e16c00/0x892c60dda91c7cc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c7cbc expref: 12 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528507.302887:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c14ab400/0x892c60dda91c7a54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c7a4d expref: 11 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528507.302908:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc26e2e00/0x892c60dda91c79f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c79eb expref: 10 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528507.302918:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc26e3000/0x892c60dda91c7a00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c79f9 expref: 9 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528507.302927:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c13fd400/0x892c60dda91c75b5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c75ae expref: 8 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528507.302938:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc26e2c00/0x892c60dda91c7a0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c7a07 expref: 7 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528507.302947:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c13fc600/0x892c60dda91c75c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c75bc expref: 6 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528507.302959:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90f6e17400/0x892c60dda91c7a1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c7a15 expref: 5 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528507.302968:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc26e3c00/0x892c60dda91c7a38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c7a31 expref: 4 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528507.302977:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc3429a00/0x892c60dda91c7cb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c7cae expref: 3 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528507.302988:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c14aae00/0x892c60dda91c7a2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c7a23 expref: 2 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528507.302998:0:8439:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a90efac6000, canceled 15 locks, left on hash table 0. 00000020:00000080:3.0:1788528507.303011:0:8439:0:(genops.c:885:class_export_put()) final put ffff8a90efac6000/dd052447-840d-4bcc-891b-140c465c7625 00010000:00010000:3.0:1788528507.303016:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528507.303023:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528507.303024:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788528507.303264:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90c49fc000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788528507.303269:0:36:0:(genops.c:885:class_export_put()) final put ffff8a90c49fd800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788528507.303271:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90c49fd800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788528507.303275:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788528507.303316:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90c49ff000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788528507.303320:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90efac6000/dd052447-840d-4bcc-891b-140c465c7625 for MGS 00000020:00000080:1.0:1788528507.303352:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90efac2000 for MGS 00000100:00100000:1.0:1788528507.303647:0:6501:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8a90f8e67c00:6501] 1 exiting: rc = 0 00000100:00100000:3.0:1788528507.304131:0:6500:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8a90d16c3600:6500] 0 exiting: rc = 1 00000100:00100000:3.0:1788528507.306649:0:6502:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8a90f8d71200:6502] 2 exiting: rc = 0 00000100:00100000:1.0:1788528507.306829:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.306838:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.306844:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.306861:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.306866:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.306873:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.306878:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.306885:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.306891:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.306896:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.306902:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.306908:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.306913:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.306919:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.306925:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.306930:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.306935:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.306942:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.306946:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.306952:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.306958:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.306965:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.306973:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.306981:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.306989:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.306997:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307005:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307014:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307020:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307031:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307037:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307044:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307056:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307073:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307081:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307089:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307096:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307101:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307117:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307123:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307128:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307133:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307138:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307144:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307150:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307155:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307160:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307166:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307171:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307176:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307181:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307186:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307192:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307196:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307202:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307207:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307212:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307217:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307223:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307228:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307233:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307238:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307244:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528507.307258:0:15144:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1788528507.308515:0:15144:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a90c2ba11e0 - data ffff8a8fc2041510/ffff8a90f6da6000 00000020:01000000:1.0:1788528507.308657:0:15144:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a90d16853c0 - data ffff8a90f0c78870/ffff8a90f8decc00 00000020:00000080:1.0:1788528507.309745:0:15144:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c749d 00000020:00000080:1.0:1788528507.309756:0:15144:0:(genops.c:885:class_export_put()) final put ffff8a90d00cb800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788528507.309779:0:15144:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8a90c7f88000 from MGS, refs=2 00000020:01000004:1.0:1788528507.309783:0:15144:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a90c7f88000 2 00000020:01000004:1.0:1788528507.309798:0:15144:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff8a90c7f88000 from MGS 00000020:00000080:1.0:1788528507.309828:0:15144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788528507.309846:0:15144:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788528507.309849:0:15144:0:(genops.c:885:class_export_put()) final put ffff8a90d00ca800/MGS 00000020:00000080:1.0:1788528507.309852:0:15144:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90d00ca800/MGS for MGS 00000020:01000000:1.0:1788528507.309862:0:15144:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788528507.309948:0:15144:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788528507.309953:0:15144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788528507.309959:0:15144:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788528507.309966:0:15144:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8a90c498d000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788528507.309972:0:15144:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8a90c78e9980) has exports, disconnecting them 00000020:00080000:1.0:1788528507.309978:0:15144:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8a90c498d000), last request at 1788528258 00000020:00000080:1.0:1788528507.309982:0:15144:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c7568 00000020:00080000:1.0:1788528507.309994:0:15144:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a90c498d000): rc 0 00000020:00000080:1.0:1788528507.310000:0:15144:0:(genops.c:885:class_export_put()) final put ffff8a90c498d000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788528507.313094:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90d00cb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788528507.313125:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90c498d000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788528507.322604:0:15144:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788528507.322614:0:15144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788528507.322618:0:15144:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788528507.322625:0:15144:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788528507.322655:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90f58ad800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788528507.322845:0:15144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788528507.322855:0:15144:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788528507.322860:0:15144:0:(genops.c:885:class_export_put()) final put ffff8a90c498b800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788528507.322864:0:15144:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90c498b800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788528507.322877:0:15144:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788528507.322958:0:15144:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a90c7f88000 1 00000020:00000080:3.0:1788528507.322965:0:15144:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c748f 00000020:00000080:3.0:1788528507.322971:0:15144:0:(genops.c:885:class_export_put()) final put ffff8a90d00cb000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788528507.322981:0:15144:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788528507.322988:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90d00cb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788528507.322997:0:15144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788528507.323001:0:15144:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788528507.323005:0:15144:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8a90c78eb300) has no exports 00000020:00000080:2.0:1788528507.387107:0:15144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788528507.387119:0:15144:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788528507.387124:0:15144:0:(genops.c:885:class_export_put()) final put ffff8a90c7f8d800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788528507.387128:0:15144:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90c7f8d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788528507.387140:0:15144:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788528507.387381:0:15144:0:(obd_mount.c:670:lustre_free_lsi()) Freeing lsi ffff8a90c7f8a000 00000020:02000400:2.0:1788528507.387440:0:15144:0:(tgt_mount.c:2258:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788528508.031815:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528508.097696:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735523200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788528508.097793:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528508.097843:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735523200 00000100:00100000:2.0:1788528508.097853:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735523200 00000100:00100000:2.0:1788528508.097923:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788528508.097935:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735523200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788528508.097974:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528508.098037:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735523200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528508.098045:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788528508.098807:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735523200:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788528509.059971:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788528509.317074:0:6506:0:(tgt_mount.c:234:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788528509.317099:0:6506:0:(tgt_mount.c:115:server_register_mount()) register mount ffff8a8fc1fe4800 from MGS 00000020:01000004:0.0:1788528509.317106:0:6506:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788528509.317128:0:6506:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8a910195cc80) 00000020:00000080:0.0:1788528509.317155:0:6506:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type mgs with refcount 2 00000020:01000004:0.0:1788528509.317253:0:6506:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a8fc1fe4800 from MGS, refs=3 00080000:01000000:0.0:1788528509.317265:0:6506:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788528509.317273:0:6506:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x892c60dda91c8ac3 00010000:00010000:0.0:1788528509.317460:0:6506:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:0.0:1788528509.317986:0:6506:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788528509.318204:0:6506:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788528509.318523:0:6506:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788528509.318722:0:6506:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788528509.318729:0:6506:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788528509.330383:0:6506:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788528509.330405:0:6506:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788528509.353335:0:6506:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788528509.353356:0:6506:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788528509.357073:0:6506:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00010000:00010000:1.0:1788528510.080164:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528511.102807:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788528511.508483:0:15350:0:(tgt_mount.c:2269:server_umount_begin()) umount -f 00000020:01000004:2.0:1788528511.520731:0:15350:0:(tgt_mount.c:2125:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788528511.520786:0:15350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c14abc00/0x892c60dda91c7a31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a38 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528511.520818:0:15350:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c14abc00/0x892c60dda91c7a31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7a38 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528511.520825:0:15350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c14abc00/0x892c60dda91c7a31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c7a38 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528511.520831:0:15350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a90c14abc00/0x892c60dda91c7a31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c7a38 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528511.520971:0:15350:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788528511.520993:0:15350:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.203.138@tcp: clear lustre-client 10000000:01000000:2.0:1788528511.520997:0:15350:0:(mgc_request.c:650:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788528511.521021:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788528511.521025:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788528511.521031:0:15350:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788528511.521036:0:15350:0:(import.c:65:import_set_state_nolock()) ffff8a90f6c00800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788528511.521041:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788528511.521042:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788528511.521046:0:15350:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788528511.522163:0:15350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c7a3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a46 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528511.522177:0:15350:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c7a3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7a46 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528511.522186:0:15350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c7a3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c7a46 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528511.522206:0:15350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c7a3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c7a46 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528511.525503:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788528511.525516:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c14abc00/0x892c60dda91c7a31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c7a38 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528511.525527:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c14abc00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:0.0:1788528511.525547:0:8439:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c14abc00/0x892c60dda91c7a31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c7a38 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528511.525572:0:8439:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c14abc00/0x892c60dda91c7a31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c7a38 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528511.525579:0:8439:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c14abc00/0x892c60dda91c7a31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c7a38 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528511.525585:0:8439:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788528511.525588:0:8439:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:0.0:1788528511.525592:0:8439:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788528511.525674:0:8439:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c14abc00/0x892c60dda91c7a31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c7a38 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528511.525680:0:8439:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788528511.525706:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c14abc00/0x892c60dda91c7a31 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c7a38 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528511.525714:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c14abc00/0x892c60dda91c7a31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c7a38 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528511.525727:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528511.525730:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c7a3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c7a46 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528511.525736:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101851200 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:0.0:1788528511.525739:0:8439:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c7a3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c7a46 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528511.525745:0:8439:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c7a3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c7a46 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528511.525756:0:8439:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c7a3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c7a46 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528511.525758:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735523328:0@lo:103:ldlm_bl.0 10000000:01000000:0.0:1788528511.525762:0:8439:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788528511.525764:0:8439:0:(mgc_request.c:1187:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1788528511.525776:0:8439:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c7a3f lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c7a46 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528511.525781:0:8439:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788528511.525794:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c7a3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c7a46 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528511.525801:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528511.525802:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528511.525804:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528511.525819:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735523456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788528511.525874:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528511.525944:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735523456 00000100:00100000:0.0:1788528511.525951:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735523456 00000100:00100000:0.0:1788528511.525985:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788528511.525993:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4676a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3639:x1875407735523456:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788528511.525999:0:6493:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788528511 with bad export cookie 9884381787312649401 00000100:00100000:3.0:1788528511.526049:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528511.526101:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735523328 00010000:00010000:2.0:1788528511.526101:0:15350:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00000100:00100000:3.0:1788528511.526105:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735523328 00010000:00010000:2.0:1788528511.526108:0:15350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a9101851200/0x892c60dda91c7a3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c7a46 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528511.526134:0:15350:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.203.138@tcp: clear lustre-MDT0001 00000100:00100000:3.0:1788528511.526136:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788528511.526140:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3638:x1875407735523328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788528511.526141:0:15350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16000/0x892c60dda91c78ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c78f6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00020000:3.0:1788528511.526144:0:10330:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788528511 with bad export cookie 9884381787312649401 00010000:00010000:2.0:1788528511.526149:0:15350:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16000/0x892c60dda91c78ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c78f6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528511.526155:0:15350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16000/0x892c60dda91c78ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c78f6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528511.526162:0:15350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16000/0x892c60dda91c78ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c78f6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528511.526174:0:15350:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788528511.526180:0:15350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c7cca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7cd1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528511.526182:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3638:x1875407735523328:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (134us total) trans 0 rc -107/-107 00010000:00010000:2.0:1788528511.526187:0:15350:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c7cca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7cd1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528511.526189:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1788528511.526193:0:15350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c7cca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c7cd1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528511.526206:0:15350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c7cca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c7cd1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528511.526217:0:15350:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00080000:3.0:1788528511.526219:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.138@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788528511.526223:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8a90efac4800 MGS: changing import state from FULL to DISCONN 10000000:01000000:2.0:1788528511.526225:0:15350:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.203.138@tcp: clear params 00000100:02020000:3.0:1788528511.526227:0:3638:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.138@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1788528511.526231:0:15350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0030c00/0x892c60dda91c75bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c75c3 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528511.526237:0:15350:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0030c00/0x892c60dda91c75bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c75c3 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528511.526354:0:15350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0030c00/0x892c60dda91c75bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c75c3 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528511.526361:0:15350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a90c0030c00/0x892c60dda91c75bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c75c3 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528511.526378:0:15350:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788528511.526389:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788528511.526394:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16000/0x892c60dda91c78ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c78f6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528511.526400:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16000 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:2.0:1788528511.526402:0:6497:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16000/0x892c60dda91c78ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c78f6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528511.526409:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16000/0x892c60dda91c78ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c78f6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788528511.526425:0:6497:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16000/0x892c60dda91c78ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c78f6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528511.526430:0:6497:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788528511.526432:0:6497:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-mdtir: stale lock, won't requeue 10000000:01000000:2.0:1788528511.526434:0:6497:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788528511.526515:0:6496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788528511.526520:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c7cca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c7cd1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528511.526526:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3429c00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528511.526529:0:6496:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c7cca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c7cd1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528511.526534:0:6496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c7cca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c7cd1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528511.526540:0:6496:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c7cca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c7cd1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528511.526544:0:6496:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788528511.526546:0:6496:0:(mgc_request.c:1180:mgc_blocking_ast()) log params: stale lock, won't requeue 10000000:01000000:1.0:1788528511.526571:0:6496:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:0.0:1788528511.540224:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4676a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3639:x1875407735523456:12345-0@lo:103:ldlm_bl.0 Request processed in 14225us (14345us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788528511.540237:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788528511.540303:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.138@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788528511.557934:0:3638:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.138@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788528511.557940:0:3638:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788528511.557952:0:3638:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a8fc4674380 x1875407735523328/t0(0) o103->MGC192.168.203.138@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788528527 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528511.557967:0:3638:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a8fc4674a80 x1875407735523456/t0(0) o103->MGC192.168.203.138@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788528527 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788528511.557985:0:3638:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788528511.557988:0:3638:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788528511.557990:0:3638:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788528511.557994:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8a90efac4800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788528511.558000:0:3638:0:(import.c:545:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 127 00000100:00080000:3.0:1788528511.558010:0:3638:0:(import.c:665:import_select_connection()) MGC192.168.203.138@tcp: import ffff8a90efac4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528511.558055:0:3638:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90f58c1f80 x1875407735523584/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788528511.558102:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd052447-840d-4bcc-891b-140c465c7625:3636:1875407735523584:0@lo:250:ptlrpcd_00_01.0 00000100:00100000:3.0:1788528511.558171:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788528511.558198:0:3639:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8a90efac4800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:3.0:1788528511.558231:0:15232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735523584 00000100:00100000:3.0:1788528511.558238:0:15232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735523584 00010000:00010000:0.0:1788528511.558241:0:8438:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528511.558262:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c0030c00/0x892c60dda91c75bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c75c3 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528511.558271:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030c00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:0.0:1788528511.558275:0:8438:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0030c00/0x892c60dda91c75bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c75c3 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528511.558284:0:8438:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c0030c00/0x892c60dda91c75bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c75c3 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528511.558292:0:8438:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0030c00/0x892c60dda91c75bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c75c3 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528511.558298:0:8438:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788528511.558301:0:8438:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-barrier: stale lock, won't requeue 10000000:01000000:0.0:1788528511.558304:0:8438:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788528511.558336:0:8438:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a90efac4800 00010000:00010000:0.0:1788528511.558339:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c0030c00/0x892c60dda91c75bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c75c3 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528511.558342:0:15232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788528511.558346:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c0030c00/0x892c60dda91c75bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c75c3 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528511.558349:0:15232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc35a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3636:x1875407735523584:12345-0@lo:250:ptlrpcd_00_01.0 00010000:00010000:0.0:1788528511.558363:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528511.558364:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000400:3.0:1788528511.558365:0:15232:0:(ldlm_lib.c:1248:target_handle_connect()) MGS: refusing connection from 0@lo: this is an MGS follower, which only serves clients that support it: rc = -19 00010000:00010000:0.0:1788528511.558366:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528511.558707:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd052447-840d-4bcc-891b-140c465c7625:3639:1875407735523456:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788528511.558945:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16000/0x892c60dda91c78ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c78f6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528511.558953:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788528511.558978:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16000/0x892c60dda91c78ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c78f6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528511.558985:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16000/0x892c60dda91c78ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c78f6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528511.559001:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528511.559003:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528511.559005:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528511.559030:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd052447-840d-4bcc-891b-140c465c7625:3638:1875407735523328:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788528511.559059:0:15350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16a00/0x892c60dda91c7a4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a54 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528511.559069:0:15350:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16a00/0x892c60dda91c7a4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7a54 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528511.559076:0:15350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16a00/0x892c60dda91c7a4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c7a54 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528511.559107:0:15350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16a00/0x892c60dda91c7a4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c7a54 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528511.559120:0:15350:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788528511.559153:0:15350:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.203.138@tcp: clear lustre-sptlrpc 10000000:01000000:2.0:1788528511.559157:0:15350:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1788528511.559173:0:15350:0:(mgc_request.c:650:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1788528511.559195:0:15350:0:(tgt_mount.c:2175:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1788528511.559199:0:15350:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1788528511.559203:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788528511.559209:0:15350:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788528511.559214:0:15350:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8a8fc34cb000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788528511.559219:0:15350:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8a8fc1f92000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788528511.559224:0:15350:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8a90c78e8000) has exports, disconnecting them 00000020:00080000:2.0:1788528511.559228:0:15350:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8a8fc34cb000), last request at 1788528507 00000020:00000080:2.0:1788528511.559235:0:15350:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c78a9 00000100:00080000:2.0:1788528511.559246:0:15350:0:(import.c:65:import_set_state_nolock()) ffff8a8fc34cc800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788528511.559289:0:15350:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a8fc34cb000): rc 0 00000020:00000080:2.0:1788528511.559291:0:15350:0:(genops.c:885:class_export_put()) final put ffff8a8fc34cb000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1788528511.559306:0:15350:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8a8fc1f92000), last request at 1788528507 00000020:00000080:2.0:1788528511.559310:0:15350:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c7775 00000100:00080000:2.0:1788528511.559315:0:15350:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1f90800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788528511.559326:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788528511.559331:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16a00/0x892c60dda91c7a4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c7a54 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528511.559337:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16a00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:2.0:1788528511.559347:0:6497:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16a00/0x892c60dda91c7a4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c7a54 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528511.559355:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16a00/0x892c60dda91c7a4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c7a54 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788528511.559361:0:6497:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16a00/0x892c60dda91c7a4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c7a54 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528511.559367:0:6497:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788528511.559369:0:6497:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 10000000:01000000:2.0:1788528511.559371:0:6497:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788528511.559393:0:6497:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a90efac4800 00010000:00010000:2.0:1788528511.559396:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16a00/0x892c60dda91c7a4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c7a54 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528511.559403:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90f6e16a00/0x892c60dda91c7a4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c7a54 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528511.559413:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528511.559414:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528511.559416:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788528511.559426:0:15350:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a8fc1f92000): rc 0 00000020:00000080:2.0:1788528511.559428:0:15350:0:(genops.c:885:class_export_put()) final put ffff8a8fc1f92000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1788528511.559436:0:15350:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffff9b7a01c9bae0 00000100:00080000:2.0:1788528511.559456:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788528511.559464:0:15350:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8a8fc44c7800 x1875407735520128/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788528517 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528511.559478:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:2.0:1788528511.560267:0:15350:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788528511.560282:0:15350:0:(import.c:65:import_set_state_nolock()) ffff8a90fa5f9800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:2.0:1788528511.560319:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735520128:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1788528511.560467:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788528511.560471:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:2.0:1788528511.560483:0:15350:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788528511.560550:0:15350:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788528511.560591:0:15350:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d0a000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788528511.560604:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788528511.560606:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1788528511.560613:0:15350:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788528511.560684:0:15350:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788528511.560693:0:15350:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3c52800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788528511.560716:0:15350:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8a90c78e8000) has no exports 00000100:00100000:2.0:1788528511.560748:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735523840:0@lo:9:umount.0 00000100:00100000:2.0:1788528511.560806:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528511.560836:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735523968:0@lo:9:umount.0 00000100:00100000:2.0:1788528511.560855:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528511.560895:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735523840 00000100:00100000:2.0:1788528511.560903:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735523840 00000100:00100000:2.0:1788528511.560947:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735523968 00000100:00100000:2.0:1788528511.560950:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735523968 00000100:00100000:2.0:1788528511.560970:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788528511.560977:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875407735523840:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788528511.560998:0:8422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c77c9 00000100:00080000:2.0:1788528511.561005:0:8422:0:(import.c:65:import_set_state_nolock()) ffff8a8fc2404800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788528511.561035:0:8422:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1788528511.561157:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3636:x1875407735523840:12345-0@lo:9:umount.0 Request processed in 179us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528511.561172:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788528511.561188:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788528511.561194:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875407735523968:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788528511.561205:0:8422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c793c 00000100:00080000:2.0:1788528511.561210:0:8422:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3c53000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788528511.561226:0:8422:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788528511.561294:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3636:x1875407735523968:12345-0@lo:9:umount.0 Request processed in 100us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528511.561300:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1788528511.561320:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788528511.561323:0:6503:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788528511.561352:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d0a000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788528511.561360:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788528511.561361:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788528511.561364:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735523840:0@lo:9:umount.0 00000100:00080000:2.0:1788528511.561374:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3c52800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788528511.561379:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788528511.561381:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788528511.561383:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735523968:0@lo:9:umount.0 00010000:00010000:2.0:1788528511.561405:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528511.566276:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd052447-840d-4bcc-891b-140c465c7625:0:1875407735523712:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788528511.566322:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528511.566346:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528511.566608:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788528511.566950:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc34cb000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1788528511.567007:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc1f92000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1788528511.567028:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc34cc800 for lustre-MDT0001 00000020:00000080:1.0:1788528511.567033:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc1f90800 for lustre-MDT0001 00000100:00100000:3.0:1788528511.569147:0:15232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc35a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3636:x1875407735523584:12345-0@lo:250:ptlrpcd_00_01.0 Request processed in 10790us (10969us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788528511.569161:0:15232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788528511.569211:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90efac4800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788528511.569217:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-19) 00000100:00100000:3.0:1788528511.569221:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd052447-840d-4bcc-891b-140c465c7625:3636:1875407735523584:0@lo:250:ptlrpcd_00_01.0 00010000:00010000:1.0:1788528511.569482:0:6496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c7cca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c7cd1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528511.569492:0:6496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528511.569521:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c7cca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c7cd1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528511.569529:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c7cca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c7cd1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528511.569542:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528511.569545:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528511.569547:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528511.569673:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd052447-840d-4bcc-891b-140c465c7625:0:1875407735524096:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788528511.580052:0:15350:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8a90c78e8000) has no exports 00000020:01000000:3.0:1788528511.625398:0:15350:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a8fc33c9660 - data ffff8a8fc200f438/ffff8a90ffa01400 00000020:01000000:3.0:1788528511.625546:0:15350:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a90f5992900 - data ffff8a90f0da0510/ffff8a90f9a40000 00000001:00000004:0.0:1788528511.640772:0:15350:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1788528511.691689:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788528511.691698:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1788528511.691706:0:15350:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788528511.696605:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788528511.696613:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:0.0:1788528511.696628:0:15350:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788528511.696630:0:15350:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788528511.697568:0:8707:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788528511.697573:0:8707:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:2.0:1788528511.697583:0:8707:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788528511.699237:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788528511.699256:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1788528511.699270:0:15350:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788528511.699273:0:15350:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788528511.701486:0:9975:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788528511.701493:0:9975:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1788528511.701509:0:9975:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788528511.703772:0:15350:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c75df 00000020:00000080:3.0:1788528511.703782:0:15350:0:(genops.c:885:class_export_put()) final put ffff8a9101945800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788528511.704604:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9101945800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788528511.705893:0:15350:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c75f4 00000020:00000080:3.0:1788528511.705903:0:15350:0:(genops.c:885:class_export_put()) final put ffff8a9101944800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788528511.705928:0:15350:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788528511.705934:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788528511.705942:0:15350:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788528511.705946:0:15350:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8a90c78ecc80) has no exports 00000020:00000080:2.0:1788528511.706118:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9101944800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:3.0:1788528511.706451:0:15350:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788528511.706461:0:15350:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c7919 00000020:00000080:3.0:1788528511.706466:0:15350:0:(genops.c:885:class_export_put()) final put ffff8a8fc34ce800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788528511.706473:0:15350:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788528511.706477:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788528511.706484:0:15350:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788528511.706487:0:15350:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8a8fc35e0000) has no exports 00000020:00000080:3.0:1788528511.706492:0:15350:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c7912 00000020:00000080:3.0:1788528511.706496:0:15350:0:(genops.c:885:class_export_put()) final put ffff8a8fc3c54000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788528511.706535:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc34ce800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788528511.706569:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3c54000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788528511.707168:0:15350:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788528511.707173:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788528511.707176:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1788528511.707182:0:15350:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788528511.707184:0:15350:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788528511.707442:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788528511.707452:0:15350:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788528511.707457:0:15350:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c77bb 00000020:00000080:3.0:1788528511.707463:0:15350:0:(genops.c:885:class_export_put()) final put ffff8a8fc1fe3800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788528511.711167:0:15350:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788528511.711183:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788528511.711196:0:15350:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788528511.712300:0:15350:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8a90fa60cc80) has no exports 00000020:00000080:3.0:1788528511.712312:0:15350:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c77b4 00000020:00000080:3.0:1788528511.712322:0:15350:0:(genops.c:885:class_export_put()) final put ffff8a8fc1d0e000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1788528511.713672:0:15350:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788528511.713678:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788528511.713683:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1788528511.713690:0:15350:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788528511.713704:0:15350:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788528511.714138:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc3c52800 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788528511.714150:0:8:0:(genops.c:885:class_export_put()) final put ffff8a8fc3025800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788528511.714154:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3025800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1788528511.714160:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788528511.714237:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc1fe3800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788528511.714243:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc1d0e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788528511.714248:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc1d0a000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788528511.715480:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788528511.715495:0:15350:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788528511.715501:0:15350:0:(genops.c:885:class_export_put()) final put ffff8a8fc1f91800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788528511.715504:0:15350:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc1f91800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788528511.715511:0:15350:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1788528511.715617:0:15350:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788528511.715628:0:15350:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c7617 00000020:00000080:3.0:1788528511.715644:0:15350:0:(genops.c:885:class_export_put()) final put ffff8a90fa5fd800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788528511.715664:0:15350:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1788528511.715668:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788528511.715677:0:15350:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788528511.715683:0:15350:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8a90fa60b300) has no exports 00000020:00000080:3.0:1788528511.715689:0:15350:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c7610 00000020:00000080:3.0:1788528511.715694:0:15350:0:(genops.c:885:class_export_put()) final put ffff8a90fa5f9000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788528511.715743:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90fa5fd800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788528511.715753:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90fa5f9000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788528511.719629:0:15350:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1788528511.719648:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788528511.719652:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1788528511.719661:0:15350:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788528511.719719:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90fa5f9800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788528511.719779:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788528511.719791:0:15350:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788528511.719795:0:15350:0:(genops.c:885:class_export_put()) final put ffff8a90fa5fe000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788528511.719799:0:15350:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90fa5fe000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1788528511.719810:0:15350:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788528511.719994:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788528511.719999:0:15350:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788528511.720002:0:15350:0:(genops.c:885:class_export_put()) final put ffff8a90c498a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788528511.720005:0:15350:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90c498a000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788528511.720009:0:15350:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788528511.720130:0:15350:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c75fb 00000020:00000080:2.0:1788528511.720137:0:15350:0:(genops.c:885:class_export_put()) final put ffff8a9101943000/lustre-MDD0001_UUID 00000020:01000000:2.0:1788528511.720151:0:15350:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1788528511.720155:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788528511.720168:0:15350:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788528511.720173:0:15350:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8a910195b300) has no exports 00000020:00000080:2.0:1788528511.720198:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788528511.720203:0:15350:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1788528511.720207:0:15350:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c7602 00000020:00000080:2.0:1788528511.720211:0:15350:0:(genops.c:885:class_export_put()) final put ffff8a9101940000/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1788528511.720219:0:15350:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8a90f5add000 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1788528511.720222:0:15350:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a90f5add000 2 00000020:01000004:2.0:1788528511.720225:0:15350:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff8a90f5add000 from lustre-MDT0001 00000020:00000080:2.0:1788528511.720248:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788528511.720252:0:15350:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1788528511.720255:0:15350:0:(genops.c:885:class_export_put()) final put ffff8a9101946800/lustre-MDT0001_UUID 00000020:00000080:2.0:1788528511.720257:0:15350:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9101946800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1788528511.720263:0:15350:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1788528511.720291:0:15350:0:(obd_mount.c:580:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1788528511.720295:0:15350:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1788528511.720298:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788528511.720301:0:15350:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788528511.720308:0:15350:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8a90f6c03800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788528511.720313:0:15350:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8a90f6c4b300) has exports, disconnecting them 00000020:00080000:2.0:1788528511.720317:0:15350:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8a90f6c03800), last request at 1788528276 00000020:00000080:2.0:1788528511.720320:0:15350:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c7656 00000020:00080000:2.0:1788528511.720333:0:15350:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a90f6c03800): rc 0 00000020:00000080:2.0:1788528511.720336:0:15350:0:(genops.c:885:class_export_put()) final put ffff8a90f6c03800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788528511.720692:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9101943000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1788528511.720724:0:8:0:(genops.c:885:class_export_put()) final put ffff8a9101947000/lustre-MDD0001_UUID 00000020:00000080:0.0:1788528511.720726:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9101947000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1788528511.720734:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1788528511.720910:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9101940000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788528511.720916:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90f6c03800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788528511.734673:0:15350:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788528511.734682:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788528511.734686:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788528511.734694:0:15350:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788528511.734866:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788528511.734874:0:15350:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788528511.734881:0:15350:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a90f5add000 1 00000020:00000080:3.0:1788528511.734887:0:15350:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c7592 00000020:00000080:3.0:1788528511.734895:0:15350:0:(genops.c:885:class_export_put()) final put ffff8a90f58de800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1788528511.734901:0:15350:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788528511.734906:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788528511.734911:0:15350:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788528511.734914:0:15350:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8a90f8e2e600) has no exports 00000020:00000080:0.0:1788528511.737262:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90f6c00800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788528511.737276:0:8:0:(genops.c:885:class_export_put()) final put ffff8a90f6c07800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1788528511.737279:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90f6c07800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1788528511.737286:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1788528511.737358:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90f58de800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788528511.818747:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788528511.818769:0:15350:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1788528511.818775:0:15350:0:(genops.c:885:class_export_put()) final put ffff8a90f5adc000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788528511.818779:0:15350:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90f5adc000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788528511.818791:0:15350:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1788528511.818918:0:15350:0:(obd_mount.c:670:lustre_free_lsi()) Freeing lsi ffff8a90f5adf000 00000020:01000000:1.0:1788528511.818938:0:15350:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788528511.818942:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788528511.818947:0:15350:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788528511.818952:0:15350:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8a90f8e29980) has no exports 00000100:00100000:1.0:1788528511.819083:0:6508:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8a90f8d70a00:6508] 0 exiting: rc = 1 00000100:00100000:2.0:1788528511.819622:0:8449:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8a8fc1ca1000:8449] 3 exiting: rc = 0 00000100:00100000:2.0:1788528511.819714:0:6510:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8a90c79e8600:6510] 2 exiting: rc = 0 00000100:00100000:2.0:1788528511.819910:0:6509:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8a90c79e9a00:6509] 1 exiting: rc = 0 00000100:00100000:2.0:1788528511.819979:0:13480:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8a8fc1c95400:13480] 4 exiting: rc = 0 00000100:00100000:1.0:1788528511.820222:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820231:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820249:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820255:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820260:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820266:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820271:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820278:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820284:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820289:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820295:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820300:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820314:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820322:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820328:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820333:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820338:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820349:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820355:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820360:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820365:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820370:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820375:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820381:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820386:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820390:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820396:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820401:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820408:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820422:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820431:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820436:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820441:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820446:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820452:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820457:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820462:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820475:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820481:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820486:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820492:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820497:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820502:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820507:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820513:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820518:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820524:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820529:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820535:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820540:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820545:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820577:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820585:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820590:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820597:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820750:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820826:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820834:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820840:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820846:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820852:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820858:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820864:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.820870:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.824440:0:14211:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff8a90f6f0e400:14211] 2 exiting: rc = 0 00000100:00100000:2.0:1788528511.824700:0:6512:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8a90d9ff7a00:6512] 1 exiting: rc = 0 00000100:00100000:1.0:1788528511.825226:0:6511:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8a90ce83cc00:6511] 0 exiting: rc = 1 00000100:00100000:1.0:1788528511.825289:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825299:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825306:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825311:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825317:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825322:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825341:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825347:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825354:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825361:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825366:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825372:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825379:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825384:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825390:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825395:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825400:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825405:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825410:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825415:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825420:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825426:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825431:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825436:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825441:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825447:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825452:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825457:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825463:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825468:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825474:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825479:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825484:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825489:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825494:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825499:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825505:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825510:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825515:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825520:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825525:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825537:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825542:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825546:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825551:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825574:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825579:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825584:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825589:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825593:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825829:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825838:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825843:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825849:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825854:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825859:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825864:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825869:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825874:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825942:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825947:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825953:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825958:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.825965:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528511.826502:0:6513:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8a90ce83d200:6513] 0 exiting: rc = 1 00000100:00100000:3.0:1788528511.826794:0:6514:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8a90ce83de00:6514] 1 exiting: rc = 0 00000100:00100000:3.0:1788528511.826856:0:9268:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8a8fc30aae00:9268] 2 exiting: rc = 0 00000100:00100000:1.0:1788528511.827117:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827127:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827135:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827148:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827156:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827163:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827169:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827177:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827184:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827191:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827196:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827203:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827218:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827224:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827230:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827252:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827258:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827264:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827271:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827277:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827285:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827292:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827298:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827304:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827311:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827317:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827323:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827342:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827349:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827354:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827360:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827367:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827372:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827378:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827384:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827390:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827396:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827401:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827407:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827428:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827435:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827441:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827446:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827451:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827459:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827465:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827472:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827484:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827490:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827496:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827502:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827521:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827528:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827533:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827540:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827545:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827583:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827590:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827596:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827692:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827699:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827705:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827711:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528511.827717:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841132:0:6516:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8a90d2cc1200:6516] 1 exiting: rc = 0 00000100:00100000:2.0:1788528511.841375:0:6515:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8a90ce83d600:6515] 0 exiting: rc = 1 00000100:00100000:0.0:1788528511.841466:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841473:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841478:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841495:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841500:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841505:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841510:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841515:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841520:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841524:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841529:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841534:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841538:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841543:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841548:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841582:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841587:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841592:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841597:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841609:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841614:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841619:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841624:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841629:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841642:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841648:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841653:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841658:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841662:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841667:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841672:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841677:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841682:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841688:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841693:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841698:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841703:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841707:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841717:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841722:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841727:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841732:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841736:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841741:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841746:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841750:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841967:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841977:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841992:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.841997:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.842003:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.842008:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.842013:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.842018:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.842023:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.842029:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.842034:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.842039:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.842044:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.842048:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.842053:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.842058:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.842063:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.842068:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.842417:0:6517:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8a90ce83a400:6517] 0 exiting: rc = 1 00000100:00100000:2.0:1788528511.842624:0:6518:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8a90ce83a000:6518] 1 exiting: rc = 0 00000100:00100000:0.0:1788528511.842838:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.842845:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.842851:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.842856:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.842861:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.842866:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.842871:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.842946:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.842965:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.842970:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.842975:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843036:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843044:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843049:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843054:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843059:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843064:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843068:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843074:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843079:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843083:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843088:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843093:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843098:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843103:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843108:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843113:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843117:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843122:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843125:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843130:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843134:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843138:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843142:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843147:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843152:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843156:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843161:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843165:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843169:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843174:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843179:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843185:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843197:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843202:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843207:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843212:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843216:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843221:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843226:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843232:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843237:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843242:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843247:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843251:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843256:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843261:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843265:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843269:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843274:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843279:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843284:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843289:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.843293:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528511.846041:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8a90ce839000:6520] 1 exiting: rc = 0 00000100:00100000:2.0:1788528511.846185:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8a90d2cc0800:6519] 0 exiting: rc = 1 00000100:00100000:0.0:1788528511.846435:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846442:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846448:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846453:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846460:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846464:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846469:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846474:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846479:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846483:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846488:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846493:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846498:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846503:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846527:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846532:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846537:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846542:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846547:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846585:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846591:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846596:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846611:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846616:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846621:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846626:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846631:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846645:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846649:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846654:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846659:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846664:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846669:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846674:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846680:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846685:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846690:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846696:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846700:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846705:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846709:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846715:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846720:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846724:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846730:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846735:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846739:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846744:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846749:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846891:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846896:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846901:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846906:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846912:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846917:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846922:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846927:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846931:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846936:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846941:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846945:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846950:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846954:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.846960:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528511.847658:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8a90d9c4da00:6521] 0 exiting: rc = 1 00000100:00100000:0.0:1788528511.848202:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8a90d60b6400:6522] 1 exiting: rc = 0 00000100:00100000:0.0:1788528511.850166:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8a90d60b6200:6523] 2 exiting: rc = 0 00000100:00100000:0.0:1788528511.850279:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850309:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850316:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850322:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850329:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850334:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850340:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850345:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850351:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850356:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850363:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850368:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850374:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850380:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850386:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850392:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850397:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850402:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850423:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850428:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850433:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850439:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850444:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850452:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850457:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850474:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850480:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850486:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850491:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850497:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850502:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850508:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850514:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850519:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850525:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850531:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850537:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850542:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850548:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850577:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850584:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850590:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850596:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850860:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850867:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850872:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850888:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850893:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850899:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850918:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850927:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850932:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850938:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850951:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850957:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850963:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850969:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850974:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850991:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.850997:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.851002:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.851008:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.851015:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528511.851020:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788528511.857897:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788528511.857912:0:15350:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788528511.857918:0:15350:0:(genops.c:885:class_export_put()) final put ffff8a90de60b800/MDS_uuid 00000020:00000080:0.0:1788528511.857922:0:15350:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90de60b800/MDS_uuid for MDS 00000020:01000000:0.0:1788528511.857928:0:15350:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788528511.858196:0:15350:0:(tgt_mount.c:2258:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1788528512.128801:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788528512.194183:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) dd052447-840d-4bcc-891b-140c465c7625->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788528512.194193:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788528512.194196:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a90efac4800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788528512.194203:0:469:0:(import.c:545:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 380 00000100:00080000:1.0:1788528512.194209:0:469:0:(import.c:630:import_select_connection()) MGC192.168.203.138@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788528512.194217:0:469:0:(import.c:665:import_select_connection()) MGC192.168.203.138@tcp: import ffff8a90efac4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1788528512.194252:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc44c7b80 x1875407735524224/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788528512.194276:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788528512.194280:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788528512.194281:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a8fc2400800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788528512.194285:0:469:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 376 00000100:00080000:1.0:1788528512.194287:0:469:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788528512.194303:0:469:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a8fc2400800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1788528512.194319:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc44c6d80 x1875407735524352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788528512.194348:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788528512.194353:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788528512.194354:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a8fc34cd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788528512.194357:0:469:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 376 00000100:00080000:1.0:1788528512.194360:0:469:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788528512.194363:0:469:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a8fc34cd800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1788528512.194373:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc44c6a00 x1875407735524608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788528512.194416:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd052447-840d-4bcc-891b-140c465c7625:3636:1875407735524224:0@lo:250:kworker.0 00000100:00100000:1.0:1788528512.194480:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528512.194521:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1875407735524352:0@lo:38:kworker.0 00000400:00000100:1.0:1788528512.194539:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875407735524352 offset 0 length 520: 4 00000100:00100000:1.0:1788528512.194573:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1875407735524608:0@lo:38:kworker.0 00000400:00000100:1.0:1788528512.194589:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875407735524608 offset 0 length 520: 4 00000100:00100000:1.0:1788528512.194693:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735524480:0@lo:400:kworker.0 00000400:00000100:1.0:1788528512.194713:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875407735524480 offset 0 length 224: 4 00000100:00100000:1.0:1788528512.194737:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735524736:0@lo:400:kworker.0 00000400:00000100:1.0:1788528512.194755:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875407735524736 offset 0 length 224: 4 00000100:00100000:1.0:1788528512.194787:0:15235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735524224 00000100:00100000:1.0:1788528512.194795:0:15235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735524224 00000100:00100000:1.0:1788528512.194832:0:15235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788528512.194838:0:15235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc35a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3636:x1875407735524224:12345-0@lo:250:kworker.0 00010000:00000400:1.0:1788528512.194854:0:15235:0:(ldlm_lib.c:1248:target_handle_connect()) MGS: refusing connection from 0@lo: this is an MGS follower, which only serves clients that support it: rc = -19 00000100:00100000:1.0:1788528512.215076:0:15235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc35a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3636:x1875407735524224:12345-0@lo:250:kworker.0 Request processed in 20229us (20587us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788528512.215090:0:15235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788528512.215138:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90efac4800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788528512.215143:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-19) 00000100:00100000:1.0:1788528512.215147:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd052447-840d-4bcc-891b-140c465c7625:3636:1875407735524224:0@lo:250:kworker.0 00010000:00010000:0.0:1788528513.163729:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528514.175154:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788528514.762694:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788528514.762703:0:9506:0:(genops.c:885:class_export_put()) final put ffff8a8fc3c50000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788528514.762736:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3c50000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788528514.763523:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc3c53000 for lustre-OST0001 00010000:00010000:0.0:1788528515.199916:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788528515.856422:0:15550:0:(tgt_mount.c:2269:server_umount_begin()) umount -f 00000020:01000004:3.0:1788528515.876518:0:15550:0:(tgt_mount.c:2125:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788528515.876601:0:15550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2000/0x892c60dda91c7a07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a0e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528515.876637:0:15550:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2000/0x892c60dda91c7a07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7a0e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528515.876645:0:15550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2000/0x892c60dda91c7a07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c7a0e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528515.876652:0:15550:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2000/0x892c60dda91c7a07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c7a0e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528515.876672:0:15550:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788528515.876688:0:15550:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.203.138@tcp: clear lustre-client 10000000:01000000:3.0:1788528515.876693:0:15550:0:(mgc_request.c:650:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788528515.876716:0:15550:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788528515.876737:0:15550:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a8fc44c6d80 x1875407735524352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788528532 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528515.876755:0:15550:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788528515.876762:0:15550:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788528515.876767:0:15550:0:(import.c:65:import_set_state_nolock()) ffff8a8fc2400800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788528515.876773:0:15550:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788528515.876777:0:15550:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a8fc44c6d80 x1875407735524352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788528532 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528515.876784:0:15550:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788528515.876787:0:15550:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:0.0:1788528515.876941:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1875407735524352:0@lo:38:kworker.0 00010000:00010000:2.0:1788528515.877093:0:6496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788528515.877100:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2000/0x892c60dda91c7a07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c7a0e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528515.877107:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e2000 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:2.0:1788528515.877110:0:6496:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2000/0x892c60dda91c7a07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c7a0e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528515.877119:0:6496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2000/0x892c60dda91c7a07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c7a0e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788528515.877126:0:6496:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2000/0x892c60dda91c7a07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c7a0e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528515.877131:0:6496:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788528515.877134:0:6496:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:2.0:1788528515.877137:0:6496:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788528515.877168:0:6496:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a90efac4800 00010000:00010000:2.0:1788528515.877172:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2000/0x892c60dda91c7a07 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c7a0e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528515.877178:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2000/0x892c60dda91c7a07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c7a0e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528515.877200:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528515.877202:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528515.877203:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788528515.878985:0:15550:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788528515.879003:0:15550:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a8fc44c5180 x1875407735524480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528528 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528515.879028:0:15550:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788528515.879047:0:15550:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788528515.879070:0:15550:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1fe6000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788528515.879196:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735524480:0@lo:400:kworker.0 00000100:00100000:0.0:1788528515.879241:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1875407735524864:0@lo:39:umount.0 00000400:00000100:0.0:1788528515.879288:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875407735524864 offset 0 length 224: 4 00010000:00010000:2.0:1788528516.224039:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528517.252902:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788528517.311933:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) dd052447-840d-4bcc-891b-140c465c7625->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788528517.311944:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788528517.311948:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a90efac4800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788528517.311956:0:469:0:(import.c:545:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 381 00000100:00080000:0.0:1788528517.311962:0:469:0:(import.c:630:import_select_connection()) MGC192.168.203.138@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788528517.311987:0:469:0:(import.c:665:import_select_connection()) MGC192.168.203.138@tcp: import ffff8a90efac4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1788528517.312021:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc4674a80 x1875407735524992/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788528517.312121:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd052447-840d-4bcc-891b-140c465c7625:3636:1875407735524992:0@lo:250:kworker.0 00000100:00100000:2.0:1788528517.312227:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788528517.312405:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788528517.312410:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788528517.312465:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735525120:0@lo:400:kworker.0 00000400:00000100:1.0:1788528517.312493:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875407735525120 offset 0 length 224: 4 00000100:00100000:3.0:1788528517.313014:0:15232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735524992 00000100:00100000:3.0:1788528517.313024:0:15232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735524992 00000100:00100000:3.0:1788528517.313064:0:15232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788528517.313076:0:15232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc35a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3636:x1875407735524992:12345-0@lo:250:kworker.0 00010000:00000400:3.0:1788528517.313094:0:15232:0:(ldlm_lib.c:1248:target_handle_connect()) MGS: refusing connection from 0@lo: this is an MGS follower, which only serves clients that support it: rc = -19 00000100:00100000:3.0:1788528517.336432:0:15232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc35a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3636:x1875407735524992:12345-0@lo:250:kworker.0 Request processed in 23341us (24190us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788528517.336451:0:15232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788528517.336637:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90efac4800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788528517.336652:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-19) 00000100:00100000:2.0:1788528517.336657:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd052447-840d-4bcc-891b-140c465c7625:3636:1875407735524992:0@lo:250:kworker.0 00000001:00100000:1.0:1788528517.825244:0:8416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788528517.825252:0:8416:0:(genops.c:885:class_export_put()) final put ffff8a8fc2406800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788528517.825379:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc2406800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788528517.825428:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc2404800 for lustre-OST0000 00010000:00010000:0.0:1788528518.271099:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528519.294844:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528520.319242:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528521.346124:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528522.367811:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788528522.430986:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) dd052447-840d-4bcc-891b-140c465c7625->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788528522.430998:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788528522.431001:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a90efac4800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788528522.431010:0:36:0:(import.c:545:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 386 00000100:00080000:0.0:1788528522.431016:0:36:0:(import.c:630:import_select_connection()) MGC192.168.203.138@tcp: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788528522.431023:0:36:0:(import.c:665:import_select_connection()) MGC192.168.203.138@tcp: import ffff8a90efac4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1788528522.431060:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc4674a80 x1875407735525248/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788528522.431097:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788528522.431100:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788528522.431263:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788528522.431277:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1875407735525376:0@lo:400:kworker.0 00000400:00000100:3.0:1788528522.431326:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875407735525376 offset 0 length 224: 4 00000100:00100000:2.0:1788528522.431456:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd052447-840d-4bcc-891b-140c465c7625:3636:1875407735525248:0@lo:250:kworker.0 00000100:00100000:2.0:1788528522.431501:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528522.431678:0:15235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735525248 00000100:00100000:0.0:1788528522.431687:0:15235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735525248 00000100:00100000:0.0:1788528522.431727:0:15235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788528522.431734:0:15235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc35a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3636:x1875407735525248:12345-0@lo:250:kworker.0 00010000:00000400:0.0:1788528522.431749:0:15235:0:(ldlm_lib.c:1248:target_handle_connect()) MGS: refusing connection from 0@lo: this is an MGS follower, which only serves clients that support it: rc = -19 00000100:00100000:0.0:1788528522.455070:0:15235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc35a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3636:x1875407735525248:12345-0@lo:250:kworker.0 Request processed in 23325us (23557us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788528522.455084:0:15235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788528522.455182:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90efac4800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788528522.455189:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-19) 00000100:00100000:2.0:1788528522.455193:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd052447-840d-4bcc-891b-140c465c7625:3636:1875407735525248:0@lo:250:kworker.0 00010000:00010000:0.0:1788528523.390978:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528524.414919:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528525.438919:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528525.502711:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788528515/real 1788528515] req@ffff8a90f58c1f80 x1875407735524864/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788528525 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528525.502758:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a90f58c1f80 x1875407735524864/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788528525 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788528525.502779:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1fe6000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788528525.502927:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1875407735524864:0@lo:39:umount.0 00000100:00080000:3.0:1788528525.503791:0:15550:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788528525.503797:0:15550:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788528525.503803:0:15550:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788528525.506312:0:15550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7a15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a1c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528525.506330:0:15550:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7a15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7a1c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528525.506338:0:15550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7a15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c7a1c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528525.506345:0:15550:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7a15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c7a1c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528525.506419:0:15550:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788528525.506439:0:15550:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.203.138@tcp: clear lustre-OST0000 00010000:00010000:3.0:1788528525.506446:0:15550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6f3ae00/0x892c60dda91c7cbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7cc3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528525.506453:0:15550:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6f3ae00/0x892c60dda91c7cbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7cc3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528525.506459:0:15550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6f3ae00/0x892c60dda91c7cbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c7cc3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528525.506619:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788528525.507235:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7a15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c7a1c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528525.507244:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101851a00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:2.0:1788528525.507247:0:6497:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7a15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c7a1c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528525.507257:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7a15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c7a1c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788528525.507265:0:6497:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7a15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c7a1c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528525.507271:0:6497:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788528525.507273:0:6497:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-OST0000: stale lock, won't requeue 00010000:00010000:2.0:1788528525.507287:0:6497:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a90efac4800 00010000:00010000:2.0:1788528525.507291:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7a15 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c7a1c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528525.507298:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c7a15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c7a1c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528525.507314:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528525.507316:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528525.507318:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528525.510617:0:15550:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a90f6f3ae00/0x892c60dda91c7cbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c7cc3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528525.510670:0:15550:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788528525.510697:0:15550:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.203.138@tcp: clear params 00010000:00010000:3.0:1788528525.510708:0:15550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c7a23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a2a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528525.510717:0:15550:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c7a23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7a2a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528525.510724:0:15550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c7a23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c7a2a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528525.510730:0:15550:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c7a23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c7a2a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528525.510754:0:15550:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788528525.510821:0:15550:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.203.138@tcp: clear lustre-sptlrpc 10000000:01000000:3.0:1788528525.510825:0:15550:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1788528525.510850:0:15550:0:(mgc_request.c:650:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788528525.510909:0:15550:0:(tgt_mount.c:2175:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788528525.510914:0:15550:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788528525.510920:0:15550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788528525.510926:0:15550:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788528525.510930:0:15550:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8a90fa609980) has no exports 00000020:00080000:3.0:1788528525.510951:0:15550:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8a90fa609980) has no exports 00010000:00010000:1.0:1788528525.513084:0:8438:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788528525.513099:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90f6f3ae00/0x892c60dda91c7cbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c7cc3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528525.513110:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3ae00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528525.513114:0:8438:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6f3ae00/0x892c60dda91c7cbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c7cc3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528525.513136:0:8438:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90f6f3ae00/0x892c60dda91c7cbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c7cc3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528525.513164:0:8438:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6f3ae00/0x892c60dda91c7cbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c7cc3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528525.513170:0:8438:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788528525.513172:0:8438:0:(mgc_request.c:1180:mgc_blocking_ast()) log params: stale lock, won't requeue 10000000:01000000:1.0:1788528525.513176:0:8438:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788528525.513216:0:8438:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a90efac4800 00010000:00010000:1.0:1788528525.513221:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90f6f3ae00/0x892c60dda91c7cbc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c7cc3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528525.513228:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90f6f3ae00/0x892c60dda91c7cbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c7cc3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528525.513243:0:8438:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528525.513247:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c7a23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c7a2a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528525.513253:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e2200 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528525.513256:0:8438:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c7a23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c7a2a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528525.513263:0:8438:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c7a23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c7a2a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528525.513270:0:8438:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c7a23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c7a2a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528525.513275:0:8438:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788528525.513277:0:8438:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 10000000:01000000:1.0:1788528525.513285:0:8438:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788528525.513331:0:8438:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a90efac4800 00010000:00010000:1.0:1788528525.513336:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c7a23 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c7a2a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528525.513342:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c7a23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c7a2a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528525.513353:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528525.513355:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528525.513357:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528525.516777:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788528525.520781:0:15550:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a8fc33c9c60 - data ffff8a8fc200fbd0/ffff8a90ffa03800 00000020:01000000:3.0:1788528525.520960:0:15550:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a8fc2420d80 - data ffff8a8fc20971b0/ffff8a90fa8a1c00 00100000:10000000:3.0:1788528525.528389:0:15550:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788528525.549484:0:15550:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c772f 00000020:00000080:0.0:1788528525.549498:0:15550:0:(genops.c:885:class_export_put()) final put ffff8a8fc1c4f000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788528525.549520:0:15550:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8a90fa76f800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788528525.549524:0:15550:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a90fa76f800 2 00000020:01000004:0.0:1788528525.549527:0:15550:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff8a90fa76f800 from lustre-OST0000 00000020:00000080:0.0:1788528525.549583:0:15550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788528525.549593:0:15550:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788528525.549596:0:15550:0:(genops.c:885:class_export_put()) final put ffff8a8fc1c4d000/lustre-OST0000_UUID 00000020:00000080:0.0:1788528525.549599:0:15550:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc1c4d000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788528525.549607:0:15550:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:3.0:1788528525.549795:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc1c4f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:0.0:1788528525.549858:0:15550:0:(obd_mount.c:580:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788528525.549863:0:15550:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788528525.549867:0:15550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788528525.549872:0:15550:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788528525.549879:0:15550:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8a8fc2401000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788528525.549886:0:15550:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8a90f6c4e600) has exports, disconnecting them 00000020:00080000:0.0:1788528525.549891:0:15550:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8a8fc2401000), last request at 1788528293 00000020:00000080:0.0:1788528525.549894:0:15550:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c7759 00000020:00080000:0.0:1788528525.549917:0:15550:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a8fc2401000): rc 0 00000020:00000080:0.0:1788528525.549921:0:15550:0:(genops.c:885:class_export_put()) final put ffff8a8fc2401000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788528525.551105:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc2401000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788528525.552676:0:15550:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788528525.552684:0:15550:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788528525.552688:0:15550:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788528525.552695:0:15550:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788528525.552895:0:15550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788528525.552906:0:15550:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788528525.552913:0:15550:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788528525.552918:0:15550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788528525.552921:0:15550:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788528525.552928:0:15550:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8a8fc1fe2000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788528525.552935:0:15550:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8a9101959980) has exports, disconnecting them 00000020:00080000:0.0:1788528525.552939:0:15550:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8a8fc1fe2000), last request at 1788528293 00000020:00000080:0.0:1788528525.552943:0:15550:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c776e 00000020:00080000:0.0:1788528525.552959:0:15550:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a8fc1fe2000): rc 0 00000020:00000080:0.0:1788528525.552964:0:15550:0:(genops.c:885:class_export_put()) final put ffff8a8fc1fe2000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788528525.553731:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc2400800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788528525.553741:0:469:0:(genops.c:885:class_export_put()) final put ffff8a8fc1c4c000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788528525.553744:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc1c4c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788528525.553751:0:469:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788528525.553827:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc1fe2000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788528525.567653:0:15550:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788528525.567663:0:15550:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788528525.567667:0:15550:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788528525.567675:0:15550:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788528525.567711:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc1fe6000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788528525.567937:0:15550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788528525.567947:0:15550:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1788528525.567953:0:15550:0:(genops.c:885:class_export_put()) final put ffff8a8fc1fe4000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1788528525.567956:0:15550:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc1fe4000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1788528525.567969:0:15550:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788528525.568056:0:15550:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a90fa76f800 1 00000020:00000080:3.0:1788528525.568062:0:15550:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c76f7 00000020:00000080:3.0:1788528525.568068:0:15550:0:(genops.c:885:class_export_put()) final put ffff8a90d635a000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788528525.568077:0:15550:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788528525.568085:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90d635a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788528525.568094:0:15550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788528525.568100:0:15550:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788528525.568103:0:15550:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8a90fa60e600) has no exports 00000020:00000080:3.0:1788528525.613724:0:15550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788528525.613737:0:15550:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788528525.613743:0:15550:0:(genops.c:885:class_export_put()) final put ffff8a90fa76c000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788528525.613747:0:15550:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90fa76c000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788528525.613753:0:15550:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788528525.613872:0:15550:0:(obd_mount.c:670:lustre_free_lsi()) Freeing lsi ffff8a90fa76b000 00000020:02000400:3.0:1788528525.613911:0:15550:0:(tgt_mount.c:2258:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788528526.463734:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528527.487742:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788528527.552042:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) dd052447-840d-4bcc-891b-140c465c7625->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788528527.552053:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788528527.552056:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a90efac4800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788528527.552064:0:36:0:(import.c:545:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 391 00000100:00080000:1.0:1788528527.552069:0:36:0:(import.c:630:import_select_connection()) MGC192.168.203.138@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788528527.552078:0:36:0:(import.c:665:import_select_connection()) MGC192.168.203.138@tcp: import ffff8a90efac4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1788528527.552115:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc44c7b80 x1875407735525504/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788528527.552135:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788528527.552138:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788528527.552223:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788528527.552240:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1875407735525632:0@lo:400:kworker.0 00000400:00000100:2.0:1788528527.552291:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875407735525632 offset 0 length 224: 4 00000100:00100000:3.0:1788528527.552856:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd052447-840d-4bcc-891b-140c465c7625:3636:1875407735525504:0@lo:250:kworker.0 00000100:00100000:3.0:1788528527.552951:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528527.553129:0:15232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735525504 00000100:00100000:0.0:1788528527.553138:0:15232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735525504 00000100:00100000:0.0:1788528527.553179:0:15232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788528527.553186:0:15232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc35a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3636:x1875407735525504:12345-0@lo:250:kworker.0 00010000:00000400:0.0:1788528527.553204:0:15232:0:(ldlm_lib.c:1248:target_handle_connect()) MGS: refusing connection from 0@lo: this is an MGS follower, which only serves clients that support it: rc = -19 00000100:00100000:0.0:1788528527.564626:0:15232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc35a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3636:x1875407735525504:12345-0@lo:250:kworker.0 Request processed in 11429us (11665us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788528527.564641:0:15232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788528527.564866:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90efac4800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788528527.564872:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-19) 00000100:00100000:3.0:1788528527.564877:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd052447-840d-4bcc-891b-140c465c7625:3636:1875407735525504:0@lo:250:kworker.0 00010000:00010000:2.0:1788528528.516731:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1788528528.575039:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788528512/real 1788528512] req@ffff8a8fc44c5f80 x1875407735524736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788528528 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528528.615224:0:3639:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8a8fc44c5f80 x1875407735524736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788528528 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788528528.615238:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8a8fc34cf800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788528528.615248:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788528528.631793:0:3639:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:1.0:1788528528.631831:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) dd052447-840d-4bcc-891b-140c465c7625->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788528528.631837:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788528528.631840:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a90efac4800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788528528.631848:0:36:0:(import.c:545:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 396 00000100:00080000:1.0:1788528528.631853:0:36:0:(import.c:630:import_select_connection()) MGC192.168.203.138@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788528528.631860:0:36:0:(import.c:665:import_select_connection()) MGC192.168.203.138@tcp: import ffff8a90efac4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1788528528.631893:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc44c5880 x1875407735525760/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788528528.631914:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788528528.631918:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788528528.631921:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788528528.631923:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788528528.631925:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a8fc34cf800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788528528.631929:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 182 00000100:00080000:1.0:1788528528.631932:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8a8fc34cf800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1788528528.631946:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc44c7b80 x1875407735525888/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788528528.631971:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd052447-840d-4bcc-891b-140c465c7625:3636:1875407735525760:0@lo:250:kworker.0 00000100:00100000:1.0:1788528528.632034:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528528.632078:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1875407735525888:0@lo:38:kworker.0 00000400:00000100:1.0:1788528528.632097:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875407735525888 offset 0 length 520: 4 00000100:00100000:1.0:1788528528.632127:0:15235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735525760 00000100:00100000:1.0:1788528528.632140:0:15235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735525760 00000100:00100000:1.0:1788528528.632171:0:15235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788528528.632178:0:15235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc35a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3636:x1875407735525760:12345-0@lo:250:kworker.0 00010000:00000400:1.0:1788528528.632194:0:15235:0:(ldlm_lib.c:1248:target_handle_connect()) MGS: refusing connection from 0@lo: this is an MGS follower, which only serves clients that support it: rc = -19 00000100:00100000:1.0:1788528528.632335:0:15235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc35a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3636:x1875407735525760:12345-0@lo:250:kworker.0 Request processed in 156us (302us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788528528.632343:0:15235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788528528.632385:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90efac4800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788528528.632390:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-19) 00000100:00100000:1.0:1788528528.632393:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd052447-840d-4bcc-891b-140c465c7625:3636:1875407735525760:0@lo:250:kworker.0 00000100:00100000:1.0:1788528528.632427:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735524736:0@lo:400:kworker.0 00000020:01000004:3.0:1788528529.272068:0:15752:0:(tgt_mount.c:2269:server_umount_begin()) umount -f 00000020:01000004:1.0:1788528529.299529:0:15752:0:(tgt_mount.c:2125:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788528529.300145:0:15752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3a00/0x892c60dda91c79dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c79e4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528529.300160:0:15752:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3a00/0x892c60dda91c79dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c79e4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528529.300168:0:15752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3a00/0x892c60dda91c79dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c79e4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528529.300175:0:15752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3a00/0x892c60dda91c79dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c79e4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528529.300200:0:15752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788528529.300217:0:15752:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.203.138@tcp: clear lustre-client 10000000:01000000:1.0:1788528529.300222:0:15752:0:(mgc_request.c:650:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1788528529.300243:0:8438:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:1.0:1788528529.300247:0:15752:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1788528529.300265:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3a00/0x892c60dda91c79dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c79e4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528529.300269:0:15752:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a8fc44c6a00 x1875407735524608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788528532 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788528529.300280:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e3a00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:2.0:1788528529.300287:0:8438:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3a00/0x892c60dda91c79dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c79e4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528529.300296:0:8438:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3a00/0x892c60dda91c79dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c79e4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528529.300300:0:15752:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 10000000:00010000:2.0:1788528529.300309:0:8438:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3a00/0x892c60dda91c79dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c79e4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788528529.300309:0:15752:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788528529.300316:0:15752:0:(import.c:65:import_set_state_nolock()) ffff8a8fc34cd800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788528529.300318:0:8438:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788528529.300323:0:8438:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 00000100:00080000:1.0:1788528529.300323:0:15752:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:01000000:2.0:1788528529.300329:0:8438:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:1.0:1788528529.300331:0:15752:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a8fc44c6a00 x1875407735524608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788528532 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528529.300340:0:15752:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788528529.300344:0:15752:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00010000:00010000:2.0:1788528529.300374:0:8438:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a90efac4800 00010000:00010000:2.0:1788528529.300379:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3a00/0x892c60dda91c79dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c79e4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528529.300385:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3a00/0x892c60dda91c79dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c79e4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528529.300396:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528529.300398:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528529.300399:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528529.302529:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1875407735524608:0@lo:38:kworker.0 00000100:00080000:1.0:1788528529.305737:0:15752:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788528529.305755:0:15752:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a8fc4674700 x1875407735525120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528533 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528529.305840:0:15752:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a8fc4677800 x1875407735525376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528538 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528529.305870:0:15752:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a8fc44c4e00 x1875407735525632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528543 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528529.305883:0:15752:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a8fc44c7b80 x1875407735525888/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788528538 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528529.305897:0:15752:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788528529.305904:0:15752:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788528529.305910:0:15752:0:(import.c:65:import_set_state_nolock()) ffff8a8fc34cf800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788528529.305917:0:15752:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788528529.305920:0:15752:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a8fc4674700 x1875407735525120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528533 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528529.305993:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1875407735525632:0@lo:400:kworker.0 00000100:00100000:3.0:1788528529.306057:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1875407735525376:0@lo:400:kworker.0 00000100:00100000:0.0:1788528529.308118:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735525120:0@lo:400:kworker.0 00000100:00100000:1.0:1788528529.314587:0:15752:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a8fc4677800 x1875407735525376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528538 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528529.314626:0:15752:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a8fc44c4e00 x1875407735525632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528543 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528529.314634:0:15752:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a8fc44c7b80 x1875407735525888/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788528538 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528529.314643:0:15752:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788528529.314807:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1875407735525888:0@lo:38:kworker.0 00000100:00100000:1.0:1788528529.317424:0:15752:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788528529.319362:0:15752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c79eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c79f2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528529.319379:0:15752:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c79eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c79f2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528529.319386:0:15752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c79eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c79f2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528529.319393:0:15752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c79eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c79f2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528529.319419:0:15752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788528529.319438:0:15752:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.203.138@tcp: clear lustre-OST0001 00010000:00010000:1.0:1788528529.319444:0:15752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3e00/0x892c60dda91c7cae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7cb5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528529.319451:0:15752:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3e00/0x892c60dda91c7cae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7cb5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528529.319457:0:15752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3e00/0x892c60dda91c7cae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c7cb5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528529.319477:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528529.319479:0:15752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3e00/0x892c60dda91c7cae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c7cb5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528529.319484:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c79eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c79f2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528529.319491:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17600 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:0.0:1788528529.319494:0:8439:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c79eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c79f2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528529.319520:0:8439:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c79eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c79f2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528529.319527:0:8439:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c79eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c79f2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528529.319533:0:8439:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788528529.319535:0:8439:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-OST0001: stale lock, won't requeue 00010000:00010000:1.0:1788528529.319541:0:15752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788528529.319547:0:8439:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a90efac4800 00010000:00010000:0.0:1788528529.319550:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c79eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c79f2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528529.319551:0:15752:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.203.138@tcp: clear params 00010000:00010000:1.0:1788528529.319573:0:15752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c79f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c7a00 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528529.319587:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90f6e17600/0x892c60dda91c79eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c79f2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528529.319589:0:15752:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c79f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c7a00 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528529.319595:0:15752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c79f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c7a00 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528529.319601:0:15752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c79f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c7a00 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528529.319602:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528529.319605:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3e00/0x892c60dda91c7cae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c7cb5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528529.319611:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e3e00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:0.0:1788528529.319614:0:8439:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3e00/0x892c60dda91c7cae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c7cb5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528529.319621:0:8439:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3e00/0x892c60dda91c7cae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c7cb5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528529.319627:0:8439:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3e00/0x892c60dda91c7cae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c7cb5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528529.319642:0:8439:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788528529.319644:0:8439:0:(mgc_request.c:1180:mgc_blocking_ast()) log params: stale lock, won't requeue 10000000:01000000:0.0:1788528529.319646:0:8439:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788528529.319674:0:8439:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a90efac4800 00010000:00010000:0.0:1788528529.319677:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3e00/0x892c60dda91c7cae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c7cb5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528529.319683:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3e00/0x892c60dda91c7cae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c7cb5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528529.319696:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528529.319699:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c79f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c7a00 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528529.319705:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101851e00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:0.0:1788528529.319707:0:8439:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c79f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c7a00 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528529.319713:0:8439:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c79f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c7a00 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528529.319718:0:8439:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c79f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c7a00 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528529.319723:0:8439:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788528529.319725:0:8439:0:(mgc_request.c:1187:mgc_blocking_ast()) log lustre-sptlrpc: stopping, won't requeue 00010000:00010000:0.0:1788528529.319729:0:8439:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a90efac4800 00010000:00010000:0.0:1788528529.319731:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c79f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c7a00 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528529.319747:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528529.319749:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528529.319817:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528529.319878:0:15752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788528529.319882:0:15752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c79f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c7a00 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528529.319900:0:15752:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.203.138@tcp: clear lustre-sptlrpc 10000000:01000000:1.0:1788528529.319903:0:15752:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788528529.319931:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788528529.319935:0:15752:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1788528529.319951:0:15752:0:(mgc_request.c:650:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788528529.319969:0:15752:0:(tgt_mount.c:2175:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788528529.319973:0:15752:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788528529.319978:0:15752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788528529.319984:0:15752:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788528529.319993:0:15752:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8a9101958000) has no exports 00000020:00080000:1.0:1788528529.320014:0:15752:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8a9101958000) has no exports 00010000:00010000:2.0:1788528529.321436:0:6496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788528529.322750:0:15752:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a90c2ba1cc0 - data ffff8a90f0e9aaf8/ffff8a90f6ebf400 00000020:01000000:1.0:1788528529.322907:0:15752:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a8fc36c1420 - data ffff8a90f0ecaa20/ffff8a8fc35d5400 00100000:10000000:3.0:1788528529.340228:0:15752:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788528529.359902:0:15752:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c7863 00000020:00000080:0.0:1788528529.359913:0:15752:0:(genops.c:885:class_export_put()) final put ffff8a90fe6bc800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788528529.359931:0:15752:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8a8fc1fe4800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788528529.359934:0:15752:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a8fc1fe4800 3 00000020:01000004:0.0:1788528529.359937:0:15752:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff8a8fc1fe4800 from lustre-OST0001 00000020:00000080:0.0:1788528529.359958:0:15752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788528529.359968:0:15752:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788528529.359971:0:15752:0:(genops.c:885:class_export_put()) final put ffff8a90fe6bf800/lustre-OST0001_UUID 00000020:00000080:0.0:1788528529.359974:0:15752:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90fe6bf800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788528529.359980:0:15752:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788528529.360125:0:15752:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import dd052447-840d-4bcc-891b-140c465c7625->MGS 00010000:00010000:0.0:1788528529.360141:0:15752:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c13fde00/0x892c60dda91c75ae lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c75b5 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528529.360151:0:15752:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c13fde00/0x892c60dda91c75ae lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c75b5 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528529.360157:0:15752:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788528529.360160:0:15752:0:(mgc_request.c:1197:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788528529.360163:0:15752:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788528529.360204:0:15752:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a90efac4800 00010000:00010000:0.0:1788528529.360208:0:15752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c13fde00/0x892c60dda91c75ae lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c75b5 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788528529.360228:0:15752:0:(import.c:65:import_set_state_nolock()) ffff8a90efac4800 MGS: changing import state from DISCONN to CLOSED 10000000:01000000:0.0:1788528529.360232:0:15752:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788528529.360244:0:15752:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788528529.360245:0:15752:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788528529.360250:0:15752:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788528529.360253:0:15752:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788528529.360255:0:15752:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788528529.360257:0:15752:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788528529.360263:0:15752:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c74ab 00000020:00000080:0.0:1788528529.360267:0:15752:0:(genops.c:885:class_export_put()) final put ffff8a90de608800/dd052447-840d-4bcc-891b-140c465c7625 00000020:01000000:0.0:1788528529.360271:0:15752:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.203.138@tcp (flags='') 00000020:00000080:0.0:1788528529.360275:0:15752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788528529.360280:0:15752:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.138@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788528529.360283:0:15752:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8a90c78ee600) has no exports 00000020:00000080:1.0:1788528529.360366:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90fe6bc800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788528529.360373:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90de608800/dd052447-840d-4bcc-891b-140c465c7625 for MGC192.168.203.138@tcp 10000000:01000000:2.0:1788528529.361522:0:6506:0:(mgc_request.c:928:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788528529.362047:0:15752:0:(obd_class.h:688:obd_cleanup_client_import()) MGC192.168.203.138@tcp: client import never connected 00000100:00080000:1.0:1788528529.362053:0:15752:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788528529.362057:0:15752:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788528529.362060:0:15752:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788528529.362063:0:15752:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788528529.362115:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90efac4800 for MGC192.168.203.138@tcp 00000020:00000080:1.0:1788528529.362115:0:15752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788528529.362125:0:15752:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.138@tcp (uuid dd052447-840d-4bcc-891b-140c465c7625) 00000020:00000080:1.0:1788528529.362130:0:15752:0:(genops.c:885:class_export_put()) final put ffff8a90efac0000/dd052447-840d-4bcc-891b-140c465c7625 00000020:00000080:1.0:1788528529.362133:0:15752:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90efac0000/dd052447-840d-4bcc-891b-140c465c7625 for MGC192.168.203.138@tcp 00000020:01000000:1.0:1788528529.362139:0:15752:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.138@tcp (dd052447-840d-4bcc-891b-140c465c7625) 00000020:01000004:1.0:1788528529.362417:0:15752:0:(tgt_mount.c:284:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788528529.362423:0:15752:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788528529.362427:0:15752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788528529.362430:0:15752:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788528529.362434:0:15752:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8a910195cc80) has no exports 00000020:00080000:1.0:1788528529.362439:0:15752:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8a910195cc80) has no exports 00000100:00100000:1.0:1788528529.362500:0:15235:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8a90ce9f9800:15235] 2 exiting: rc = 0 00000100:00100000:1.0:1788528529.362797:0:15233:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8a90ce9f9a00:15233] 1 exiting: rc = 0 00000100:00100000:2.0:1788528529.363881:0:15232:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8a8fc1f89800:15232] 0 exiting: rc = 1 00000100:00100000:1.0:1788528529.364233:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364240:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364247:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364253:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364258:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364264:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364269:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364285:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364290:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364296:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364302:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364307:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364314:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364319:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364324:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364329:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364334:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364339:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364345:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364349:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364354:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364360:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364365:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364371:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364376:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364382:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364388:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364393:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364398:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364404:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364409:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364414:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364420:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364425:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364430:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364436:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364441:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364446:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364452:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364456:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364461:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364466:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364478:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364482:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364488:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364493:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364498:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364504:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364509:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364523:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364529:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364534:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364540:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364545:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364549:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364590:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364596:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364602:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364607:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364612:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364617:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364622:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364628:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.364632:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788528529.365367:0:15752:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8ac3 00000020:00000080:1.0:1788528529.365376:0:15752:0:(genops.c:885:class_export_put()) final put ffff8a8fc477b800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788528529.365395:0:15752:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8a8fc1fe4800 from MGS, refs=2 00000020:01000004:1.0:1788528529.365398:0:15752:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a8fc1fe4800 2 00000020:01000004:1.0:1788528529.365401:0:15752:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff8a8fc1fe4800 from MGS 00000020:00000080:1.0:1788528529.365423:0:15752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788528529.365429:0:15752:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788528529.365431:0:15752:0:(genops.c:885:class_export_put()) final put ffff8a8fc477d800/MGS 00000020:00000080:1.0:1788528529.365434:0:15752:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc477d800/MGS for MGS 00000020:01000000:1.0:1788528529.365440:0:15752:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788528529.365497:0:15752:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788528529.365501:0:15752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788528529.365506:0:15752:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788528529.365532:0:15752:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8a8fc34c9800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788528529.365538:0:15752:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff8a90fa608000) has exports, disconnecting them 00000020:00080000:1.0:1788528529.365543:0:15752:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8a8fc34c9800), last request at 1788528313 00000020:00000080:1.0:1788528529.365547:0:15752:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c788d 00000020:00080000:1.0:1788528529.365580:0:15752:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a8fc34c9800): rc 0 00000020:00000080:1.0:1788528529.365585:0:15752:0:(genops.c:885:class_export_put()) final put ffff8a8fc34c9800/lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788528529.366240:0:15752:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788528529.366246:0:15752:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788528529.366250:0:15752:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788528529.366256:0:15752:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788528529.366386:0:15752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788528529.366392:0:15752:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788528529.366396:0:15752:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788528529.366400:0:15752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788528529.366404:0:15752:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788528529.366409:0:15752:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8a8fc34c8000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788528529.366413:0:15752:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff8a8fc35e4c80) has exports, disconnecting them 00000020:00080000:0.0:1788528529.366417:0:15752:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8a8fc34c8000), last request at 1788528313 00000020:00000080:0.0:1788528529.366420:0:15752:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c78a2 00000020:00080000:0.0:1788528529.366431:0:15752:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a8fc34c8000): rc 0 00000020:00000080:0.0:1788528529.366435:0:15752:0:(genops.c:885:class_export_put()) final put ffff8a8fc34c8000/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1788528529.367120:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc477b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788528529.367132:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc34c9800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788528529.367138:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc34cd800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788528529.367143:0:36:0:(genops.c:885:class_export_put()) final put ffff8a8fc3026000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788528529.367145:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3026000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788528529.367151:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788528529.367207:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc34c8000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1788528529.379652:0:15752:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788528529.379660:0:15752:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788528529.379665:0:15752:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788528529.379673:0:15752:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788528529.379703:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc34cf800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1788528529.379746:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788528529.379873:0:8438:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788528529.379935:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:0.0:1788528529.390353:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00010000:00010000:1.0:1788528529.390857:0:6496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-5 blwis in pool) 00000100:00100000:1.0:1788528529.391223:0:6492:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8a90f8f32e00:6492] 1 exiting: rc = 0 00000100:00100000:0.0:1788528529.391324:0:8437:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8a8fc1ce8200:8437] 2 exiting: rc = 0 00000100:00100000:3.0:1788528529.391491:0:6491:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8a90d9d4a400:6491] 0 exiting: rc = 1 00000100:00100000:2.0:1788528529.392038:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.392359:0:10330:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff8a90f6fb7800:10330] 4 exiting: rc = 0 00000100:00100000:0.0:1788528529.392528:0:6495:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8a90d1695000:6495] 2 exiting: rc = 0 00000100:00100000:0.0:1788528529.392839:0:6493:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8a90d1695600:6493] 0 exiting: rc = 1 00000100:00100000:0.0:1788528529.392992:0:8441:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8a8fc1cede00:8441] 3 exiting: rc = 0 00000100:00100000:3.0:1788528529.393204:0:6494:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8a90d1695200:6494] 1 exiting: rc = 0 00000100:00100000:2.0:1788528529.393363:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393371:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393378:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393385:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393391:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393398:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393404:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393411:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393417:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393429:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393442:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393448:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393454:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393459:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393465:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393471:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393476:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393481:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393487:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393493:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393499:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393504:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393509:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393525:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393531:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393536:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393540:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393546:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393716:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393726:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393731:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393735:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393740:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393746:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393752:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393757:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393762:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393766:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393772:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393776:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393781:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393786:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393790:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393795:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393799:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393812:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393817:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393822:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393827:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393831:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393836:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393841:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393845:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393850:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393854:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393978:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393987:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393992:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.393997:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.394002:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.394007:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.394013:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.394017:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.394022:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788528529.395631:0:15752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788528529.395641:0:15752:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1788528529.395647:0:15752:0:(genops.c:885:class_export_put()) final put ffff8a8fc34c9000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1788528529.395651:0:15752:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc34c9000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1788528529.395656:0:15752:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1788528529.395706:0:15752:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a8fc1fe4800 1 00000020:00000080:2.0:1788528529.395712:0:15752:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c7832 00000020:00000080:2.0:1788528529.395717:0:15752:0:(genops.c:885:class_export_put()) final put ffff8a90fe6bd000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788528529.395732:0:15752:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788528529.395735:0:15752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788528529.395740:0:15752:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788528529.395744:0:15752:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff8a90f6c49980) has no exports 00000020:00000080:1.0:1788528529.397279:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90fe6bd000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788528529.459046:0:15752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788528529.459062:0:15752:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788528529.459080:0:15752:0:(genops.c:885:class_export_put()) final put ffff8a8fc1fe1000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788528529.459086:0:15752:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc1fe1000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788528529.459092:0:15752:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788528529.459912:0:15752:0:(obd_mount.c:670:lustre_free_lsi()) Freeing lsi ffff8a8fc1fe7800 00000020:01000000:2.0:1788528529.459945:0:15752:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788528529.459951:0:15752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788528529.459963:0:15752:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788528529.459968:0:15752:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8a910195e600) has no exports 00000020:00000080:2.0:1788528529.459992:0:15752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788528529.459999:0:15752:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788528529.460002:0:15752:0:(genops.c:885:class_export_put()) final put ffff8a90fa76c800/OSS_uuid 00000020:00000080:2.0:1788528529.460005:0:15752:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90fa76c800/OSS_uuid for OSS 00000020:01000000:2.0:1788528529.460013:0:15752:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1788528529.460124:0:8421:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8a90f6d04c00:8421] 0 exiting: rc = 1 00000100:00100000:2.0:1788528529.460221:0:8725:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8a8fc30aa000:8725] 3 exiting: rc = 0 00000100:00100000:2.0:1788528529.460284:0:8422:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8a90f8d71c00:8422] 1 exiting: rc = 0 00000100:00100000:1.0:1788528529.461456:0:8423:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8a90f6d61a00:8423] 2 exiting: rc = 0 00000100:00080000:3.0:1788528529.461733:0:6503:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788528529.461872:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.461881:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.461887:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.461894:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.461900:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463257:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463278:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463284:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463298:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463304:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463310:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463315:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463320:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463325:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463332:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463337:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463343:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463349:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463354:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463359:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463364:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463370:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463375:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463380:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463405:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463410:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463416:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463421:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463426:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463431:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463437:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463443:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463448:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463454:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463458:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463464:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463469:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463474:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463479:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463484:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463489:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463493:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463498:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463503:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463508:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463524:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463530:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463535:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463540:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463545:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463549:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463571:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463578:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463582:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463587:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463591:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463596:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463601:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463606:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463619:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463624:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463629:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463643:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.463650:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.464411:0:9546:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8a8fc3765000:9546] 2 exiting: rc = 0 00000100:00100000:1.0:1788528529.464507:0:8424:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8a90f6d61800:8424] 0 exiting: rc = 1 00000100:00100000:3.0:1788528529.464664:0:8425:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8a90f6d60a00:8425] 1 exiting: rc = 0 00000100:00100000:2.0:1788528529.465225:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.465234:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.465241:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.465247:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.465252:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.465258:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.465263:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.465268:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.465273:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.465278:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.465283:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.465287:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.465293:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.465298:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.465302:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.465307:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.465311:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.465316:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.465320:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.465325:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.465329:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.465334:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.465339:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.465344:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.465349:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.465353:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466088:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466094:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466100:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466117:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466123:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466128:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466133:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466137:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466142:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466147:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466152:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466157:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466162:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466167:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466181:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466187:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466192:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466196:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466201:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466207:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466216:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466221:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466226:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466231:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466236:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466241:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466250:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466255:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466260:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466265:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466270:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466275:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466280:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466293:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466300:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466304:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466309:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528529.466313:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528529.468331:0:8427:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8a90f6d60800:8427] 1 exiting: rc = 0 00000100:00100000:2.0:1788528529.470580:0:8426:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8a90f6d05800:8426] 0 exiting: rc = 1 00000100:00100000:2.0:1788528529.473686:0:8428:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8a90f6d61400:8428] 2 exiting: rc = 0 00000100:00100000:3.0:1788528529.476710:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476720:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476727:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476732:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476738:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476743:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476749:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476755:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476760:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476766:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476772:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476778:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476783:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476788:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476793:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476798:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476803:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476822:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476829:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476834:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476840:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476845:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476851:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476856:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476862:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476868:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476873:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476879:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476885:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476903:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476909:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476914:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476920:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476926:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476932:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476937:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476943:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476949:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476954:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476959:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476965:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476986:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476993:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.476999:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.477005:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.477013:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.477019:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.477025:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.477032:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.477037:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.477043:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.477049:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.477064:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.477071:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.477077:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.477082:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.477088:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.477094:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.477100:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.477106:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.477111:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.477117:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.477122:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.477128:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.486287:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8a90fa638c00:8430] 1 exiting: rc = 0 00000100:00100000:2.0:1788528529.486782:0:8429:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8a90d0ddd200:8429] 0 exiting: rc = 1 00000100:00100000:3.0:1788528529.489130:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489140:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489144:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489150:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489154:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489159:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489165:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489170:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489290:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489295:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489301:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489306:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489312:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489317:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489322:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489327:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489332:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489338:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489343:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489348:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489473:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489482:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489488:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489493:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489498:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489503:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489507:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489522:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489617:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489624:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489630:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489635:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489640:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489646:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489650:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489666:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489671:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489676:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489682:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489687:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489692:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489698:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489702:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489707:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489713:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489718:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489723:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489727:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489732:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489737:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489741:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489746:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489751:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489756:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489762:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489767:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489772:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489777:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489781:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489786:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489791:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489796:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489800:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.489804:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528529.490901:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8a90f5b00400:8431] 0 exiting: rc = 1 00000100:00100000:2.0:1788528529.491093:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8a90f5b02800:8432] 1 exiting: rc = 0 00000100:00100000:0.0:1788528529.491197:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491206:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491218:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491226:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491232:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491239:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491246:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491252:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491258:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491264:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491270:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491290:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491296:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491302:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491308:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491314:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491320:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491327:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491333:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491339:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491345:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491351:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491357:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491374:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491380:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491386:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491392:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491398:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491404:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491409:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491415:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491421:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491427:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491442:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491448:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491465:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491472:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491477:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491484:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491490:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491495:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491501:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491507:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491522:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491528:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491534:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491540:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491702:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491721:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491726:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491732:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491738:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491744:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491750:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491755:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491761:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491767:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491773:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491778:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491796:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491810:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491816:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491821:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528529.491833:0:15752:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788528529.501166:0:15752:0:(tgt_mount.c:2258:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788528548.936940:0:16517:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788528558.919874:0:17116:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:0.0:1788528558.919881:0:17116:0:(obd_mount.c:928:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788528558.919883:0:17116:0:(obd_mount.c:931:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788528558.919994:0:17116:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a8fc477d800 00000020:01000004:0.0:1788528558.920010:0:17116:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788528558.920024:0:17116:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788528558.920038:0:17116:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8a9101958000) 00000020:00000080:0.0:1788528558.920052:0:17116:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788528558.979117:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788528558.982364:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788528558.984961:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1788528558.985344:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788528558.985982:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788528558.986399:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788528558.986715:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1788528558.987063:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1788528558.987589:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1788528558.987823:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788528558.988345:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788528558.988849:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788528558.989391:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1788528558.989750:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788528558.992045:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1788528558.993031:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788528558.993424:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788528558.993779:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788528558.994084:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1788528558.995225:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1788528558.996455:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1788528558.997387:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788528559.001947:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788528559.004301:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788528559.006716:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788528559.009221:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788528559.010230:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788528559.011127:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788528559.011948:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788528559.012661:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788528559.012984:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788528559.014408:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788528559.015376:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788528559.016366:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788528559.017107:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788528559.017587:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788528559.017787:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788528559.018092:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788528559.018482:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788528559.018836:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788528559.019101:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788528559.019374:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788528559.019703:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788528559.020036:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788528559.020476:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788528559.020804:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788528559.021165:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788528559.033983:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788528559.037783:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788528559.038164:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788528559.038996:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1788528559.039496:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788528559.039998:0:17116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:3.0:1788528559.042416:0:17116:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788528559.043142:0:17116:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788528559.043149:0:17116:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788528559.043161:0:17116:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x892c60dda91c8ad1 00000020:01000004:3.0:1788528559.043169:0:17116:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788528559.043174:0:17116:0:(tgt_mount.c:234:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788528559.043189:0:17116:0:(tgt_mount.c:115:server_register_mount()) register mount ffff8a8fc477d800 from MGS 00000020:01000004:3.0:1788528559.043192:0:17116:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788528559.043203:0:17116:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8a8fc35e3300) 00000020:00000080:3.0:1788528559.043213:0:17116:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788528559.043995:0:17116:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a8fc477d800 from MGS, refs=2 00080000:01000000:3.0:1788528559.044016:0:17116:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788528559.044022:0:17116:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x892c60dda91c8adf 00000100:00100000:3.0:1788528559.044125:0:17116:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788528559.044633:0:17116:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788528559.044640:0:17116:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788528559.045381:0:17116:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788528559.045389:0:17116:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788528559.047007:0:17116:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788528559.047971:0:17116:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788528559.047981:0:17116:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788528559.049055:0:17116:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788528559.049065:0:17116:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788528559.049957:0:17116:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788528559.049965:0:17116:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788528559.050983:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528559.050987:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528559.050989:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528559.051335:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528559.051338:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528559.051339:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528559.052135:0:17116:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788528559.059456:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788528559.061701:0:17116:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788528559.065204:0:17128:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788528559.065664:0:17116:0:(mgs_nids.c:671:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788528559.065716:0:17116:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788528559.066990:0:17116:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788528559.067375:0:17116:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788528559.073732:0:17116:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788528559.073745:0:17116:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788528559.084786:0:17116:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788528559.084800:0:17116:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788528559.085901:0:17116:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788528559.085912:0:17116:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788528559.087763:0:17116:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788528559.087788:0:17116:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.138@tcp' 00000020:01000004:1.0:1788528559.087790:0:17116:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788528559.087820:0:17116:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.138@tcp (typ=mgc) 00000020:00000080:1.0:1788528559.087901:0:17116:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.138@tcp (ffff8a90ce96b300) 00000020:00000080:1.0:1788528559.087919:0:17116:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788528559.087998:0:17116:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a90c5a9a000@MGC192.168.203.138@tcp: add connection 192.168.203.138@tcp at head 00010000:00010000:1.0:1788528559.088815:0:17116:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.138@tcp-0 is initialized 00000040:01000000:1.0:1788528559.088823:0:17116:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788528559.089819:0:17134:0:(mgc_request.c:839:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788528559.089954:0:17116:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.138@tcp (uuid 463b8984-c30b-4b73-b2f1-81113bd4e10a) 00000020:00000080:0.0:1788528559.089973:0:17116:0:(genops.c:1385:class_connect()) connect: client 463b8984-c30b-4b73-b2f1-81113bd4e10a, cookie 0x892c60dda91c8aed 00000100:00080000:0.0:1788528559.089984:0:17116:0:(import.c:545:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788528559.089990:0:17116:0:(import.c:665:import_select_connection()) MGC192.168.203.138@tcp: import ffff8a90c5a9a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1788528559.090018:0:17116:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc4674700 x1875407735526016/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788528559.090046:0:17116:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 463b8984-c30b-4b73-b2f1-81113bd4e10a->MGS 00000020:01000004:0.0:1788528559.090062:0:17116:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788528559.090066:0:17116:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788528559.090078:0:17116:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8a910195b300) 00000020:00000080:0.0:1788528559.090086:0:17116:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788528559.090424:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:463b8984-c30b-4b73-b2f1-81113bd4e10a:3636:1875407735526016:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788528559.090494:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788528559.090791:0:17133:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1788528559.091651:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735526016 00000100:00100000:2.0:1788528559.091662:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735526016 00000100:00100000:2.0:1788528559.091701:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788528559.091709:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3636:x1875407735526016:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788528559.091734:0:17131:0:(ldlm_lib.c:1458:target_handle_connect()) MGS: connection from 463b8984-c30b-4b73-b2f1-81113bd4e10a@0@lo t0 exp 0000000000000000 cur 428 last 0 00000020:00000080:2.0:1788528559.091773:0:17131:0:(genops.c:1385:class_connect()) connect: client 463b8984-c30b-4b73-b2f1-81113bd4e10a, cookie 0x892c60dda91c8afb 00000100:00080000:2.0:1788528559.091954:0:17131:0:(import.c:65:import_set_state_nolock()) ffff8a8fc45c2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788528559.092029:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+5:3636:x1875407735526016:12345-0@lo:250:mount.lustre.0 Request processed in 319us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528559.092036:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788528559.092083:0:3636:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.138@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788528559.092091:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.138@tcp: connect to target with instance 0 00000100:00080000:2.0:1788528559.092097:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.138@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788528559.092101:0:3636:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788528559.092104:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90c5a9a000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788528559.092107:0:3636:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788528559.092114:0:3636:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788528559.092118:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:463b8984-c30b-4b73-b2f1-81113bd4e10a:3636:1875407735526016:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788528559.116039:0:17116:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788528559.118366:0:17116:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788528559.118389:0:17116:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788528559.122272:0:17116:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788528559.122285:0:17116:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788528559.125331:0:17116:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788528559.125343:0:17116:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788528559.126968:0:17116:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788528559.127160:0:17116:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788528559.127165:0:17116:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788528559.128916:0:17116:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788528559.128927:0:17116:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788528559.196765:0:17116:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788528559.197727:0:17116:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788528559.197735:0:17116:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788528559.202851:0:17116:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788528559.202866:0:17116:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788528559.203728:0:17116:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788528559.203926:0:17116:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788528559.203932:0:17116:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788528559.205690:0:17116:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788528559.205707:0:17116:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788528559.206400:0:17116:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788528559.208003:0:17116:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788528559.208011:0:17116:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788528559.214126:0:17116:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788528559.214140:0:17116:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788528559.215527:0:17116:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788528559.217778:0:17116:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788528559.217787:0:17116:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788528559.218536:0:17116:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788528559.218545:0:17116:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788528559.248530:0:17116:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788528559.248966:0:17116:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788528559.248974:0:17116:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788528559.252190:0:17116:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788528559.252207:0:17116:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788528559.253388:0:17116:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788528559.253399:0:17116:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788528559.258868:0:17116:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788528559.258925:0:17116:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.138@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788528559.258930:0:17116:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788528559.258932:0:17116:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788528559.258933:0:17116:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788528559.258934:0:17116:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788528559.258935:0:17116:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788528559.258937:0:17116:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788528559.258938:0:17116:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788528559.258939:0:17116:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788528559.258941:0:17116:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788528559.258942:0:17116:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788528559.258945:0:17116:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788528559.258947:0:17116:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788528559.258948:0:17116:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788528559.258950:0:17116:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788528559.258951:0:17116:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788528559.258952:0:17116:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788528559.258953:0:17116:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788528559.258954:0:17116:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788528559.258955:0:17116:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788528559.258956:0:17116:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788528559.258961:0:17116:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788528559.258987:0:17116:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788528559.259006:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735526144:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788528559.259078:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528559.259130:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528559.259212:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735526144 00000100:00100000:2.0:1788528559.259219:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735526144 00000100:00100000:2.0:1788528559.259269:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788528559.259277:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+5:17116:x1875407735526144:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788528559.259334:0:17132:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788528559.259336:0:17132:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788528559.259339:0:17132:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788528559.260959:0:17153:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788528559.263969:0:17132:0:(mgs_nids.c:671:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1788528559.274938:0:17154:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788528559.274946:0:17154:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788528559.274948:0:17154:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788528559.274951:0:17154:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788528559.275203:0:17154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788528559.275853:0:17132:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788528559.275864:0:17132:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788528559.282262:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+5:17116:x1875407735526144:12345-0@lo:253:mount.lustre.0 Request processed in 22976us (23174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528559.282281:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788528559.282914:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735526144:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788528559.282929:0:17116:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788528559.282932:0:17116:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788528559.282933:0:17116:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788528559.282934:0:17116:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788528559.282935:0:17116:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788528559.282936:0:17116:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788528559.282937:0:17116:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788528559.282939:0:17116:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788528559.282940:0:17116:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788528559.282942:0:17116:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788528559.282943:0:17116:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788528559.283026:0:17116:0:(tgt_mount.c:115:server_register_mount()) register mount ffff8a8fc477d800 from lustre-MDT0000 10000000:01000000:3.0:1788528559.283115:0:17116:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788528559.283118:0:17116:0:(mgc_request.c:423:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788528559.283121:0:17116:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8a8fc477d800 10000000:01000000:3.0:1788528559.283127:0:17116:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788528559.283146:0:17116:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff8a8fc477d800 from 1 10000000:01000000:3.0:1788528559.283148:0:17116:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788528559.283290:0:17116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429a00/0x892c60dda91c8b02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528559.283300:0:17116:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429a00/0x892c60dda91c8b02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528559.283330:0:17116:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429a00/0x892c60dda91c8b02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528559.283347:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735526272:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788528559.283690:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528559.283767:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d146e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788528559.283802:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735526272 00000100:00100000:2.0:1788528559.283808:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735526272 00000100:00100000:2.0:1788528559.283872:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788528559.283881:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+5:17116:x1875407735526272:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788528559.283893:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528559.283908:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9101850c00/0x892c60dda91c8b09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8b02 expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528559.283938:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101850c00/0x892c60dda91c8b09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8b02 expref: 6 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528559.283946:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9101850c00/0x892c60dda91c8b09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8b02 expref: 6 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528559.283955:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101850c00, rc 0) 00000100:00100000:2.0:1788528559.284040:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+6:17116:x1875407735526272:12345-0@lo:101:mount.lustre.0 Request processed in 150us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528559.284046:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788528559.284183:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735526272:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788528559.284197:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429a00/0x892c60dda91c8b02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8b09 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.284206:0:17116:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429a00/0x892c60dda91c8b02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8b09 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528559.284372:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735526400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788528559.284410:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528559.284475:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528559.284840:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735526400 00000100:00100000:2.0:1788528559.284846:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735526400 00000100:00100000:2.0:1788528559.284880:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788528559.284888:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+6:17116:x1875407735526400:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788528559.284971:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+6:17116:x1875407735526400:12345-0@lo:501:mount.lustre.0 Request processed in 85us (560us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788528559.284978:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788528559.285273:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735526400:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788528559.285291:0:17116:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788528559.285317:0:17116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429a00/0x892c60dda91c8b02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8b09 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.285337:0:17116:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429a00/0x892c60dda91c8b02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8b09 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528559.285346:0:17116:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff8a8fc477d800 10000000:01000000:0.0:1788528559.285352:0:17116:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788528559.285376:0:17116:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-barrier-ffff8a8fc477d800 10000000:01000000:0.0:1788528559.285380:0:17116:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788528559.285394:0:17116:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-barrier-ffff8a8fc477d800 from 1 10000000:01000000:0.0:1788528559.285397:0:17116:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788528559.285420:0:17116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0030200/0x892c60dda91c8b10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.285441:0:17116:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c0030200/0x892c60dda91c8b10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.285449:0:17116:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c0030200/0x892c60dda91c8b10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528559.285463:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735526528:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788528559.285492:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528559.285531:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528559.285655:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735526528 00000100:00100000:3.0:1788528559.285659:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735526528 00000100:00100000:3.0:1788528559.285691:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788528559.285699:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+6:17116:x1875407735526528:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788528559.285708:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528559.285720:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc3429000/0x892c60dda91c8b17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8b10 expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528559.285737:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc3429000/0x892c60dda91c8b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8b10 expref: 7 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528559.285746:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc3429000/0x892c60dda91c8b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8b10 expref: 7 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528559.285753:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3429000, rc 0) 00000100:00100000:3.0:1788528559.285781:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+7:17116:x1875407735526528:12345-0@lo:101:mount.lustre.0 Request processed in 84us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528559.285788:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788528559.286084:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735526528:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788528559.286097:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c0030200/0x892c60dda91c8b10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8b17 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.286105:0:17116:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c0030200/0x892c60dda91c8b10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8b17 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528559.286130:0:17116:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788528559.286135:0:17116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0030200/0x892c60dda91c8b10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8b17 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.286142:0:17116:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c0030200/0x892c60dda91c8b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8b17 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528559.286150:0:17116:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788528559.286154:0:17116:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788528559.286195:0:17116:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff8a8fc477d800 10000000:01000000:0.0:1788528559.286199:0:17116:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788528559.286214:0:17116:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788528559.286217:0:17116:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788528559.286243:0:17116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0031600/0x892c60dda91c8b1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.286250:0:17116:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c0031600/0x892c60dda91c8b1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.286258:0:17116:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c0031600/0x892c60dda91c8b1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528559.286272:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735526656:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788528559.286301:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528559.286338:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528559.286686:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735526656 00000100:00100000:3.0:1788528559.286690:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735526656 00000100:00100000:3.0:1788528559.286716:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788528559.286722:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+7:17116:x1875407735526656:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788528559.286740:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528559.286750:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc3428c00/0x892c60dda91c8b25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8b1e expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528559.286767:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc3428c00/0x892c60dda91c8b25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8b1e expref: 8 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528559.286775:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc3428c00/0x892c60dda91c8b25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8b1e expref: 8 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528559.286782:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3428c00, rc 0) 00000100:00100000:3.0:1788528559.286812:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+8:17116:x1875407735526656:12345-0@lo:101:mount.lustre.0 Request processed in 89us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528559.286818:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788528559.286951:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735526656:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788528559.286963:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c0031600/0x892c60dda91c8b1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8b25 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.286976:0:17116:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c0031600/0x892c60dda91c8b1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8b25 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528559.287009:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735526784:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788528559.287033:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528559.287061:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528559.287114:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735526784 00000100:00100000:3.0:1788528559.287119:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735526784 00000100:00100000:3.0:1788528559.287149:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788528559.287156:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+8:17116:x1875407735526784:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788528559.287304:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+9:17116:x1875407735526784:12345-0@lo:501:mount.lustre.0 Request processed in 148us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528559.287321:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788528559.287936:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735526784:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788528559.287973:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735526912:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788528559.288020:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528559.288052:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528559.288095:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735526912 00000100:00100000:3.0:1788528559.288100:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735526912 00000100:00100000:3.0:1788528559.288138:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788528559.288145:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+9:17116:x1875407735526912:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788528559.289033:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+9:17116:x1875407735526912:12345-0@lo:503:mount.lustre.0 Request processed in 886us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528559.289055:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788528559.289716:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735526912:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788528559.290105:0:17155:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:463b8984-c30b-4b73-b2f1-81113bd4e10a:17155:1875407735527040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788528559.290149:0:17155:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528559.290256:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735527040 00000100:00100000:3.0:1788528559.290261:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735527040 00000100:00100000:3.0:1788528559.290297:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788528559.290304:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+9:17155:x1875407735527040:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788528559.291025:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+9:17155:x1875407735527040:12345-0@lo:502:llog_process_th.0 Request processed in 719us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528559.291033:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788528559.291163:0:17155:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78f0000 going to sleep for 11 seconds 00000100:00100000:2.0:1788528559.291330:0:17155:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:463b8984-c30b-4b73-b2f1-81113bd4e10a:17155:1875407735527040:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788528559.291357:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788528559.291369:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528559.291371:0:17155:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788528559.291382:0:17155:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788528559.291384:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788528559.291399:0:17155:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8a90f6c4cc80) 00000020:00000080:2.0:1788528559.291416:0:17155:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788528559.291422:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788528559.291687:0:17155:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788528559.291697:0:17155:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x892c60dda91c8b33 00000020:00000080:2.0:1788528559.291887:0:17155:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788528559.291892:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788528559.291896:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528559.291897:0:17155:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788528559.291900:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788528559.291903:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528559.291905:0:17155:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788528559.291908:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788528559.291915:0:17155:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8a90f6c48000) 00000020:00000080:2.0:1788528559.291926:0:17155:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788528559.291930:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788528559.291932:0:17155:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788528559.291935:0:17155:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788528559.291941:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788528559.291977:0:17155:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a8fc477d800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788528559.291989:0:17155:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8a90f6c49980) 00000020:00000080:2.0:1788528559.291996:0:17155:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788528559.292065:0:17155:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788528559.292071:0:17155:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x892c60dda91c8b48 00000020:00000080:2.0:1788528559.292156:0:17155:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788528559.292162:0:17155:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788528559.292167:0:17155:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x892c60dda91c8b4f 00080000:01000000:2.0:1788528559.293327:0:17155:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788528559.293338:0:17155:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x892c60dda91c8b56 00010000:00010000:3.0:1788528559.382773:0:17155:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788528559.384824:0:17155:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:3.0:1788528559.385749:0:17155:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788528559.386284:0:17155:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8a8fc35e6600) 00000020:00000080:3.0:1788528559.386314:0:17155:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788528559.386390:0:17155:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788528559.386396:0:17155:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x892c60dda91c8b64 00000020:00000080:3.0:1788528559.387203:0:17155:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788528559.396224:0:17155:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x892c60dda91c8b6b 00000020:00000080:2.0:1788528559.402921:0:17155:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788528559.402939:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788528559.402952:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528559.402955:0:17155:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788528559.402958:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788528559.402961:0:17155:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788528559.402962:0:17155:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788528559.402964:0:17155:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788528559.402965:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788528559.402968:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528559.402969:0:17155:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788528559.402972:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788528559.402977:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528559.402978:0:17155:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788528559.402982:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788528559.403032:0:17155:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788528559.403050:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788528559.403053:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528559.403055:0:17155:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788528559.403057:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788528559.403060:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528559.403062:0:17155:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788528559.403065:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788528559.403071:0:17155:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:00000080:2.0:1788528559.403095:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788528559.403108:0:17155:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8a90f6c4e600) 00000020:00000080:2.0:1788528559.403124:0:17155:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788528559.403128:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788528559.403179:0:17155:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788528559.403185:0:17155:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788528559.403191:0:17155:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x892c60dda91c8b79 00010000:00080000:2.0:1788528559.403221:0:17155:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a90de3f0800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:2.0:1788528559.411420:0:17155:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1788528559.413975:0:17155:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788528559.413990:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788528559.414051:0:17155:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788528559.414072:0:17155:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x892c60dda91c8b80 00000100:00080000:2.0:1788528559.414083:0:17155:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788528559.414089:0:17155:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a90de3f0800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1788528559.414126:0:17155:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90f6da0700 x1875407735527168/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788528559.414156:0:17155:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1788528559.414216:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788528559.414220:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528559.414223:0:17155:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788528559.414226:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788528559.414229:0:17155:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1788528559.414230:0:17155:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788528559.414304:0:17155:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788528559.414314:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788528559.414319:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528559.414320:0:17155:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788528559.414323:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788528559.414329:0:17155:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788528559.414332:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528559.414334:0:17155:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788528559.414337:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788528559.414344:0:17155:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000100:00100000:1.0:1788528559.414378:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735527168:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1788528559.414380:0:17155:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788528559.414382:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788528559.414394:0:17155:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8a90f6c4b300) 00000020:00000080:2.0:1788528559.414404:0:17155:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788528559.414408:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1788528559.414455:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788528559.414614:0:17155:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788528559.414623:0:17155:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788528559.414630:0:17155:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x892c60dda91c8b8e 00010000:00080000:2.0:1788528559.414656:0:17155:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a8fc1d08800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:2.0:1788528559.414862:0:17155:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1788528559.415022:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735527168 00000100:00100000:0.0:1788528559.415031:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735527168 00000100:00100000:0.0:1788528559.415072:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788528559.415080:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1875407735527168:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1788528559.415094:0:17142:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788528559.415143:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1875407735527168:12345-0@lo:38:llog_process_th.0 Request processed in 62us (687us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788528559.415151:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788528559.415190:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90de3f0800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788528559.415195:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788528559.415199:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735527168:0@lo:38:llog_process_th.0 00000040:01000000:2.0:1788528559.416362:0:17155:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788528559.417894:0:17155:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788528559.420141:0:17155:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788528559.421666:0:17155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788528559.431077:0:17155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788528559.432274:0:17161:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788528559.432280:0:17161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788528559.433023:0:17155:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788528559.433035:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788528559.433079:0:17155:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788528559.433099:0:17155:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x892c60dda91c8b95 00000100:00080000:2.0:1788528559.433109:0:17155:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788528559.433115:0:17155:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a8fc1d08800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1788528559.433154:0:17155:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90f6da1500 x1875407735527296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788528559.433181:0:17155:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1788528559.433221:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735527296:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788528559.433278:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875407735527296 offset 0 length 520: 4 00000020:01000000:2.0:1788528559.433374:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788528559.433379:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528559.433381:0:17155:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788528559.433384:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788528559.433387:0:17155:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1788528559.433389:0:17155:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788528559.433390:0:17155:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788528559.433391:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788528559.433393:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528559.433395:0:17155:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788528559.433397:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788528559.433400:0:17155:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788528559.433403:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528559.433404:0:17155:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788528559.433406:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788528559.433410:0:17155:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:2.0:1788528559.433674:0:17155:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788528559.433684:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788528559.433705:0:17155:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8a90f7de8000) 00000020:00000080:2.0:1788528559.433718:0:17155:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1788528559.433722:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788528559.433784:0:17155:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788528559.433789:0:17155:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788528559.433794:0:17155:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x892c60dda91c8ba3 00010000:00080000:2.0:1788528559.433827:0:17155:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a90de3f4000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:3.0:1788528559.436834:0:17155:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788528559.436908:0:17155:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788528559.436923:0:17155:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788528559.439013:0:17155:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788528559.439185:0:17155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788528559.439669:0:17155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1788528559.442673:0:17163:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788528559.442680:0:17163:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788528559.443514:0:17155:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788528559.443528:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788528559.443650:0:17155:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788528559.443670:0:17155:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x892c60dda91c8baa 00000100:00080000:0.0:1788528559.443680:0:17155:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788528559.443686:0:17155:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a90de3f4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1788528559.443721:0:17155:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc4674380 x1875407735527424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788528559.443778:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735527424:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788528559.443833:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875407735527424 offset 0 length 520: 4 00000100:00080000:0.0:1788528559.443881:0:17155:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788528559.443983:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528559.443989:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528559.443990:0:17155:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788528559.443993:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788528559.443997:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528559.443998:0:17155:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788528559.444001:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788528559.444002:0:17155:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788528559.444004:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528559.444006:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528559.444007:0:17155:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788528559.444009:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788528559.444011:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528559.444012:0:17155:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788528559.444015:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788528559.444040:0:17155:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:463b8984-c30b-4b73-b2f1-81113bd4e10a:17155:1875407735527552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788528559.444089:0:17155:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528559.444122:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735527552 00000100:00100000:0.0:1788528559.444127:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735527552 00000100:00100000:0.0:1788528559.444160:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788528559.444176:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+9:17155:x1875407735527552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788528559.444280:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+9:17155:x1875407735527552:12345-0@lo:502:llog_process_th.0 Request processed in 104us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528559.444287:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788528559.444334:0:17155:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cd540 going to sleep for 11 seconds 00000100:00100000:0.0:1788528559.444353:0:17155:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:463b8984-c30b-4b73-b2f1-81113bd4e10a:17155:1875407735527552:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788528559.444374:0:17155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528559.444378:0:17155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528559.444379:0:17155:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788528559.444382:0:17155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788528559.444433:0:17116:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788528559.444443:0:17116:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788528559.444457:0:17116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0031600/0x892c60dda91c8b1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8b25 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.444467:0:17116:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c0031600/0x892c60dda91c8b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8b25 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528559.444475:0:17116:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff8a8fc477d800 from 1 10000000:01000000:0.0:1788528559.444478:0:17116:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788528559.444503:0:17116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8bb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.444511:0:17116:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8bb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.444520:0:17116:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8bb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528559.444542:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735527680:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788528559.444596:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528559.444617:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cd540 going to sleep for 11 seconds 00000100:00100000:0.0:1788528559.446136:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735527680 00000100:00100000:0.0:1788528559.446147:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735527680 00000100:00100000:0.0:1788528559.446190:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788528559.446197:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+9:17116:x1875407735527680:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788528559.446211:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528559.446228:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c0030a00/0x892c60dda91c8bb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8bb1 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.446252:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c0030a00/0x892c60dda91c8bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8bb1 expref: 10 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.446262:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c0030a00/0x892c60dda91c8bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8bb1 expref: 10 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.446269:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0030a00, rc 0) 00000100:00100000:0.0:1788528559.446337:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+10:17116:x1875407735527680:12345-0@lo:101:mount.lustre.0 Request processed in 139us (1740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528559.446343:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788528559.446388:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735527680:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788528559.446403:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8bb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8bb8 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.446412:0:17116:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8bb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8bb8 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528559.446983:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735527808:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788528559.447026:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528559.447056:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cd540 going to sleep for 11 seconds 00000100:00100000:0.0:1788528559.447075:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735527808 00000100:00100000:0.0:1788528559.447079:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735527808 00000100:00100000:0.0:1788528559.447103:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788528559.447108:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+10:17116:x1875407735527808:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788528559.447123:0:17131:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788528559.447128:0:17131:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788528559.447181:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+10:17116:x1875407735527808:12345-0@lo:256:mount.lustre.0 Request processed in 73us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528559.447187:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788528559.447218:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735527808:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788528559.449298:0:17116:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788528559.449450:0:17116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8bb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8bb8 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.449465:0:17116:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8bb8 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528559.449474:0:17116:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a8fc477d800 from 1 10000000:01000000:0.0:1788528559.449478:0:17116:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788528559.449614:0:17116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8bbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.449624:0:17116:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8bbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.449645:0:17116:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8bbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528559.449668:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735527936:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788528559.449729:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528559.449764:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cd540 going to sleep for 11 seconds 00000100:00100000:1.0:1788528559.449889:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735527936 00000100:00100000:1.0:1788528559.449896:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735527936 00000100:00100000:1.0:1788528559.449937:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788528559.449944:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+10:17116:x1875407735527936:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788528559.449956:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528559.449971:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c1551800/0x892c60dda91c8bc6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8bbf expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528559.449998:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c1551800/0x892c60dda91c8bc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8bbf expref: 11 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528559.450008:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c1551800/0x892c60dda91c8bc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8bbf expref: 11 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528559.450026:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c1551800, rc 0) 00000100:00100000:1.0:1788528559.450058:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+11:17116:x1875407735527936:12345-0@lo:101:mount.lustre.0 Request processed in 115us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528559.450064:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788528559.450382:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735527936:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788528559.450462:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8bbf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8bc6 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.450470:0:17116:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8bbf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8bc6 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528559.450609:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735528064:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788528559.450639:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528559.450659:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cd540 going to sleep for 11 seconds 00000100:00100000:1.0:1788528559.450784:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735528064 00000100:00100000:1.0:1788528559.450789:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735528064 00000100:00100000:1.0:1788528559.450824:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788528559.450830:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+11:17116:x1875407735528064:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788528559.450958:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+11:17116:x1875407735528064:12345-0@lo:501:mount.lustre.0 Request processed in 127us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528559.450965:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788528559.451065:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735528064:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788528559.451090:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735528192:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788528559.451126:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528559.451146:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cd540 going to sleep for 11 seconds 00000100:00100000:1.0:1788528559.451186:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735528192 00000100:00100000:1.0:1788528559.451190:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735528192 00000100:00100000:1.0:1788528559.451216:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788528559.451221:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+11:17116:x1875407735528192:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788528559.451297:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+11:17116:x1875407735528192:12345-0@lo:503:mount.lustre.0 Request processed in 75us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528559.451313:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788528559.451463:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735528192:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788528559.451936:0:17165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:463b8984-c30b-4b73-b2f1-81113bd4e10a:17165:1875407735528320:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788528559.451977:0:17165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528559.452039:0:17165:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cd900 going to sleep for 11 seconds 00000100:00100000:1.0:1788528559.452213:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735528320 00000100:00100000:1.0:1788528559.452219:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735528320 00000100:00100000:1.0:1788528559.452276:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788528559.452284:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+11:17165:x1875407735528320:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788528559.453188:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+11:17165:x1875407735528320:12345-0@lo:502:llog_process_th.0 Request processed in 902us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528559.453197:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788528559.453302:0:17165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:463b8984-c30b-4b73-b2f1-81113bd4e10a:17165:1875407735528320:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788528559.453340:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788528559.453349:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528559.453351:0:17165:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788528559.453358:0:17165:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a8fc477d800 00000020:00000080:0.0:1788528559.453360:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788528559.453367:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528559.453370:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528559.453371:0:17165:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788528559.453374:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788528559.453376:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528559.453377:0:17165:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788528559.453380:0:17165:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a8fc477d800 00000020:00000080:0.0:1788528559.453382:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788528559.453630:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528559.453634:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528559.453636:0:17165:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788528559.453638:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788528559.453640:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528559.453641:0:17165:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788528559.453644:0:17165:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a8fc477d800 00000020:00000080:0.0:1788528559.453646:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788528559.456574:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528559.456611:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528559.456613:0:17165:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788528559.456619:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788528559.456623:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528559.456624:0:17165:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788528559.456629:0:17165:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a8fc477d800 00000020:00000080:0.0:1788528559.456632:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788528559.456714:0:17165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:463b8984-c30b-4b73-b2f1-81113bd4e10a:17165:1875407735528448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788528559.456793:0:17165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528559.456842:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735528448 00000100:00100000:0.0:1788528559.456849:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735528448 00000100:00100000:0.0:1788528559.456894:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788528559.456901:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+11:17165:x1875407735528448:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788528559.457003:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+11:17165:x1875407735528448:12345-0@lo:502:llog_process_th.0 Request processed in 101us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528559.457010:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788528559.457054:0:17165:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cd900 going to sleep for 11 seconds 00000100:00100000:0.0:1788528559.457073:0:17165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:463b8984-c30b-4b73-b2f1-81113bd4e10a:17165:1875407735528448:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788528559.457094:0:17165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528559.457098:0:17165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528559.457099:0:17165:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788528559.457102:0:17165:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788528559.457421:0:17116:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788528559.457431:0:17116:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788528559.457454:0:17116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8bbf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8bc6 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528559.457465:0:17116:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8bbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8bc6 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528559.457527:0:17116:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788528559.457531:0:17116:0:(mgc_request.c:423:config_log_add()) add config log lustre-client-ffff8a8fc477d800 10000000:01000000:1.0:1788528559.457534:0:17116:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff8a8fc477d800 10000000:01000000:1.0:1788528559.457538:0:17116:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788528559.457587:0:17116:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff8a8fc477d800 from 1 10000000:01000000:1.0:1788528559.457591:0:17116:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788528559.457619:0:17116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c1551a00/0x892c60dda91c8bcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528559.457627:0:17116:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c1551a00/0x892c60dda91c8bcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528559.457636:0:17116:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c1551a00/0x892c60dda91c8bcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528559.457649:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735528576:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788528559.457679:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528559.457694:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16ac480 going to sleep for 11 seconds 00000100:00100000:1.0:1788528559.457710:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735528576 00000100:00100000:1.0:1788528559.457714:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735528576 00000100:00100000:1.0:1788528559.457738:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788528559.457744:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+11:17116:x1875407735528576:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788528559.457762:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528559.457773:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c1551e00/0x892c60dda91c8bd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8bcd expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528559.457794:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c1551e00/0x892c60dda91c8bd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8bcd expref: 12 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528559.457804:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c1551e00/0x892c60dda91c8bd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8bcd expref: 12 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528559.457812:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c1551e00, rc 0) 00000100:00100000:1.0:1788528559.457836:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+12:17116:x1875407735528576:12345-0@lo:101:mount.lustre.0 Request processed in 92us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528559.457842:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788528559.457872:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735528576:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788528559.457883:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c1551a00/0x892c60dda91c8bcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8bd4 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528559.457892:0:17116:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c1551a00/0x892c60dda91c8bcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8bd4 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528559.457916:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735528704:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788528559.457935:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528559.457944:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16ac480 going to sleep for 11 seconds 00000100:00100000:0.0:1788528559.458155:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735528704 00000100:00100000:0.0:1788528559.458159:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735528704 00000100:00100000:0.0:1788528559.458181:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788528559.458186:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+12:17116:x1875407735528704:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788528559.458279:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+12:17116:x1875407735528704:12345-0@lo:501:mount.lustre.0 Request processed in 92us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528559.458286:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788528559.458373:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735528704:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788528559.458460:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735528832:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788528559.458584:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528559.458611:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16ac480 going to sleep for 11 seconds 00000100:00100000:0.0:1788528559.459372:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735528832 00000100:00100000:0.0:1788528559.459380:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735528832 00000100:00100000:0.0:1788528559.459591:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788528559.459600:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+12:17116:x1875407735528832:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788528559.459722:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+12:17116:x1875407735528832:12345-0@lo:503:mount.lustre.0 Request processed in 124us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528559.459730:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788528559.459846:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735528832:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788528559.462712:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:463b8984-c30b-4b73-b2f1-81113bd4e10a:17168:1875407735528960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788528559.462792:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528559.462835:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735528960 00000100:00100000:0.0:1788528559.462841:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735528960 00000100:00100000:0.0:1788528559.462883:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788528559.462891:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+12:17168:x1875407735528960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788528559.463012:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+12:17168:x1875407735528960:12345-0@lo:502:llog_process_th.0 Request processed in 120us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528559.463020:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788528559.463075:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528559.463097:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:463b8984-c30b-4b73-b2f1-81113bd4e10a:17168:1875407735528960:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788528559.463156:0:17168:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788528559.463172:0:17168:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8a910195e600) 00000020:00000080:0.0:1788528559.463191:0:17168:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1788528559.463281:0:17168:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a8fc477d800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788528559.463285:0:17168:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8a8fc477d800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788528559.463288:0:17168:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a8fc477d800 4 00010000:00080000:0.0:1788528559.463331:0:17168:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a90d0053800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:0.0:1788528559.471979:0:17168:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1788528559.472176:0:17168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788528559.472216:0:17168:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788528559.472229:0:17168:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x892c60dda91c8be2 00000100:00080000:0.0:1788528559.472239:0:17168:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788528559.472245:0:17168:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a90d0053800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1788528559.472279:0:17168:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc4675500 x1875407735529088/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788528559.472336:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875407735529088:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788528559.472410:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788528559.472469:0:17168:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788528559.476781:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:463b8984-c30b-4b73-b2f1-81113bd4e10a:17168:1875407735529216:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788528559.476866:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528559.476908:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735529216 00000100:00100000:0.0:1788528559.476915:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735529216 00000100:00100000:0.0:1788528559.476953:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788528559.476961:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+12:17168:x1875407735529216:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788528559.477069:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+12:17168:x1875407735529216:12345-0@lo:502:llog_process_th.0 Request processed in 107us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528559.477076:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788528559.477128:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528559.477148:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:463b8984-c30b-4b73-b2f1-81113bd4e10a:17168:1875407735529216:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788528559.477187:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:463b8984-c30b-4b73-b2f1-81113bd4e10a:17168:1875407735529344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788528559.477214:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528559.477232:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735529344 00000100:00100000:0.0:1788528559.477235:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735529344 00000100:00100000:0.0:1788528559.477255:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788528559.477260:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+12:17168:x1875407735529344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788528559.477326:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+12:17168:x1875407735529344:12345-0@lo:502:llog_process_th.0 Request processed in 64us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528559.477332:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788528559.477358:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528559.477369:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:463b8984-c30b-4b73-b2f1-81113bd4e10a:17168:1875407735529344:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788528559.477384:0:17168:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000100:00100000:2.0:1788528559.477710:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735529088 00000100:00100000:2.0:1788528559.477716:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735529088 00000100:00100000:2.0:1788528559.477747:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788528559.477752:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1875407735529088:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788528559.477807:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1875407735529088:12345-0@lo:38:llog_process_th.0 Request processed in 54us (5398us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788528559.477812:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788528559.480823:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788528559.480833:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90d0053800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788528559.480839:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788528559.480849:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875407735529088:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1788528559.481624:0:17116:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788528559.481640:0:17116:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788528559.481663:0:17116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c1551a00/0x892c60dda91c8bcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8bd4 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528559.481675:0:17116:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c1551a00/0x892c60dda91c8bcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8bd4 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788528559.481739:0:17116:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788528559.481741:0:17116:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788528559.481743:0:17116:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788528559.481744:0:17116:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788528559.481745:0:17116:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788528559.481746:0:17116:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788528559.481748:0:17116:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788528559.481749:0:17116:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788528559.481751:0:17116:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788528559.481752:0:17116:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788528559.481756:0:17116:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788528559.481758:0:17116:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788528559.481760:0:17116:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788528559.481761:0:17116:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788528559.481762:0:17116:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788528559.481763:0:17116:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788528559.481764:0:17116:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788528559.481765:0:17116:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788528559.481766:0:17116:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788528559.481767:0:17116:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788528559.481768:0:17116:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788528559.481792:0:17116:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788528559.481810:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735529472:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788528559.481874:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528559.481909:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1c59000 going to sleep for 11 seconds 00000100:00100000:0.0:1788528559.484688:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735529472 00000100:00100000:0.0:1788528559.484704:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735529472 00000100:00100000:0.0:1788528559.484760:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788528559.484767:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+12:17116:x1875407735529472:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788528559.484798:0:17130:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788528559.484812:0:17130:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788528559.492223:0:17130:0:(mgs_nids.c:820:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788528559.492236:0:17130:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788528559.492464:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+12:17116:x1875407735529472:12345-0@lo:253:mount.lustre.0 Request processed in 7692us (10586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528559.492475:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 20000000:01000000:3.0:1788528559.492961:0:17153:0:(mgs_nids.c:717:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788528559.492972:0:17153:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788528559.492991:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a8fc3428200/0x892c60dda91c8be9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528559.493006:0:17153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c0030a00/0x892c60dda91c8bb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8bb1 expref: 11 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528559.493013:0:17153:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a8fc3428200/0x892c60dda91c8be9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528559.493048:0:17153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c0030a00/0x892c60dda91c8bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c8bb1 expref: 11 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528559.493061:0:17153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a90c0030a00/0x892c60dda91c8bb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c8bb1 expref: 11 pid: 17132 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528559.493073:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17153:1875407735529600:0@lo:104: 00000100:00100000:3.0:1788528559.493111:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528559.493140:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1c59480 going to sleep for 11 seconds 00000100:00100000:3.0:1788528559.493172:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17116:1875407735529472:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788528559.493181:0:17116:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788528559.493184:0:17116:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788528559.493185:0:17116:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788528559.493186:0:17116:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788528559.493187:0:17116:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788528559.493189:0:17116:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788528559.493190:0:17116:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788528559.493191:0:17116:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788528559.493192:0:17116:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788528559.493194:0:17116:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788528559.493195:0:17116:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788528559.493208:0:17116:0:(tgt_mount.c:2815:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788528559.494479:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735529600 00000100:00100000:2.0:1788528559.494490:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735529600 00000100:00100000:2.0:1788528559.495725:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788528559.495734:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:463b8984-c30b-4b73-b2f1-81113bd4e10a+3:17153:x1875407735529600:12345-0@lo:104: 00010000:00010000:2.0:1788528559.495752:0:17120:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c8bb8 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528559.495825:0:17120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788528559.495830:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:463b8984-c30b-4b73-b2f1-81113bd4e10a+3:17153:x1875407735529600:12345-0@lo:104: Request processed in 98us (2719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528559.495837:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788528559.496116:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17153:1875407735529600:0@lo:104: 00010000:00010000:2.0:1788528559.496139:0:17153:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a8fc3428200/0x892c60dda91c8be9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528559.498680:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528559.498692:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c8bb8 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528559.498702:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030600 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528559.498706:0:17126:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c8bb8 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528559.498716:0:17126:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c8bb8 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528559.498722:0:17126:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c8bb8 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528559.498727:0:17126:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788528559.499138:0:17126:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8bb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8bb8 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528559.499145:0:17126:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528559.499172:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8bb1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8bb8 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528559.499179:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8bb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8bb8 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528559.499197:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528559.499198:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528559.499200:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528559.501923:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:463b8984-c30b-4b73-b2f1-81113bd4e10a:3639:1875407735529728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788528559.501994:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528559.502095:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735529728 00000100:00100000:0.0:1788528559.502102:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735529728 00010000:00010000:0.0:1788528559.502131:0:17122:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c0030a00/0x892c60dda91c8bb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c8bb1 expref: 12 pid: 17132 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528559.502158:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788528559.502165:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4677100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:463b8984-c30b-4b73-b2f1-81113bd4e10a+12:3639:x1875407735529728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788528559.502177:0:17122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528559.502181:0:17122:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c0030a00/0x892c60dda91c8bb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c8bb1 expref: 12 pid: 17132 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.502192:0:17122:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c0030a00/0x892c60dda91c8bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c8bb1 expref: 12 pid: 17132 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.502207:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c0030a00/0x892c60dda91c8bb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c8bb1 expref: 12 pid: 17132 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.502233:0:17122:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a8fc3428200/0x892c60dda91c8be9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.502241:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc3428200/0x892c60dda91c8be9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788528559.502257:0:17122:0:(mgs_nids.c:693:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009285697s 00010000:00010000:0.0:1788528559.502262:0:17122:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a8fc3428200/0x892c60dda91c8be9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.502268:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a8fc3428200/0x892c60dda91c8be9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.502274:0:17122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a8fc3428200/0x892c60dda91c8be9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.502282:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a8fc3428200/0x892c60dda91c8be9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.502288:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428200 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528559.502292:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a8fc3428200/0x892c60dda91c8be9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.502300:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a8fc3428200/0x892c60dda91c8be9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.502330:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a8fc3428200/0x892c60dda91c8be9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.502340:0:17122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528559.502381:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4677100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:463b8984-c30b-4b73-b2f1-81113bd4e10a+11:3639:x1875407735529728:12345-0@lo:103:ldlm_bl.0 Request processed in 216us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528559.502399:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788528559.502427:0:17153:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a8fc3428200/0x892c60dda91c8be9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.502435:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a8fc3428200/0x892c60dda91c8be9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528559.502441:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc3428200/0x892c60dda91c8be9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528559.502474:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:463b8984-c30b-4b73-b2f1-81113bd4e10a:3639:1875407735529728:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788528559.540479:0:17116:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1788528559.540947:0:17116:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788528559.541112:0:17177:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1788528559.541115:0:17177:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1788528559.541173:0:17178:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1788528559.541796:0:17178:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788528559.543704:0:17116:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1788528559.544863:0:17178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788528559.544926:0:17178:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:0.0:1788528559.547081:0:17116:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788528559.547122:0:17116:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788528559.547928:0:17116:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788528559.547939:0:17116:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788528559.547985:0:17116:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788528559.549150:0:17116:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788528559.550112:0:17116:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788528559.550156:0:17116:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000100:00080000:1.0:1788528559.550691:0:17179:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8a8fc44c5180 x1875407735529856/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528559.550704:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16ac240 going to sleep for 0 seconds 00080000:10000000:1.0:1788528559.555365:0:17116:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1788528559.558180:0:17116:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788528559.559916:0:17116:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788528559.559949:0:17116:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9b7a01c3b9b8 00100000:10000000:1.0:1788528559.559957:0:17116:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788528559.564541:0:17116:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788528559.564588:0:17116:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788528559.565543:0:17116:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788528559.565761:0:17116:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788528560.068712:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788528560.256269:0:17134:0:(mgc_request.c:714:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788528560.256277:0:17134:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff8a8fc477d800 from 7 10000000:01000000:0.0:1788528560.256283:0:17134:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788528560.256354:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c8bf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528560.256367:0:17134:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c8bf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528560.256378:0:17134:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c8bf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528560.256404:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735529984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788528560.256469:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528560.256518:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3a949c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528560.257350:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735529984 00000100:00100000:1.0:1788528560.257360:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735529984 00000100:00100000:1.0:1788528560.257418:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788528560.257427:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+11:17134:x1875407735529984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788528560.257440:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528560.257455:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c1550600/0x892c60dda91c8bf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8bf0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528560.257477:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c1550600/0x892c60dda91c8bf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8bf0 expref: 12 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528560.257488:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c1550600/0x892c60dda91c8bf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8bf0 expref: 12 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528560.257497:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c1550600, rc 0) 00000100:00100000:1.0:1788528560.257546:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+12:17134:x1875407735529984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528560.257573:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788528560.257626:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735529984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788528560.257641:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c8bf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8bf7 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528560.257650:0:17134:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c8bf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8bf7 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528560.257698:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735530112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788528560.257728:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528560.257746:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f8db7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788528560.257805:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735530112 00000100:00100000:0.0:1788528560.257810:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735530112 00000100:00100000:0.0:1788528560.257838:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788528560.257845:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+12:17134:x1875407735530112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788528560.257857:0:17132:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788528560.257871:0:17132:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788528560.257874:0:17132:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788528560.257938:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+12:17134:x1875407735530112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 93us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528560.257945:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788528560.258140:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735530112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788528560.258196:0:17134:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788528560.258204:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c8bf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8bf7 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528560.258212:0:17134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c8bf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8bf7 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788528560.513359:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788528560.575381:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16ac240 going to sleep for 0 seconds 00010000:00010000:1.0:1788528561.100595:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788528561.535186:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788528561.605145:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16ac240 going to sleep for 0 seconds 00010000:00010000:0.0:1788528562.112853:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528562.623048:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16ac240 going to sleep for 0 seconds 00010000:00010000:1.0:1788528563.141931:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528563.647392:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16ac240 going to sleep for 0 seconds 00010000:00010000:0.0:1788528564.160212:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788528564.352854:0:17422:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788528564.670727:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16ac240 going to sleep for 0 seconds 00000100:00100000:0.0:1788528564.929766:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:463b8984-c30b-4b73-b2f1-81113bd4e10a:3640:1875407735530240:0@lo:400:kworker.0 00000100:00100000:0.0:1788528564.929893:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528564.930127:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735530240 00000100:00100000:3.0:1788528564.930146:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735530240 00000100:00100000:3.0:1788528564.930190:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788528564.930200:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+12:3640:x1875407735530240:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788528564.931891:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788528564.931899:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788528564.931903:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a90de3f0800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788528564.931909:0:469:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 428 00000100:00080000:1.0:1788528564.931914:0:469:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788528564.931920:0:469:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a90de3f0800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1788528564.931951:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc44c5500 x1875407735530368/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788528564.931978:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788528564.931982:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788528564.931985:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788528564.931987:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788528564.931989:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788528564.931992:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788528564.931994:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a90d0053800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788528564.931999:0:469:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a90d0053800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1788528564.932012:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc44c7800 x1875407735530496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788528564.932047:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735530368:0@lo:38:kworker.0 00000100:00100000:1.0:1788528564.932296:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528564.932330:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875407735530496:0@lo:38:kworker.0 00000100:00100000:1.0:1788528564.932363:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528564.932420:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735530368 00000100:00100000:1.0:1788528564.932427:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735530368 00000100:00100000:1.0:1788528564.932458:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788528564.932464:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1875407735530368:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788528564.932484:0:17142:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788528564.933524:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735530496 00000100:00100000:2.0:1788528564.933533:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735530496 00000100:00100000:2.0:1788528564.933576:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788528564.933582:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1875407735530496:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788528564.933605:0:17139:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:2.0:1788528564.933638:0:17139:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x892c60dda91c8bfe 00000004:00100000:2.0:1788528564.933652:0:17139:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788528564.933777:0:17139:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1f91000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788528564.934332:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875407735530496:12345-0@lo:38:kworker.0 Request processed in 747us (1965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528564.934341:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788528564.936549:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a8fc44c7800 x1875407735530496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788528574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788528564.936587:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788528564.936598:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788528564.936605:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788528564.936608:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90d0053800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788528564.936617:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875407735530496:0@lo:38:kworker.0 00000100:00100000:3.0:1788528564.942344:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+12:3640:x1875407735530240:12345-0@lo:400:kworker.0 Request processed in 12135us (12441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528564.942358:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788528564.942686:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:463b8984-c30b-4b73-b2f1-81113bd4e10a:3640:1875407735530240:0@lo:400:kworker.0 00000100:00100000:1.0:1788528564.961705:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1875407735530368:12345-0@lo:38:kworker.0 Request processed in 29230us (29400us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788528564.961720:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788528564.961779:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90de3f0800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788528564.961815:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788528564.961820:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735530368:0@lo:38:kworker.0 00010000:00010000:1.0:1788528565.183547:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788528565.394323:0:17474:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788528565.394765:0:17474:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788528565.703085:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16ac240 going to sleep for 0 seconds 00010000:00010000:2.0:1788528566.206690:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788528566.335324:0:17524:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788528566.335544:0:17524:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788528566.718669:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16ac240 going to sleep for 0 seconds 00010000:00010000:1.0:1788528567.230738:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528567.742951:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16ac240 going to sleep for 0 seconds 00010000:00010000:2.0:1788528568.255307:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528568.769707:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16ac240 going to sleep for 0 seconds 00000100:00100000:0.0:1788528569.029979:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788528559/real 1788528559] req@ffff8a8fc4674380 x1875407735527424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528569 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528569.030007:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a8fc4674380 x1875407735527424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528569 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528569.030017:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788528559/real 1788528559] req@ffff8a90f6da1500 x1875407735527296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528569 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528569.030029:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a90f6da1500 x1875407735527296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528569 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788528569.030048:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90de3f4000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788528569.030070:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788528569.030074:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735527424:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788528569.030080:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d08800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788528569.030085:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788528569.030087:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735527296:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788528569.030234:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788528569.030249:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788528569.030251:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a90de3f0800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788528569.030256:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 434 00000100:00080000:3.0:1788528569.030261:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788528569.030269:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a90de3f0800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528569.030288:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90f58c1180 x1875407735530752/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788528569.030290:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:463b8984-c30b-4b73-b2f1-81113bd4e10a:3637:1875407735530624:0@lo:400:kworker.0 00000100:00080000:3.0:1788528569.030301:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528569.030303:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788528569.030305:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d08800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788528569.030308:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 428 00000100:00080000:3.0:1788528569.030310:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788528569.030312:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a8fc1d08800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528569.030321:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90f58c2680 x1875407735530880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788528569.030336:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528569.030339:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788528569.030341:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a90de3f4000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788528569.030344:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 428 00000100:00080000:3.0:1788528569.030346:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788528569.030349:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a90de3f4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528569.030359:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90f58c2d80 x1875407735531008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788528569.030402:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528569.030408:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735531136:0@lo:400:kworker.0 00000100:00100000:3.0:1788528569.030437:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528569.030465:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735530624 00000100:00100000:3.0:1788528569.030472:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735531136 00000100:00100000:0.0:1788528569.030473:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735530624 00000100:00100000:3.0:1788528569.030475:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735531136 00000100:00100000:0.0:1788528569.030509:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788528569.030510:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788528569.030517:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735531136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528569.030517:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+12:3637:x1875407735530624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528569.030577:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735531136:12345-0@lo:400:kworker.0 Request processed in 60us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528569.030577:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+12:3637:x1875407735530624:12345-0@lo:400:kworker.0 Request processed in 60us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528569.030584:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788528569.030588:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788528569.030615:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735530752:0@lo:38:kworker.0 00010000:00080000:3.0:1788528569.030618:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a90f58c1f80 x1875407735531136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528569.030629:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735531136:0@lo:400:kworker.0 00000100:00100000:0.0:1788528569.030640:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528569.030661:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735530880:0@lo:8:kworker.0 00000100:00100000:3.0:1788528569.030670:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735530752 00000100:00100000:3.0:1788528569.030673:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735530752 00000400:00000100:0.0:1788528569.030677:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875407735530880 offset 0 length 520: 4 00000100:00100000:3.0:1788528569.030691:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788528569.030693:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735531008:0@lo:8:kworker.0 00000400:00000100:0.0:1788528569.030712:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875407735531008 offset 0 length 520: 4 00000100:00100000:0.0:1788528569.030739:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:463b8984-c30b-4b73-b2f1-81113bd4e10a:3637:1875407735530624:0@lo:400:kworker.0 00000100:00100000:3.0:1788528569.030826:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1875407735530752:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788528569.030917:0:17143:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788528569.067624:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1875407735530752:12345-0@lo:38:kworker.0 Request processed in 36917us (36972us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788528569.067639:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788528569.067697:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90de3f0800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788528569.067702:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788528569.067706:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735530752:0@lo:38:kworker.0 00010000:00010000:1.0:1788528569.279853:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528569.793492:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16ac240 going to sleep for 0 seconds 00010000:00010000:2.0:1788528570.303742:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528570.816512:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16ac240 going to sleep for 0 seconds 00010000:00010000:3.0:1788528571.327659:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788528571.778047:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788528571.838644:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16ac240 going to sleep for 0 seconds 00010000:00010000:0.0:1788528572.351017:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528572.864286:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16ac240 going to sleep for 0 seconds 00010000:00010000:3.0:1788528573.378411:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788528573.776655:0:17869:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:0.0:1788528573.776659:0:17869:0:(obd_mount.c:928:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788528573.776661:0:17869:0:(obd_mount.c:931:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788528573.777157:0:17869:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a90f6c03000 00000020:01000004:0.0:1788528573.777173:0:17869:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1788528573.777184:0:17869:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788528573.777198:0:17869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8a910195cc80) 00000020:00000080:0.0:1788528573.777224:0:17869:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00000100:00100000:0.0:1788528573.886894:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16ac240 going to sleep for 0 seconds 00100000:10000000:2.0:1788528573.915289:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788528573.920147:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788528573.923294:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788528573.923878:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1788528573.925409:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788528573.935264:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1788528573.935811:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1788528573.936242:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788528573.936656:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788528573.936872:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788528573.937221:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788528573.937520:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788528573.938230:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788528573.938514:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788528573.944103:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788528573.944868:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1788528573.945309:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788528573.945737:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1788528573.946028:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788528573.946393:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788528573.951508:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788528573.952183:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788528573.953021:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788528573.955972:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788528573.957387:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788528573.959123:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788528573.959720:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788528573.960197:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1788528573.960733:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1788528573.961179:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788528573.961401:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788528573.962682:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788528573.968714:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1788528573.969039:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788528573.969385:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1788528573.970181:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788528573.970914:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788528573.972245:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1788528573.972836:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1788528573.973217:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1788528573.973550:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788528573.973829:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1788528573.974314:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788528573.975038:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788528573.975826:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788528573.976268:0:17869:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00080000:01000000:0.0:1788528573.980948:0:17869:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788528573.981809:0:17869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788528573.981823:0:17869:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788528573.981838:0:17869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x892c60dda91c8c0c 00000020:01000004:0.0:1788528573.981847:0:17869:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788528573.981870:0:17869:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.138@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788528573.981873:0:17869:0:(mgc_request.c:1317:mgc_set_info_async()) InitRecov MGC192.168.203.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788528573.981879:0:17869:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1788528573.982009:0:17869:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.138@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1788528573.982013:0:17869:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788528573.982014:0:17869:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788528573.982015:0:17869:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788528573.982017:0:17869:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788528573.982018:0:17869:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788528573.982019:0:17869:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788528573.982021:0:17869:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788528573.982023:0:17869:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788528573.982024:0:17869:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788528573.982027:0:17869:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1788528573.982030:0:17869:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788528573.982035:0:17869:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788528573.982036:0:17869:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788528573.982037:0:17869:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788528573.982038:0:17869:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788528573.982039:0:17869:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788528573.982040:0:17869:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788528573.982041:0:17869:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788528573.982042:0:17869:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788528573.982065:0:17869:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788528573.982141:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735531264:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788528573.982219:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528573.982356:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3eb4300 going to sleep for 11 seconds 00000100:00100000:1.0:1788528573.982901:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735531264 00000100:00100000:1.0:1788528573.982910:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735531264 00000100:00100000:3.0:1788528573.983337:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788528573.983349:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+12:17869:x1875407735531264:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788528573.983381:0:17130:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788528573.983385:0:17130:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1788528573.983391:0:17130:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788528573.984394:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+12:17869:x1875407735531264:12345-0@lo:253:mount.lustre.0 Request processed in 1044us (2172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528573.984405:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788528573.984522:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735531264:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788528573.984536:0:17869:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788528573.984538:0:17869:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788528573.984540:0:17869:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788528573.984541:0:17869:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788528573.984542:0:17869:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788528573.984543:0:17869:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788528573.984545:0:17869:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788528573.984546:0:17869:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788528573.984548:0:17869:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788528573.984549:0:17869:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788528573.984591:0:17869:0:(tgt_mount.c:115:server_register_mount()) register mount ffff8a90f6c03000 from lustre-MDT0001 10000000:01000000:1.0:1788528573.984623:0:17869:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1788528573.984625:0:17869:0:(mgc_request.c:423:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788528573.984632:0:17869:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8a90f6c03000 10000000:01000000:1.0:1788528573.984638:0:17869:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788528573.984659:0:17869:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-MDT0001-osd 00000040:01000000:2.0:1788528573.994838:0:17869:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788528574.003826:0:17869:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788528574.003843:0:17869:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff8a90f6c03000 from 1 10000000:01000000:2.0:1788528574.003847:0:17869:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788528574.003885:0:17869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101850e00/0x892c60dda91c8c13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528574.003896:0:17869:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a9101850e00/0x892c60dda91c8c13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528574.003907:0:17869:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a9101850e00/0x892c60dda91c8c13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528574.003929:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735531392:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788528574.003988:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528574.004064:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9101848b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788528574.009189:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735531392 00000100:00100000:0.0:1788528574.009214:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735531392 00000100:00100000:2.0:1788528574.011908:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788528574.012004:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+12:17869:x1875407735531392:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788528574.012030:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528574.012052:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9101851600/0x892c60dda91c8c1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8c13 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528574.012528:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101851600/0x892c60dda91c8c1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8c13 expref: 13 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528574.012629:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9101851600/0x892c60dda91c8c1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8c13 expref: 13 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528574.012639:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101851600, rc 0) 00000100:00100000:2.0:1788528574.012711:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+13:17869:x1875407735531392:12345-0@lo:101:mount.lustre.0 Request processed in 713us (8723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528574.012813:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735531392:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788528574.012833:0:17869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a9101850e00/0x892c60dda91c8c13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8c1a expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528574.012842:0:17869:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a9101850e00/0x892c60dda91c8c13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8c1a expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528574.012931:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735531520:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788528574.012973:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528574.013003:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d61c4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788528574.019391:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735531520 00000100:00100000:3.0:1788528574.019406:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735531520 00000100:00100000:2.0:1788528574.024152:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788528574.026030:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788528574.026052:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+13:17869:x1875407735531520:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788528574.026218:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+13:17869:x1875407735531520:12345-0@lo:501:mount.lustre.0 Request processed in 166us (13233us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788528574.026226:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788528574.026268:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735531520:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788528574.026293:0:17869:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.203.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:3.0:1788528574.026636:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735531648:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788528574.026671:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528574.026703:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735531648 00000100:00100000:3.0:1788528574.026708:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de3eb000 going to sleep for 11 seconds 00000100:00100000:2.0:1788528574.026710:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735531648 00000100:00100000:0.0:1788528574.026893:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788528574.026984:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+13:17869:x1875407735531648:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788528574.027057:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+13:17869:x1875407735531648:12345-0@lo:501:mount.lustre.0 Request processed in 156us (385us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788528574.027064:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788528574.027224:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735531648:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788528574.027250:0:17869:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788528574.027272:0:17869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101850e00/0x892c60dda91c8c13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8c1a expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.027282:0:17869:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a9101850e00/0x892c60dda91c8c13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8c1a expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528574.027292:0:17869:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff8a90f6c03000 10000000:01000000:0.0:1788528574.027298:0:17869:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788528574.027319:0:17869:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-MDT0001-osd 00000040:01000000:0.0:1788528574.027405:0:17869:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788528574.027421:0:17869:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788528574.027428:0:17869:0:(mgc_request.c:206:do_config_log_add()) do adding config log nodemap-ffff8a90ce96b300 10000000:01000000:0.0:1788528574.027431:0:17869:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788528574.027658:0:17869:0:(mgc_request.c:2062:mgc_process_log()) Process log nodemap-ffff8a90ce96b300 from 1 10000000:01000000:2.0:1788528574.027663:0:17869:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788528574.027691:0:17869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851c00/0x892c60dda91c8c21 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528574.027699:0:17869:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a9101851c00/0x892c60dda91c8c21 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528574.027708:0:17869:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a9101851c00/0x892c60dda91c8c21 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528574.027722:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735531776:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788528574.027755:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528574.027794:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9101848300 going to sleep for 11 seconds 00000100:00100000:3.0:1788528574.027825:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735531776 00000100:00100000:3.0:1788528574.027831:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735531776 00000100:00100000:3.0:1788528574.027863:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788528574.027870:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+13:17869:x1875407735531776:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788528574.027880:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528574.027893:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc3429400/0x892c60dda91c8c28 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8c21 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528574.027913:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc3429400/0x892c60dda91c8c28 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8c21 expref: 14 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528574.027923:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc3429400/0x892c60dda91c8c28 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8c21 expref: 14 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528574.027931:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3429400, rc 0) 00000100:00100000:3.0:1788528574.027972:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+14:17869:x1875407735531776:12345-0@lo:101:mount.lustre.0 Request processed in 102us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528574.027977:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788528574.028038:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735531776:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788528574.028052:0:17869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a9101851c00/0x892c60dda91c8c21 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8c28 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528574.028061:0:17869:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a9101851c00/0x892c60dda91c8c21 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8c28 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528574.028076:0:17869:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788528574.028089:0:17869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851c00/0x892c60dda91c8c21 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8c28 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528574.028096:0:17869:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a9101851c00/0x892c60dda91c8c21 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8c28 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528574.028104:0:17869:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-barrier-ffff8a90f6c03000 10000000:01000000:3.0:1788528574.028240:0:17869:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788528574.028266:0:17869:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-barrier-ffff8a90f6c03000 from 1 10000000:01000000:3.0:1788528574.028269:0:17869:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788528574.028285:0:17869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428000/0x892c60dda91c8c2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528574.028294:0:17869:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428000/0x892c60dda91c8c2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528574.028311:0:17869:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428000/0x892c60dda91c8c2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528574.028324:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735531904:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788528574.028373:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528574.028394:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de3eb780 going to sleep for 11 seconds 00000100:00100000:1.0:1788528574.028417:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735531904 00000100:00100000:1.0:1788528574.028424:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735531904 00000100:00100000:1.0:1788528574.028462:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788528574.028471:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+14:17869:x1875407735531904:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788528574.028479:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528574.028489:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c1551400/0x892c60dda91c8c36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8c2f expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528574.028503:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c1551400/0x892c60dda91c8c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8c2f expref: 15 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528574.028511:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c1551400/0x892c60dda91c8c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8c2f expref: 15 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528574.028517:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c1551400, rc 0) 00000100:00100000:1.0:1788528574.028584:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+15:17869:x1875407735531904:12345-0@lo:101:mount.lustre.0 Request processed in 116us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528574.028590:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788528574.028813:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735531904:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788528574.028824:0:17869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428000/0x892c60dda91c8c2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8c36 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.028838:0:17869:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428000/0x892c60dda91c8c2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8c36 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528574.028849:0:17869:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788528574.028865:0:17869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428000/0x892c60dda91c8c2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8c36 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.028872:0:17869:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428000/0x892c60dda91c8c2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8c36 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528574.028878:0:17869:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788528574.028883:0:17869:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788528574.028902:0:17869:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-MDT0001-osd 00000040:01000000:0.0:1788528574.028960:0:17869:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788528574.028965:0:17869:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788528574.028971:0:17869:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff8a90f6c03000 10000000:01000000:0.0:1788528574.028974:0:17869:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788528574.029003:0:17869:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788528574.029005:0:17869:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788528574.029021:0:17869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c8c3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.029029:0:17869:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c8c3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.029036:0:17869:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c8c3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528574.029047:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4676680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735532032:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788528574.029091:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528574.029120:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3eb4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788528574.029136:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735532032 00000100:00100000:3.0:1788528574.029141:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735532032 00000100:00100000:3.0:1788528574.029175:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788528574.029182:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+15:17869:x1875407735532032:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788528574.029190:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528574.029198:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc3429800/0x892c60dda91c8c44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8c3d expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528574.029221:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc3429800/0x892c60dda91c8c44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8c3d expref: 16 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528574.029230:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc3429800/0x892c60dda91c8c44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8c3d expref: 16 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528574.029235:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3429800, rc 0) 00000100:00100000:3.0:1788528574.029272:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+16:17869:x1875407735532032:12345-0@lo:101:mount.lustre.0 Request processed in 90us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528574.029279:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788528574.030466:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4676680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735532032:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788528574.030488:0:17869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c8c3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8c44 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.030498:0:17869:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c8c3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8c44 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788528574.032948:0:17869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 46 count 46 00000040:00080000:1.0:1788528574.034065:0:17869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788528574.044804:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].1, 224 off8416 00000040:00080000:1.0:1788528574.044866:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].2, 136 off8552 00000040:00080000:1.0:1788528574.044894:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].3, 176 off8728 00000040:00080000:1.0:1788528574.044910:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].4, 224 off8952 00000040:00080000:1.0:1788528574.044939:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].5, 224 off9176 00000040:00080000:1.0:1788528574.044954:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].6, 120 off9296 00000040:00080000:1.0:1788528574.044968:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].7, 112 off9408 00000040:00080000:1.0:1788528574.044980:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].8, 160 off9568 00000040:00080000:1.0:1788528574.044991:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].9, 224 off9792 00000040:00080000:1.0:1788528574.045005:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].10, 224 off10016 00000040:00080000:1.0:1788528574.045017:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].11, 88 off10104 00000040:00080000:1.0:1788528574.045028:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].12, 144 off10248 00000040:00080000:1.0:1788528574.045040:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].13, 152 off10400 00000040:00080000:1.0:1788528574.045053:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].14, 168 off10568 00000040:00080000:1.0:1788528574.046256:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].15, 224 off10792 00000040:00080000:1.0:1788528574.046313:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].16, 224 off11016 00000040:00080000:1.0:1788528574.046546:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].17, 80 off11096 00000040:00080000:1.0:1788528574.046592:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].18, 224 off11320 00000040:00080000:1.0:1788528574.046606:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].19, 224 off11544 00000040:00080000:1.0:1788528574.046619:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].20, 160 off11704 00000040:00080000:1.0:1788528574.046632:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].21, 224 off11928 00000040:00080000:1.0:1788528574.046645:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].22, 224 off12152 00000040:00080000:1.0:1788528574.046657:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].23, 80 off12232 00000040:00080000:1.0:1788528574.046670:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].24, 224 off12456 00000040:00080000:1.0:1788528574.046682:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].25, 224 off12680 00000040:00080000:1.0:1788528574.046695:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].26, 88 off12768 00000040:00080000:1.0:1788528574.046708:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].27, 144 off12912 00000040:00080000:1.0:1788528574.046721:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].28, 152 off13064 00000040:00080000:1.0:1788528574.047724:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].29, 136 off13200 00000040:00080000:1.0:1788528574.048348:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].30, 224 off13424 00000040:00080000:1.0:1788528574.048376:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].31, 224 off13648 00000040:00080000:1.0:1788528574.048391:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].32, 80 off13728 00000040:00080000:1.0:1788528574.048403:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].33, 224 off13952 00000040:00080000:1.0:1788528574.048424:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].34, 224 off14176 00000040:00080000:1.0:1788528574.048447:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].35, 88 off14264 00000040:00080000:1.0:1788528574.048482:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].36, 144 off14408 00000040:00080000:1.0:1788528574.048494:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].37, 152 off14560 00000040:00080000:1.0:1788528574.048504:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].38, 136 off14696 00000040:00080000:1.0:1788528574.048515:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].39, 224 off14920 00000040:00080000:1.0:1788528574.048527:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].40, 224 off15144 00000040:00080000:1.0:1788528574.048538:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].41, 80 off15224 00000040:00080000:1.0:1788528574.048551:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].42, 224 off15448 00000040:00080000:1.0:1788528574.048605:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].43, 224 off15672 00000040:00080000:1.0:1788528574.048617:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].44, 120 off15792 00000040:00080000:1.0:1788528574.048648:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].45, 224 off16016 00000040:00080000:1.0:1788528574.048653:0:17869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 45 count 46 00000100:00100000:1.0:1788528574.048789:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735532160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788528574.048852:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528574.048891:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d61c49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528574.050582:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735532160 00000100:00100000:3.0:1788528574.050595:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735532160 00000100:00100000:3.0:1788528574.050656:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788528574.050668:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+16:17869:x1875407735532160:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788528574.050868:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+16:17869:x1875407735532160:12345-0@lo:501:mount.lustre.0 Request processed in 203us (2015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528574.050876:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788528574.050929:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735532160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788528574.050980:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735532288:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788528574.059866:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528574.059951:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d61c49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528574.060820:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735532288 00000100:00100000:1.0:1788528574.060832:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735532288 00000100:00100000:1.0:1788528574.061020:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788528574.061032:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+16:17869:x1875407735532288:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788528574.062787:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+16:17869:x1875407735532288:12345-0@lo:503:mount.lustre.0 Request processed in 1753us (2923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528574.062800:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788528574.068347:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735532288:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788528574.069260:0:17869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788528574.069680:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735532416:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788528574.070172:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528574.070278:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9101848300 going to sleep for 11 seconds 00000100:00100000:3.0:1788528574.071683:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735532416 00000100:00100000:3.0:1788528574.071694:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735532416 00000100:00100000:3.0:1788528574.071858:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788528574.071868:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+16:17869:x1875407735532416:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788528574.075090:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+16:17869:x1875407735532416:12345-0@lo:502:mount.lustre.0 Request processed in 3214us (4910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528574.075104:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788528574.075224:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735532416:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788528574.075524:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].1, 224 off8416 00000040:00080000:2.0:1788528574.075594:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].2, 136 off8552 00000040:00080000:2.0:1788528574.075613:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].3, 176 off8728 00000040:00080000:2.0:1788528574.075626:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].4, 224 off8952 00000040:00080000:2.0:1788528574.075652:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].5, 224 off9176 00000040:00080000:2.0:1788528574.075667:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].6, 120 off9296 00000040:00080000:2.0:1788528574.075680:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].7, 112 off9408 00000040:00080000:2.0:1788528574.075692:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].8, 160 off9568 00000040:00080000:2.0:1788528574.075703:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].9, 224 off9792 00000040:00080000:2.0:1788528574.075715:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].10, 224 off10016 00000040:00080000:2.0:1788528574.075726:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].11, 88 off10104 00000040:00080000:2.0:1788528574.075754:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].12, 144 off10248 00000040:00080000:2.0:1788528574.075766:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].13, 152 off10400 00000040:00080000:2.0:1788528574.075778:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].14, 168 off10568 00000040:00080000:2.0:1788528574.075790:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].15, 224 off10792 00000040:00080000:2.0:1788528574.075803:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].16, 224 off11016 00000040:00080000:2.0:1788528574.075815:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].17, 80 off11096 00000040:00080000:2.0:1788528574.075829:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].18, 224 off11320 00000040:00080000:2.0:1788528574.075843:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].19, 224 off11544 00000040:00080000:2.0:1788528574.075857:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].20, 160 off11704 00000040:00080000:2.0:1788528574.075870:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].21, 224 off11928 00000040:00080000:2.0:1788528574.075885:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].22, 224 off12152 00000040:00080000:2.0:1788528574.075899:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].23, 80 off12232 00000040:00080000:2.0:1788528574.075912:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].24, 224 off12456 00000040:00080000:2.0:1788528574.075925:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].25, 224 off12680 00000040:00080000:2.0:1788528574.075936:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].26, 88 off12768 00000040:00080000:2.0:1788528574.075947:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].27, 144 off12912 00000040:00080000:2.0:1788528574.075959:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].28, 152 off13064 00000040:00080000:2.0:1788528574.075973:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].29, 136 off13200 00000040:00080000:2.0:1788528574.075987:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].30, 224 off13424 00000040:00080000:2.0:1788528574.076000:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].31, 224 off13648 00000040:00080000:2.0:1788528574.076011:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].32, 80 off13728 00000040:00080000:2.0:1788528574.076023:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].33, 224 off13952 00000040:00080000:2.0:1788528574.076037:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].34, 224 off14176 00000040:00080000:2.0:1788528574.076049:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].35, 88 off14264 00000040:00080000:2.0:1788528574.076061:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].36, 144 off14408 00000040:00080000:2.0:1788528574.076073:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].37, 152 off14560 00000040:00080000:2.0:1788528574.076099:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].38, 136 off14696 00000040:00080000:2.0:1788528574.076113:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].39, 224 off14920 00000040:00080000:2.0:1788528574.076127:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].40, 224 off15144 00000040:00080000:2.0:1788528574.076139:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].41, 80 off15224 00000040:00080000:2.0:1788528574.076151:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].42, 224 off15448 00000040:00080000:2.0:1788528574.076162:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].43, 224 off15672 00000040:00080000:2.0:1788528574.076173:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].44, 120 off15792 00000100:00100000:2.0:1788528574.076221:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735532544:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788528574.076278:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528574.078430:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9101848300 going to sleep for 11 seconds 00000100:00100000:0.0:1788528574.078476:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735532544 00000100:00100000:0.0:1788528574.078487:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735532544 00000100:00100000:3.0:1788528574.078569:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788528574.078581:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+16:17869:x1875407735532544:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788528574.078737:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+16:17869:x1875407735532544:12345-0@lo:502:mount.lustre.0 Request processed in 158us (2458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528574.078744:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788528574.078831:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735532544:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788528574.078927:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].45, 224 off16016 00000040:00080000:2.0:1788528574.078940:0:17869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1788528574.084567:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788528574.084584:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528574.084587:0:17873:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788528574.084594:0:17873:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788528574.084598:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788528574.084613:0:17873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8a9101959980) 00000020:00000080:0.0:1788528574.084633:0:17873:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1788528574.084639:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788528574.084736:0:17873:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788528574.084743:0:17873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x892c60dda91c8c52 00000020:00000080:0.0:1788528574.085040:0:17873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788528574.085046:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528574.085050:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528574.085052:0:17873:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788528574.085056:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788528574.085060:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528574.085061:0:17873:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1788528574.085065:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788528574.085143:0:17873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8a90fb078000) 00000020:00000080:0.0:1788528574.085156:0:17873:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1788528574.085168:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788528574.085170:0:17873:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1788528574.085173:0:17873:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788528574.085179:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788528574.085239:0:17873:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a90f6c03000 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788528574.085252:0:17873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8a90fb07b300) 00000020:00000080:0.0:1788528574.085262:0:17873:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1788528574.085330:0:17873:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788528574.085336:0:17873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x892c60dda91c8c67 00000020:00000080:0.0:1788528574.085701:0:17873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788528574.085709:0:17873:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788528574.085715:0:17873:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x892c60dda91c8c6e 00080000:01000000:0.0:1788528574.085723:0:17873:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788528574.085726:0:17873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x892c60dda91c8c75 00000100:00080000:3.0:1788528574.142862:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788528574.142869:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788528574.142873:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a90de3f0800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788528574.142882:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 438 00000100:00080000:3.0:1788528574.142888:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788528574.142895:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a90de3f0800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528574.143173:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90f58c1880 x1875407735532672/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788528574.143197:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528574.143218:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788528574.143221:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528574.143223:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788528574.143268:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735532800:0@lo:400:kworker.0 00000100:00100000:3.0:1788528574.143336:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528574.143453:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735532672:0@lo:38:kworker.0 00000100:00100000:1.0:1788528574.143520:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528574.143548:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735532672 00000100:00100000:1.0:1788528574.143572:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735532672 00000100:00100000:1.0:1788528574.143614:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788528574.143621:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1875407735532672:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1788528574.143639:0:17142:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (not set up) 00000100:00100000:2.0:1788528574.146661:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735532800 00000100:00100000:2.0:1788528574.146678:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735532800 00000100:00100000:2.0:1788528574.146734:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788528574.146743:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735532800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528574.146838:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735532800:12345-0@lo:400:kworker.0 Request processed in 97us (3503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528574.146846:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788528574.146892:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a90f58c2a00 x1875407735532800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528574.146906:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735532800:0@lo:400:kworker.0 00000100:00100000:1.0:1788528574.157421:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1875407735532672:12345-0@lo:38:kworker.0 Request processed in 13791us (13892us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788528574.157436:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788528574.157482:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90de3f0800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788528574.157487:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788528574.157491:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735532672:0@lo:38:kworker.0 00010000:00010000:0.0:1788528574.190325:0:17873:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1788528574.192700:0:17873:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:0.0:1788528574.195538:0:17873:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788528574.199485:0:17873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1788528574.199498:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528574.199503:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528574.199504:0:17873:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1788528574.199507:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788528574.199511:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528574.199512:0:17873:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1788528574.199514:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788528574.199518:0:17873:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:00000080:0.0:1788528574.199540:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788528574.199571:0:17873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8a90fb07e600) 00000020:00000080:0.0:1788528574.199589:0:17873:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1788528574.199592:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788528574.199670:0:17873:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1788528574.199690:0:17873:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788528574.199700:0:17873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x892c60dda91c8c83 00010000:00080000:0.0:1788528574.199730:0:17873:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a90c83a9800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.138@tcp at head 00010000:00010000:2.0:1788528574.214182:0:17873:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1788528574.217934:0:17873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788528574.217951:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788528574.218019:0:17873:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788528574.218047:0:17873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x892c60dda91c8c8a 00000100:00080000:2.0:1788528574.218058:0:17873:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788528574.218064:0:17873:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a90c83a9800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1788528574.218100:0:17873:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90f6da0380 x1875407735532928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788528574.218129:0:17873:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788528574.218196:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:01000000:2.0:1788528574.218196:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788528574.218200:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00080000:3.0:1788528574.218215:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:2.0:1788528574.218217:0:17873:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000100:00080000:3.0:1788528574.218221:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:01000000:2.0:1788528574.218223:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000100:00080000:3.0:1788528574.218228:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1788528574.218229:0:17873:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788528574.218233:0:17873:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788528574.218236:0:17873:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788528574.218238:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788528574.218242:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528574.218244:0:17873:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788528574.218247:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788528574.218252:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528574.218254:0:17873:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788528574.218258:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788528574.218289:0:17873:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788528574.218303:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788528574.218306:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528574.218307:0:17873:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788528574.218309:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788528574.218311:0:17873:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1788528574.218312:0:17873:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788528574.218314:0:17873:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788528574.218315:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788528574.218318:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528574.218319:0:17873:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788528574.218321:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788528574.218325:0:17873:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788528574.218335:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528574.218336:0:17873:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788528574.218340:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788528574.218344:0:17873:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:2.0:1788528574.218364:0:17873:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788528574.218366:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788528574.218379:0:17873:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8a90f7deb300) 00000020:00000080:2.0:1788528574.218390:0:17873:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788528574.218395:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788528574.218461:0:17873:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788528574.218467:0:17873:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788528574.218473:0:17873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x892c60dda91c8c98 00010000:00080000:2.0:1788528574.218503:0:17873:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a90f6ee8800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.138@tcp at head 00000100:00100000:1.0:1788528574.218746:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735532928:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788528574.218815:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528574.219026:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735532928 00000100:00100000:3.0:1788528574.219034:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735532928 00000100:00100000:3.0:1788528574.219073:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788528574.219081:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1875407735532928:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788528574.219114:0:17143:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 443 last 0 00000020:00000080:3.0:1788528574.219143:0:17143:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x892c60dda91c8c9f 00000004:00100000:3.0:1788528574.219156:0:17143:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788528574.219162:0:17143:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:2.0:1788528574.222352:0:17873:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:3.0:1788528574.223742:0:17143:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d08000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788528574.223839:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1875407735532928:12345-0@lo:38:llog_process_th.0 Request processed in 4755us (5021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528574.223850:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788528574.223934:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788528574.223953:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788528574.223962:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788528574.223969:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788528574.223971:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90c83a9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788528574.223990:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735532928:0@lo:38:llog_process_th.0 00000040:01000000:2.0:1788528574.224653:0:17873:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788528574.224896:0:17873:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1788528574.224938:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788528574.224956:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4676680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735533056:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788528574.225019:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528574.225095:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735533056 00000100:00100000:0.0:1788528574.225103:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735533056 00000100:00100000:0.0:1788528574.225151:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788528574.225161:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1875407735533056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788528574.225194:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788528574.225256:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1875407735533056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528574.225264:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788528574.225328:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4676680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735533056:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788528574.226606:0:17873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788528574.228722:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788528574.228899:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:1.0:1788528574.232606:0:17879:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788528574.232615:0:17879:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788528574.238166:0:17873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788528574.238182:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788528574.238234:0:17873:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788528574.238263:0:17873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x892c60dda91c8ca6 00000100:00080000:3.0:1788528574.238274:0:17873:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788528574.238280:0:17873:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a90f6ee8800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528574.238316:0:17873:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90f58c1c00 x1875407735533184/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788528574.238342:0:17873:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788528574.238547:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788528574.238581:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528574.238584:0:17873:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788528574.238587:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788528574.238590:0:17873:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1788528574.238591:0:17873:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788528574.238593:0:17873:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788528574.238594:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788528574.238597:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528574.238598:0:17873:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788528574.238600:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788528574.238604:0:17873:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788528574.238607:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528574.238608:0:17873:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788528574.238611:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788528574.238615:0:17873:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:3.0:1788528574.238636:0:17873:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788528574.238638:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788528574.238654:0:17873:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8a8fc35e1980) 00000020:00000080:3.0:1788528574.238671:0:17873:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1788528574.238675:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788528574.238729:0:17873:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788528574.238736:0:17873:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788528574.238741:0:17873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x892c60dda91c8cb4 00010000:00080000:3.0:1788528574.238767:0:17873:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a90f58dd000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.138@tcp at head 00000100:00080000:0.0:1788528574.238901:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788528574.238905:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788528574.238908:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788528574.238910:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788528574.239058:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735533184:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788528574.239108:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875407735533184 offset 0 length 520: 4 00010000:00010000:3.0:1788528574.239311:0:17873:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788528574.239454:0:17873:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788528574.239470:0:17873:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788528574.249243:0:17873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788528574.251168:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788528574.251480:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788528574.261096:0:17881:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788528574.261104:0:17881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788528574.262551:0:17873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788528574.262583:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788528574.262628:0:17873:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788528574.262650:0:17873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x892c60dda91c8cbb 00000100:00080000:0.0:1788528574.262660:0:17873:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788528574.262666:0:17873:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a90f58dd000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1788528574.262698:0:17873:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc4676300 x1875407735533312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788528574.262726:0:17873:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788528574.262823:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528574.262827:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528574.262829:0:17873:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788528574.262831:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788528574.262842:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528574.262844:0:17873:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788528574.262847:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788528574.262849:0:17873:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788528574.262851:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528574.262854:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528574.262855:0:17873:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788528574.262858:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788528574.262859:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528574.262861:0:17873:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788528574.262864:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788528574.262885:0:17873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528574.262887:0:17873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528574.262888:0:17873:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788528574.262890:0:17873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 46 count 46 00000100:00100000:1.0:1788528574.263048:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4676300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735533312:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788528574.263102:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875407735533312 offset 0 length 520: 4 00000100:00080000:3.0:1788528574.269613:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528574.269623:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788528574.269626:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528574.269628:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1788528574.269658:0:17869:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1788528574.269683:0:17869:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788528574.269698:0:17869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c8c3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8c44 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528574.269712:0:17869:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c8c3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8c44 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528574.269720:0:17869:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff8a90f6c03000 from 1 10000000:01000000:3.0:1788528574.269723:0:17869:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788528574.269762:0:17869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c8cc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528574.269770:0:17869:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c8cc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528574.269780:0:17869:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c8cc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528574.269822:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735533440:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788528574.269888:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528574.269930:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78496c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528574.270103:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735533440 00000100:00100000:0.0:1788528574.270111:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735533440 00000100:00100000:0.0:1788528574.270164:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788528574.270173:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+16:17869:x1875407735533440:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788528574.270184:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528574.270196:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c0031a00/0x892c60dda91c8cc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8cc2 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.270229:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c0031a00/0x892c60dda91c8cc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8cc2 expref: 17 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.270239:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c0031a00/0x892c60dda91c8cc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8cc2 expref: 17 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.270249:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031a00, rc 0) 00000100:00100000:0.0:1788528574.270299:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+17:17869:x1875407735533440:12345-0@lo:101:mount.lustre.0 Request processed in 127us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528574.270316:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788528574.270389:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735533440:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788528574.270405:0:17869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c8cc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8cc9 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528574.270414:0:17869:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c8cc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8cc9 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528574.270960:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735533568:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788528574.271003:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528574.271025:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ef8600 going to sleep for 11 seconds 00000100:00100000:2.0:1788528574.271171:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735533568 00000100:00100000:2.0:1788528574.271177:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735533568 00000100:00100000:2.0:1788528574.271222:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788528574.271230:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+17:17869:x1875407735533568:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788528574.271246:0:17131:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788528574.271265:0:17131:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788528574.271268:0:17131:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788528574.271363:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+17:17869:x1875407735533568:12345-0@lo:256:mount.lustre.0 Request processed in 134us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528574.271371:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788528574.271542:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735533568:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788528574.272182:0:17869:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788528574.272198:0:17869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c8cc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8cc9 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528574.272220:0:17869:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c8cc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8cc9 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528574.272228:0:17869:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a90f6c03000 from 1 10000000:01000000:1.0:1788528574.272231:0:17869:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788528574.272256:0:17869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c1550a00/0x892c60dda91c8cd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528574.272321:0:17869:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c1550a00/0x892c60dda91c8cd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528574.272331:0:17869:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c1550a00/0x892c60dda91c8cd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528574.272487:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735533696:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788528574.272529:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528574.272610:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735533696 00000100:00100000:0.0:1788528574.272616:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735533696 00000100:00100000:0.0:1788528574.272657:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788528574.272658:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ef8600 going to sleep for 11 seconds 00000100:00100000:0.0:1788528574.272665:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+17:17869:x1875407735533696:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788528574.272675:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528574.272687:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c0030a00/0x892c60dda91c8cd7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8cd0 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.272708:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c0030a00/0x892c60dda91c8cd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8cd0 expref: 18 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.272719:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c0030a00/0x892c60dda91c8cd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8cd0 expref: 18 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.272801:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0030a00, rc 0) 00000100:00100000:0.0:1788528574.272844:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+18:17869:x1875407735533696:12345-0@lo:101:mount.lustre.0 Request processed in 180us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528574.272850:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788528574.275202:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735533696:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788528574.275243:0:17869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c1550a00/0x892c60dda91c8cd0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8cd7 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.275255:0:17869:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c1550a00/0x892c60dda91c8cd0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8cd7 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788528574.283317:0:17869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 13 count 13 00000040:00080000:0.0:1788528574.283851:0:17869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788528574.284763:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].1, 224 off8416 00000040:00080000:0.0:1788528574.284792:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].2, 112 off8528 00000040:00080000:0.0:1788528574.284825:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].3, 224 off8752 00000040:00080000:0.0:1788528574.284842:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].4, 224 off8976 00000040:00080000:0.0:1788528574.284853:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].5, 112 off9088 00000040:00080000:0.0:1788528574.284864:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].6, 224 off9312 00000040:00080000:0.0:1788528574.284874:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].7, 224 off9536 00000040:00080000:0.0:1788528574.284886:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].8, 128 off9664 00000040:00080000:0.0:1788528574.284901:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].9, 224 off9888 00000040:00080000:0.0:1788528574.284918:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].10, 224 off10112 00000040:00080000:0.0:1788528574.285317:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].11, 128 off10240 00000040:00080000:0.0:1788528574.285343:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].12, 224 off10464 00000040:00080000:0.0:1788528574.285350:0:17869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 12 count 13 00000100:00100000:0.0:1788528574.285857:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4674000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735533824:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788528574.286053:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528574.286113:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d0288000 going to sleep for 11 seconds 00000100:00100000:1.0:1788528574.288355:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735533824 00000100:00100000:1.0:1788528574.288369:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735533824 00000100:00100000:1.0:1788528574.288453:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788528574.288462:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+18:17869:x1875407735533824:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788528574.288659:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+18:17869:x1875407735533824:12345-0@lo:501:mount.lustre.0 Request processed in 197us (2736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528574.288667:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788528574.289089:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4674000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735533824:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788528574.289136:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4674000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735533952:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788528574.289191:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528574.289271:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d0288000 going to sleep for 11 seconds 00000100:00100000:3.0:1788528574.296157:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735533952 00000100:00100000:3.0:1788528574.296172:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735533952 00000100:00100000:2.0:1788528574.296489:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788528574.296512:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+18:17869:x1875407735533952:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788528574.296691:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+18:17869:x1875407735533952:12345-0@lo:503:mount.lustre.0 Request processed in 180us (7498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528574.296699:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788528574.296793:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4674000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735533952:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788528574.297258:0:17869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788528574.297338:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4674000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735534080:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788528574.297386:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528574.297436:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d0288000 going to sleep for 11 seconds 00000100:00100000:3.0:1788528574.297730:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735534080 00000100:00100000:3.0:1788528574.297736:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735534080 00000100:00100000:3.0:1788528574.297777:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788528574.297785:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+18:17869:x1875407735534080:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788528574.297881:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+18:17869:x1875407735534080:12345-0@lo:502:mount.lustre.0 Request processed in 96us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528574.297888:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788528574.298075:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4674000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735534080:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788528574.298277:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].1, 224 off8416 00000040:00080000:0.0:1788528574.298315:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].2, 112 off8528 00000040:00080000:0.0:1788528574.298331:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].3, 224 off8752 00000040:00080000:0.0:1788528574.298345:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].4, 224 off8976 00000040:00080000:0.0:1788528574.298375:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].5, 112 off9088 00000040:00080000:0.0:1788528574.298390:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].6, 224 off9312 00000040:00080000:0.0:1788528574.298404:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].7, 224 off9536 00000040:00080000:0.0:1788528574.298495:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].8, 128 off9664 00000040:00080000:0.0:1788528574.298511:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].9, 224 off9888 00000040:00080000:0.0:1788528574.298525:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].10, 224 off10112 00000040:00080000:0.0:1788528574.298538:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].11, 128 off10240 00000100:00100000:0.0:1788528574.298592:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4674000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735534208:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788528574.298636:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528574.298659:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d0288000 going to sleep for 11 seconds 00000100:00100000:1.0:1788528574.300184:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735534208 00000100:00100000:1.0:1788528574.300195:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735534208 00000100:00100000:1.0:1788528574.300263:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788528574.300271:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+18:17869:x1875407735534208:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788528574.300420:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+18:17869:x1875407735534208:12345-0@lo:502:mount.lustre.0 Request processed in 150us (1784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528574.300428:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788528574.300941:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4674000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735534208:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788528574.301028:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].12, 224 off10464 00000040:00080000:0.0:1788528574.301040:0:17869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788528574.301782:0:17883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788528574.301792:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528574.301795:0:17883:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788528574.301802:0:17883:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a90f6c03000 00000020:00000080:0.0:1788528574.301805:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788528574.301811:0:17883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528574.301814:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528574.301815:0:17883:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788528574.301818:0:17883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788528574.301820:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528574.301821:0:17883:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788528574.301824:0:17883:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a90f6c03000 00000020:00000080:0.0:1788528574.301826:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788528574.301884:0:17883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528574.301888:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528574.301894:0:17883:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788528574.301898:0:17883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788528574.301901:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528574.301902:0:17883:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788528574.301906:0:17883:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a90f6c03000 00000020:00000080:0.0:1788528574.301908:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788528574.301927:0:17883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528574.301930:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528574.301932:0:17883:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788528574.301934:0:17883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788528574.301936:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528574.301938:0:17883:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788528574.301941:0:17883:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a90f6c03000 00000020:00000080:0.0:1788528574.301943:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788528574.301963:0:17883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528574.301966:0:17883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528574.301968:0:17883:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788528574.301971:0:17883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 13 count 13 00000020:01000000:3.0:1788528574.305694:0:17869:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788528574.305716:0:17869:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788528574.305736:0:17869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c1550a00/0x892c60dda91c8cd0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8cd7 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528574.305748:0:17869:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c1550a00/0x892c60dda91c8cd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8cd7 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528574.305815:0:17869:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788528574.305818:0:17869:0:(mgc_request.c:423:config_log_add()) add config log lustre-client-ffff8a90f6c03000 10000000:01000000:3.0:1788528574.305821:0:17869:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff8a90f6c03000 10000000:01000000:3.0:1788528574.305827:0:17869:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788528574.305858:0:17869:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-MDT0001-osd 00000040:01000000:3.0:1788528574.305948:0:17869:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788528574.305955:0:17869:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788528574.305965:0:17869:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff8a90f6c03000 from 1 10000000:01000000:3.0:1788528574.305973:0:17869:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788528574.306004:0:17869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c8cde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528574.306013:0:17869:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c8cde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528574.306023:0:17869:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c8cde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528574.306046:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735534336:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788528574.306106:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528574.306140:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c1254b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788528574.306161:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735534336 00000100:00100000:3.0:1788528574.306168:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735534336 00000100:00100000:3.0:1788528574.306224:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788528574.306233:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+18:17869:x1875407735534336:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788528574.306245:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528574.306256:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc3428a00/0x892c60dda91c8ce5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8cde expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528574.306279:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc3428a00/0x892c60dda91c8ce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8cde expref: 19 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528574.306291:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc3428a00/0x892c60dda91c8ce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8cde expref: 19 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528574.306300:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3428a00, rc 0) 00000100:00100000:3.0:1788528574.306335:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:17869:x1875407735534336:12345-0@lo:101:mount.lustre.0 Request processed in 103us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528574.306350:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788528574.306401:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735534336:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788528574.306430:0:17869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c8cde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8ce5 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528574.306439:0:17869:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c8cde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8ce5 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788528574.314907:0:17869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000040:00080000:3.0:1788528574.315188:0:17869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788528574.316256:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].1, 224 off8416 00000040:00080000:3.0:1788528574.316288:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].2, 120 off8536 00000040:00080000:3.0:1788528574.316304:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].3, 168 off8704 00000040:00080000:3.0:1788528574.316317:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].4, 224 off8928 00000040:00080000:3.0:1788528574.318579:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].5, 224 off9152 00000040:00080000:3.0:1788528574.318618:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].6, 120 off9272 00000040:00080000:3.0:1788528574.318952:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].7, 168 off9440 00000040:00080000:3.0:1788528574.318969:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].8, 224 off9664 00000040:00080000:3.0:1788528574.318982:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].9, 224 off9888 00000040:00080000:3.0:1788528574.318994:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].10, 120 off10008 00000040:00080000:3.0:1788528574.319008:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].11, 224 off10232 00000040:00080000:3.0:1788528574.319022:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].12, 224 off10456 00000040:00080000:3.0:1788528574.319034:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].13, 88 off10544 00000040:00080000:3.0:1788528574.319047:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].14, 128 off10672 00000040:00080000:3.0:1788528574.319058:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].15, 144 off10816 00000040:00080000:3.0:1788528574.319069:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].16, 160 off10976 00000040:00080000:3.0:1788528574.319081:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].17, 224 off11200 00000040:00080000:3.0:1788528574.319093:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].18, 224 off11424 00000040:00080000:3.0:1788528574.319104:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].19, 80 off11504 00000040:00080000:3.0:1788528574.319117:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].20, 224 off11728 00000040:00080000:3.0:1788528574.319143:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].21, 224 off11952 00000040:00080000:3.0:1788528574.319157:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].22, 88 off12040 00000040:00080000:3.0:1788528574.319183:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].23, 128 off12168 00000040:00080000:3.0:1788528574.319199:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].24, 144 off12312 00000040:00080000:3.0:1788528574.319227:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].25, 160 off12472 00000040:00080000:3.0:1788528574.319241:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].26, 224 off12696 00000040:00080000:3.0:1788528574.319254:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].27, 224 off12920 00000040:00080000:3.0:1788528574.319268:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].28, 80 off13000 00000040:00080000:3.0:1788528574.319281:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].29, 224 off13224 00000040:00080000:3.0:1788528574.319294:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].30, 224 off13448 00000040:00080000:3.0:1788528574.319308:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].31, 88 off13536 00000040:00080000:3.0:1788528574.319321:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].32, 128 off13664 00000040:00080000:3.0:1788528574.321115:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].33, 144 off13808 00000040:00080000:3.0:1788528574.321133:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].34, 128 off13936 00000040:00080000:3.0:1788528574.321146:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].35, 224 off14160 00000040:00080000:3.0:1788528574.321159:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].36, 224 off14384 00000040:00080000:3.0:1788528574.321171:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].37, 80 off14464 00000040:00080000:3.0:1788528574.321185:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].38, 224 off14688 00000040:00080000:3.0:1788528574.321228:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].39, 224 off14912 00000040:00080000:3.0:1788528574.321244:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].40, 88 off15000 00000040:00080000:3.0:1788528574.321257:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].41, 128 off15128 00000040:00080000:3.0:1788528574.321271:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].42, 144 off15272 00000040:00080000:3.0:1788528574.321283:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].43, 128 off15400 00000040:00080000:3.0:1788528574.321296:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].44, 224 off15624 00000040:00080000:3.0:1788528574.321309:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].45, 224 off15848 00000040:00080000:3.0:1788528574.321322:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].46, 80 off15928 00000040:00080000:3.0:1788528574.321352:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].47, 224 off16152 00000040:00080000:3.0:1788528574.321367:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].48, 232 off16384 00000040:00080000:3.0:1788528574.321623:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].49, 224 off16608 00000040:00080000:3.0:1788528574.321647:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].50, 120 off16728 00000040:00080000:3.0:1788528574.321664:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].51, 224 off16952 00000040:00080000:3.0:1788528574.321669:0:17869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 51 count 51 00000100:00100000:3.0:1788528574.321762:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735534464:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788528574.321828:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528574.321873:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735534464 00000100:00100000:3.0:1788528574.321880:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735534464 00000100:00100000:3.0:1788528574.321921:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788528574.321929:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:17869:x1875407735534464:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788528574.322039:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:17869:x1875407735534464:12345-0@lo:501:mount.lustre.0 Request processed in 110us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528574.322047:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788528574.322092:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d9fb60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528574.322113:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735534464:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788528574.322143:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735534592:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788528574.322179:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528574.322193:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d9fb60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528574.322219:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735534592 00000100:00100000:3.0:1788528574.322223:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735534592 00000100:00100000:3.0:1788528574.322247:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788528574.322254:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:17869:x1875407735534592:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788528574.322325:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:17869:x1875407735534592:12345-0@lo:503:mount.lustre.0 Request processed in 71us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528574.322332:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788528574.322376:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735534592:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788528574.325958:0:17869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788528574.326066:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735534720:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788528574.326137:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528574.326180:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735534720 00000100:00100000:3.0:1788528574.326192:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735534720 00000100:00100000:3.0:1788528574.329955:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788528574.329971:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:17869:x1875407735534720:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788528574.330125:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:17869:x1875407735534720:12345-0@lo:502:mount.lustre.0 Request processed in 158us (3987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528574.330133:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788528574.330195:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c1254b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788528574.330233:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735534720:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788528574.331509:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].1, 224 off8416 00000040:00080000:3.0:1788528574.331569:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].2, 120 off8536 00000040:00080000:3.0:1788528574.331585:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].3, 168 off8704 00000040:00080000:3.0:1788528574.331598:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].4, 224 off8928 00000040:00080000:3.0:1788528574.331611:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].5, 224 off9152 00000040:00080000:3.0:1788528574.331622:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].6, 120 off9272 00000040:00080000:3.0:1788528574.331634:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].7, 168 off9440 00000040:00080000:3.0:1788528574.331645:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].8, 224 off9664 00000040:00080000:3.0:1788528574.331656:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].9, 224 off9888 00000040:00080000:3.0:1788528574.331669:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].10, 120 off10008 00000040:00080000:3.0:1788528574.331682:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].11, 224 off10232 00000040:00080000:3.0:1788528574.331694:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].12, 224 off10456 00000040:00080000:3.0:1788528574.331705:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].13, 88 off10544 00000040:00080000:3.0:1788528574.331719:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].14, 128 off10672 00000040:00080000:3.0:1788528574.331732:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].15, 144 off10816 00000040:00080000:3.0:1788528574.331746:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].16, 160 off10976 00000040:00080000:3.0:1788528574.331780:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].17, 224 off11200 00000040:00080000:3.0:1788528574.331796:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].18, 224 off11424 00000040:00080000:3.0:1788528574.331807:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].19, 80 off11504 00000040:00080000:3.0:1788528574.331819:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].20, 224 off11728 00000040:00080000:3.0:1788528574.331833:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].21, 224 off11952 00000040:00080000:3.0:1788528574.331846:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].22, 88 off12040 00000040:00080000:3.0:1788528574.331871:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].23, 128 off12168 00000040:00080000:3.0:1788528574.331885:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].24, 144 off12312 00000040:00080000:3.0:1788528574.331898:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].25, 160 off12472 00000040:00080000:3.0:1788528574.331924:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].26, 224 off12696 00000040:00080000:3.0:1788528574.331942:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].27, 224 off12920 00000040:00080000:3.0:1788528574.331955:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].28, 80 off13000 00000040:00080000:3.0:1788528574.331967:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].29, 224 off13224 00000040:00080000:3.0:1788528574.331979:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].30, 224 off13448 00000040:00080000:3.0:1788528574.331990:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].31, 88 off13536 00000040:00080000:3.0:1788528574.332001:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].32, 128 off13664 00000040:00080000:3.0:1788528574.332026:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].33, 144 off13808 00000040:00080000:3.0:1788528574.332041:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].34, 128 off13936 00000040:00080000:3.0:1788528574.332053:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].35, 224 off14160 00000040:00080000:3.0:1788528574.332067:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].36, 224 off14384 00000040:00080000:3.0:1788528574.332080:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].37, 80 off14464 00000040:00080000:3.0:1788528574.332094:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].38, 224 off14688 00000040:00080000:3.0:1788528574.332106:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].39, 224 off14912 00000040:00080000:3.0:1788528574.332117:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].40, 88 off15000 00000040:00080000:3.0:1788528574.332129:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].41, 128 off15128 00000040:00080000:3.0:1788528574.332142:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].42, 144 off15272 00000040:00080000:3.0:1788528574.332153:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].43, 128 off15400 00000040:00080000:3.0:1788528574.332167:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].44, 224 off15624 00000040:00080000:3.0:1788528574.332179:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].45, 224 off15848 00000040:00080000:3.0:1788528574.332190:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].46, 80 off15928 00000040:00080000:3.0:1788528574.332212:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].47, 224 off16152 00000040:00080000:3.0:1788528574.332228:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].48, 232 off16384 00000100:00100000:3.0:1788528574.332296:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735534848:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788528574.332783:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528574.332821:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735534848 00000100:00100000:3.0:1788528574.332828:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735534848 00000100:00100000:3.0:1788528574.332873:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788528574.332882:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:17869:x1875407735534848:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788528574.333132:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:17869:x1875407735534848:12345-0@lo:502:mount.lustre.0 Request processed in 250us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528574.333139:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788528574.333191:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c1254b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788528574.333222:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735534848:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788528574.340656:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].49, 224 off16608 00000040:00080000:2.0:1788528574.340737:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].50, 120 off16728 00000100:00100000:2.0:1788528574.340792:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735534976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788528574.340873:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528574.340909:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3eef3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528574.348318:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735534976 00000100:00100000:1.0:1788528574.348400:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735534976 00000100:00100000:1.0:1788528574.348503:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788528574.348524:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:17869:x1875407735534976:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788528574.349157:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:17869:x1875407735534976:12345-0@lo:502:mount.lustre.0 Request processed in 633us (8282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528574.349166:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788528574.357627:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735534976:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788528574.357816:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].51, 224 off16952 00000040:00080000:2.0:1788528574.357831:0:17869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788528574.362401:0:17890:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788528574.362418:0:17890:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8a90ce969980) 00000020:00000080:1.0:1788528574.362447:0:17890:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788528574.363230:0:17890:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a90f6c03000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788528574.363240:0:17890:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8a90f6c03000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788528574.363243:0:17890:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a90f6c03000 3 00010000:00080000:1.0:1788528574.363282:0:17890:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a90c5a9b000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.138@tcp at head 00010000:00010000:1.0:1788528574.372137:0:17890:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1788528574.373542:0:17890:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788528574.374769:0:17890:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788528574.374788:0:17890:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x892c60dda91c8cf3 00000100:00080000:2.0:1788528574.374800:0:17890:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788528574.374806:0:17890:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a90c5a9b000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1788528574.374841:0:17890:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90f6da2a00 x1875407735535104/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788528574.374861:0:17890:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788528574.375424:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528574.375431:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788528574.375433:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528574.375435:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788528574.376005:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875407735535104:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788528574.376078:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528574.376143:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735535104 00000100:00100000:1.0:1788528574.376151:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735535104 00000100:00100000:1.0:1788528574.376184:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788528574.376191:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1875407735535104:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788528574.376228:0:17139:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 443 last 0 00000020:00000080:1.0:1788528574.376269:0:17139:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x892c60dda91c8cfa 00000004:00100000:1.0:1788528574.376283:0:17139:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788528574.376315:0:17139:0:(import.c:65:import_set_state_nolock()) ffff8a90c3a09000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788528574.377513:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875407735535104:12345-0@lo:38:llog_process_th.0 Request processed in 1317us (1431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528574.377524:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788528574.377607:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a90f6da2a00 x1875407735535104/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788528584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528574.377618:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788528574.377626:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788528574.377634:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788528574.377638:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788528574.377642:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90c5a9b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788528574.377648:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875407735535104:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788528574.378461:0:17890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 52 count 51 00000020:01000000:0.0:1788528574.379115:0:17869:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788528574.379133:0:17869:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788528574.379155:0:17869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c8cde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8ce5 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.379167:0:17869:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c8cde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8ce5 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788528574.379227:0:17869:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788528574.379229:0:17869:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788528574.379230:0:17869:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788528574.379232:0:17869:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788528574.379233:0:17869:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788528574.379235:0:17869:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788528574.379236:0:17869:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788528574.379238:0:17869:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788528574.379244:0:17869:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788528574.379247:0:17869:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1788528574.379249:0:17869:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788528574.379250:0:17869:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788528574.379251:0:17869:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788528574.379252:0:17869:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788528574.379253:0:17869:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788528574.379254:0:17869:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788528574.379255:0:17869:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788528574.379256:0:17869:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788528574.379257:0:17869:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788528574.379280:0:17869:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788528574.379298:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4674000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735535232:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788528574.379364:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528574.379402:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d0288000 going to sleep for 11 seconds 00000100:00100000:3.0:1788528574.381136:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735535232 00000100:00100000:3.0:1788528574.381149:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735535232 00000100:00100000:3.0:1788528574.381219:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788528574.381228:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:17869:x1875407735535232:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788528574.381262:0:17132:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788528574.381278:0:17132:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1788528574.385316:0:17117:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788528574.385714:0:17132:0:(mgs_nids.c:820:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788528574.385734:0:17132:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1788528574.385883:0:17153:0:(mgs_nids.c:717:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788528574.385888:0:17153:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788528574.385909:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a9101851400/0x892c60dda91c8d01 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528574.385939:0:17153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c1550600/0x892c60dda91c8bf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8bf0 expref: 19 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528574.385964:0:17153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c0031a00/0x892c60dda91c8cc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8cc2 expref: 19 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528574.385972:0:17153:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a9101851400/0x892c60dda91c8d01 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528574.386009:0:17153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c0031a00/0x892c60dda91c8cc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c8cc2 expref: 19 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528574.386023:0:17153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a90c0031a00/0x892c60dda91c8cc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c8cc2 expref: 19 pid: 17132 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528574.386037:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17153:1875407735535360:0@lo:104: 00000100:00100000:2.0:1788528574.386098:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788528574.386152:0:17153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c1550600/0x892c60dda91c8bf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c8bf0 expref: 19 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528574.386160:0:17153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a90c1550600/0x892c60dda91c8bf7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c8bf0 expref: 19 pid: 17131 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528574.386168:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17153:1875407735535488:0@lo:104: 00000100:00100000:2.0:1788528574.386188:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528574.386216:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d61c4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528574.387047:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:17869:x1875407735535232:12345-0@lo:253:mount.lustre.0 Request processed in 5818us (7680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528574.387059:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788528574.387123:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4674000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:17869:1875407735535232:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788528574.387136:0:17869:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788528574.387146:0:17869:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788528574.387148:0:17869:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788528574.387150:0:17869:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788528574.387151:0:17869:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788528574.387152:0:17869:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788528574.387153:0:17869:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788528574.387155:0:17869:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788528574.387156:0:17869:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788528574.387158:0:17869:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788528574.387172:0:17869:0:(tgt_mount.c:2815:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788528574.387380:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735535360 00000100:00100000:0.0:1788528574.387388:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735535360 00000100:00100000:0.0:1788528574.387424:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735535488 00000100:00100000:0.0:1788528574.387427:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735535488 00000100:00100000:0.0:1788528574.387441:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788528574.387449:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:463b8984-c30b-4b73-b2f1-81113bd4e10a+4:17153:x1875407735535360:12345-0@lo:104: 00010000:00010000:0.0:1788528574.387463:0:17120:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c8cc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c8cc9 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.387516:0:17120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788528574.387521:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:463b8984-c30b-4b73-b2f1-81113bd4e10a+4:17153:x1875407735535360:12345-0@lo:104: Request processed in 73us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528574.387528:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788528574.387541:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788528574.387547:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:463b8984-c30b-4b73-b2f1-81113bd4e10a+3:17153:x1875407735535488:12345-0@lo:104: 00010000:00010000:0.0:1788528574.387573:0:17120:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c8bf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c8bf7 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.387620:0:17120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788528574.387625:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:463b8984-c30b-4b73-b2f1-81113bd4e10a+3:17153:x1875407735535488:12345-0@lo:104: Request processed in 79us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528574.387631:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788528574.387648:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788528574.387653:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c8cc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c8cc9 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.387660:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428200 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:0.0:1788528574.387664:0:17125:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c8cc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c8cc9 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.387672:0:17125:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c8cc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c8cc9 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528574.387680:0:17125:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c8cc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c8cc9 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528574.387686:0:17125:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788528574.387715:0:17125:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c8cc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8cc9 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.387722:0:17125:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788528574.387740:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c8cc2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8cc9 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.387746:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428200/0x892c60dda91c8cc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8cc9 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.387769:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528574.387772:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c8bf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c8bf7 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.387778:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031e00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:0.0:1788528574.387781:0:17125:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c8bf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c8bf7 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.387788:0:17125:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c8bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c8bf7 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528574.387794:0:17125:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c8bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c8bf7 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528574.387799:0:17125:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788528574.387812:0:17125:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c8bf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8bf7 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.387817:0:17125:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788528574.387823:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c8bf0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8bf7 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.387829:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c0031e00/0x892c60dda91c8bf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8bf7 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.387843:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528574.387844:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528574.387846:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528574.387865:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:463b8984-c30b-4b73-b2f1-81113bd4e10a:3637:1875407735535616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788528574.387901:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788528574.388799:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528574.388816:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:463b8984-c30b-4b73-b2f1-81113bd4e10a:3638:1875407735535744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788528574.393192:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528574.393429:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735535616 00000100:00100000:1.0:1788528574.393440:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735535616 00010000:00010000:1.0:1788528574.393472:0:17123:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c0031a00/0x892c60dda91c8cc9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c8cc2 expref: 19 pid: 17132 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528574.393500:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735535744 00000100:00100000:1.0:1788528574.393503:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735535744 00010000:00010000:1.0:1788528574.393515:0:17123:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c1550600/0x892c60dda91c8bf7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c8bf0 expref: 20 pid: 17131 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528574.393530:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788528574.393537:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4675180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:463b8984-c30b-4b73-b2f1-81113bd4e10a+20:3637:x1875407735535616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788528574.393551:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528574.393576:0:17123:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c0031a00/0x892c60dda91c8cc9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c8cc2 expref: 20 pid: 17132 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528574.393592:0:17123:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c0031a00/0x892c60dda91c8cc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c8cc2 expref: 20 pid: 17132 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528574.393613:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528574.393670:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4675180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:463b8984-c30b-4b73-b2f1-81113bd4e10a+20:3637:x1875407735535616:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (5768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528574.393678:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788528574.393695:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788528574.393701:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:3638:x1875407735535744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788528574.393709:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528574.393714:0:17123:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c1550600/0x892c60dda91c8bf7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c8bf0 expref: 19 pid: 17131 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528574.393723:0:17123:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c1550600/0x892c60dda91c8bf7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c8bf0 expref: 19 pid: 17131 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528574.393734:0:17123:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a9101851400/0x892c60dda91c8d01 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528574.393743:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101851400/0x892c60dda91c8d01 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788528574.393757:0:17123:0:(mgs_nids.c:693:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009285697s 00010000:00010000:1.0:1788528574.393761:0:17123:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9101851400/0x892c60dda91c8d01 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528574.393768:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9101851400/0x892c60dda91c8d01 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528574.393774:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a9101851400/0x892c60dda91c8d01 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528574.393781:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a9101851400/0x892c60dda91c8d01 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528574.393796:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101851400 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528574.393800:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a9101851400/0x892c60dda91c8d01 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528574.393808:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a9101851400/0x892c60dda91c8d01 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528574.393816:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a9101851400/0x892c60dda91c8d01 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528574.393826:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528574.393856:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:3638:x1875407735535744:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528574.393863:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788528574.393904:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:463b8984-c30b-4b73-b2f1-81113bd4e10a:3638:1875407735535744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788528574.394001:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:463b8984-c30b-4b73-b2f1-81113bd4e10a:3637:1875407735535616:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788528574.394667:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c0031a00/0x892c60dda91c8cc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c8cc2 expref: 18 pid: 17132 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528574.394680:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17153:1875407735535360:0@lo:104: 00010000:00010000:0.0:1788528574.394692:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c1550600/0x892c60dda91c8bf7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c8bf0 expref: 17 pid: 17131 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528574.394700:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17153:1875407735535488:0@lo:104: 00010000:00010000:0.0:1788528574.394715:0:17153:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a9101851400/0x892c60dda91c8d01 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.394724:0:17153:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a9101851400/0x892c60dda91c8d01 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.394729:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a9101851400/0x892c60dda91c8d01 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.394735:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101851400/0x892c60dda91c8d01 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528574.399966:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788528574.401155:0:17869:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1788528574.401233:0:17895:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788528574.401237:0:17895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788528574.401748:0:17896:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788528574.402094:0:17869:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:2.0:1788528574.402453:0:17896:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788528574.404544:0:17897:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17897:1875407735535872:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788528574.404770:0:17869:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1788528574.404832:0:17869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788528574.405311:0:17869:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788528574.405321:0:17869:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788528574.405441:0:17869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788528574.405717:0:17897:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528574.405756:0:17897:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d5d3f900 going to sleep for 11 seconds 00000100:00100000:3.0:1788528574.406177:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735535872 00000100:00100000:3.0:1788528574.406186:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735535872 00000100:00100000:3.0:1788528574.406241:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788528574.406250:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17897:x1875407735535872:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788528574.406438:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17897:x1875407735535872:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 188us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528574.406446:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:3.0:1788528574.407002:0:17869:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788528574.407541:0:17869:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788528574.407606:0:17869:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788528574.407705:0:17869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788528574.408846:0:17896:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788528574.408920:0:17896:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1788528574.411597:0:17897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17897:1875407735535872:0@lo:1000:lod0001_rec0000.0 00080000:10000000:2.0:1788528574.412148:0:17869:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:2.0:1788528574.418776:0:17869:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000040:01000000:0.0:1788528574.420374:0:17897:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788528574.420436:0:17897:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17897:1875407735536000:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788528574.420518:0:17897:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528574.420683:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735536000 00000100:00100000:3.0:1788528574.420691:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735536000 00000100:00100000:3.0:1788528574.420744:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788528574.420755:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4677b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17897:x1875407735536000:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788528574.420868:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4677b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17897:x1875407735536000:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 115us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528574.420876:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788528574.421098:0:17897:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c5ade840 going to sleep for 11 seconds 00000100:00100000:0.0:1788528574.421124:0:17897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17897:1875407735536000:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788528574.421190:0:17897:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17897:1875407735536128:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788528574.421233:0:17897:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528574.421260:0:17897:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c5adec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788528574.421421:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735536128 00000100:00100000:3.0:1788528574.421426:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735536128 00000100:00100000:3.0:1788528574.421463:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788528574.421470:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17897:x1875407735536128:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788528574.421524:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17897:x1875407735536128:12345-0@lo:900:lod0001_rec0000.0 Request processed in 54us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528574.421531:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788528574.421686:0:17897:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a8fc4675f80 x1875407735536128/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788528590 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528574.421698:0:17897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17897:1875407735536128:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788528574.421745:0:17897:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c5c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17897:1875407735536256:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788528574.421776:0:17897:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528574.421798:0:17897:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d5d350c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528574.421856:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735536256 00000100:00100000:3.0:1788528574.421860:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735536256 00000100:00100000:3.0:1788528574.421988:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788528574.421995:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17897:x1875407735536256:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788528574.422056:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17897:x1875407735536256:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 63us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528574.422063:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788528574.422092:0:17897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c5c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17897:1875407735536256:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788528574.422137:0:17897:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788528574.425717:0:17897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788528574.425803:0:17897:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788528574.425807:0:17897:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:2.0:1788528574.426445:0:17869:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788528574.426473:0:17869:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9b7a015239b8 00100000:10000000:2.0:1788528574.426480:0:17869:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788528574.427298:0:17869:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788528574.427316:0:17869:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788528574.428192:0:17869:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788528574.432667:0:17869:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788528574.910644:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16ac240 going to sleep for 0 seconds 00000040:00080000:0.0:1788528575.360792:0:17889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788528575.422728:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788528575.742677:0:17134:0:(mgc_request.c:714:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788528575.742685:0:17134:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff8a90f6c03000 from 8 10000000:01000000:0.0:1788528575.742689:0:17134:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788528575.742740:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8d08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528575.742753:0:17134:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8d08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528575.742764:0:17134:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8d08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528575.742789:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4676680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735536384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788528575.742873:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528575.742994:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c5adeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788528575.745638:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735536384 00000100:00100000:1.0:1788528575.745653:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735536384 00000100:00100000:1.0:1788528575.745730:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788528575.745754:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+17:17134:x1875407735536384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788528575.745771:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528575.745789:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c1550200/0x892c60dda91c8d0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8d08 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528575.745817:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c1550200/0x892c60dda91c8d0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8d08 expref: 18 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528575.745828:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c1550200/0x892c60dda91c8d0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8d08 expref: 18 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528575.745838:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c1550200, rc 0) 00000100:00100000:1.0:1788528575.745923:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+18:17134:x1875407735536384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (3050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528575.745931:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788528575.746187:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4676680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735536384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788528575.746217:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8d08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8d0f expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528575.746227:0:17134:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8d08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8d0f expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528575.746295:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4676680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735536512:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788528575.746331:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528575.746419:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c5adeb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788528575.748005:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735536512 00000100:00100000:2.0:1788528575.748017:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735536512 00000100:00100000:2.0:1788528575.748076:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788528575.748085:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+18:17134:x1875407735536512:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788528575.748106:0:17132:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788528575.748125:0:17132:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788528575.748128:0:17132:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788528575.748237:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+18:17134:x1875407735536512:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 153us (1905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528575.748245:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788528575.748358:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4676680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735536512:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788528575.748512:0:17134:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788528575.748521:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8d08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8d0f expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528575.748532:0:17134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8d08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8d0f expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528575.748688:0:17134:0:(mgc_request.c:714:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788528575.748692:0:17134:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff8a8fc477d800 from 8 10000000:01000000:0.0:1788528575.748694:0:17134:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788528575.748720:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0031200/0x892c60dda91c8d16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528575.748728:0:17134:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c0031200/0x892c60dda91c8d16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528575.748736:0:17134:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c0031200/0x892c60dda91c8d16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528575.748751:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4676680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735536640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788528575.748779:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528575.748810:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c5adeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788528575.748935:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735536640 00000100:00100000:1.0:1788528575.748941:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735536640 00000100:00100000:1.0:1788528575.749037:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788528575.749046:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+18:17134:x1875407735536640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788528575.749055:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528575.749067:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c1550800/0x892c60dda91c8d1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8d16 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528575.749086:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c1550800/0x892c60dda91c8d1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8d16 expref: 19 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528575.749096:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c1550800/0x892c60dda91c8d1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8d16 expref: 19 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528575.749115:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c1550800, rc 0) 00000100:00100000:1.0:1788528575.749153:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:17134:x1875407735536640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528575.749158:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788528575.749261:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4676680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735536640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788528575.749280:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c0031200/0x892c60dda91c8d16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8d1d expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528575.749288:0:17134:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c0031200/0x892c60dda91c8d16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8d1d expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528575.749329:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4676680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735536768:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788528575.749358:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528575.752018:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735536768 00000100:00100000:3.0:1788528575.752033:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735536768 00000100:00100000:3.0:1788528575.752085:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788528575.752095:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ec9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:17134:x1875407735536768:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788528575.752120:0:17132:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788528575.752143:0:17132:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788528575.752146:0:17132:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788528575.752271:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ec9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:17134:x1875407735536768:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 177us (2912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528575.752290:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788528575.758760:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c5adeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788528575.758799:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4676680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735536768:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788528575.758878:0:17134:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788528575.758892:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0031200/0x892c60dda91c8d16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8d1d expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528575.758904:0:17134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c0031200/0x892c60dda91c8d16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8d1d expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528575.934694:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16ac240 going to sleep for 0 seconds 00000040:00080000:0.0:1788528576.383230:0:17889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788528576.453375:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528576.958650:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16ac240 going to sleep for 0 seconds 00010000:00010000:3.0:1788528577.477404:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528577.982657:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16ac240 going to sleep for 0 seconds 00010000:00010000:1.0:1788528578.494749:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528579.008089:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16ac240 going to sleep for 0 seconds 00000001:02000400:0.0:1788528579.262187:0:18138:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788528579.264749:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735536896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528579.264839:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528579.265096:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735536896 00000100:00100000:3.0:1788528579.265106:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735536896 00000100:00100000:3.0:1788528579.265190:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788528579.265200:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735536896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788528579.265237:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788528579.265294:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735536896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528579.265301:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788528579.265380:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735536896:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788528579.530433:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788528579.774983:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788528579.774990:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788528579.774994:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a90de3f0800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788528579.775003:0:469:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 443 00000100:00080000:1.0:1788528579.775007:0:469:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788528579.775014:0:469:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a90de3f0800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1788528579.775039:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc44c6a00 x1875407735537152/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788528579.775064:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788528579.775068:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788528579.775070:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788528579.775073:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788528579.775096:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788528579.775099:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788528579.775102:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788528579.775105:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788528579.775134:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875407735537408:0@lo:400:kworker.0 00000100:00100000:1.0:1788528579.775227:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528579.775292:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788528579.775299:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735537280:0@lo:400:kworker.0 00000100:00100000:1.0:1788528579.775321:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528579.775387:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735537408 00000100:00100000:1.0:1788528579.775395:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735537408 00000100:00100000:1.0:1788528579.775433:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735537280 00000100:00100000:1.0:1788528579.775436:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735537280 00000100:00100000:1.0:1788528579.775451:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788528579.775459:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875407735537408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528579.775518:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875407735537408:12345-0@lo:400:kworker.0 Request processed in 58us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528579.775524:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788528579.775540:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788528579.775545:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735537280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528579.775613:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735537280:12345-0@lo:400:kworker.0 Request processed in 67us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528579.775619:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788528579.775658:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a8fc44c7b80 x1875407735537280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528579.775671:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735537280:0@lo:400:kworker.0 00010000:00080000:1.0:1788528579.775680:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a8fc44c5c00 x1875407735537408/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528579.775687:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875407735537408:0@lo:400:kworker.0 00000100:00100000:0.0:1788528579.775849:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735537152:0@lo:38:kworker.0 00000100:00100000:0.0:1788528579.775882:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528579.775970:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735537152 00000100:00100000:1.0:1788528579.775980:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735537152 00000100:00100000:1.0:1788528579.776013:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788528579.776018:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4676680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1875407735537152:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788528579.776041:0:17142:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:1.0:1788528579.776071:0:17142:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x892c60dda91c8d24 00000004:00100000:1.0:1788528579.776085:0:17142:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788528579.776091:0:17142:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1788528579.776215:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788528579.776225:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:463b8984-c30b-4b73-b2f1-81113bd4e10a:3639:1875407735537024:0@lo:400:kworker.0 00000100:00100000:2.0:1788528579.776258:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528579.776456:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735537024 00000100:00100000:1.0:1788528579.776460:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735537024 00000100:00100000:1.0:1788528579.776497:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788528579.776504:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:3639:x1875407735537024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528579.776550:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:3639:x1875407735537024:12345-0@lo:400:kworker.0 Request processed in 46us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528579.776578:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788528579.776698:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:463b8984-c30b-4b73-b2f1-81113bd4e10a:3639:1875407735537024:0@lo:400:kworker.0 00000100:00080000:1.0:1788528579.793278:0:17142:0:(import.c:65:import_set_state_nolock()) ffff8a90c7d54800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788528579.793426:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4676680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1875407735537152:12345-0@lo:38:kworker.0 Request processed in 17404us (17540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528579.793437:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788528579.794294:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788528579.794399:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788528579.794408:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788528579.794413:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788528579.794417:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90de3f0800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788528579.794443:0:3636:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000007780c81d): req@ffff8a8fc44c5180 x1875407735529856/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528579.794466:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735537152:0@lo:38:kworker.0 00000100:00100000:1.0:1788528579.794605:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788528579.794620:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735537536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788528579.794669:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528579.794708:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735537536 00000100:00100000:1.0:1788528579.794715:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735537536 00000100:00100000:1.0:1788528579.794756:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788528579.794764:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1875407735537536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788528579.794792:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788528579.794832:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1875407735537536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528579.794846:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788528579.794884:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735537536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788528579.795221:0:17179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528579.795240:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16ac240 going to sleep for 11 seconds 00000100:00100000:3.0:1788528579.795253:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735529856 00000100:00100000:3.0:1788528579.795256:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735529856 00000100:00100000:3.0:1788528579.795282:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788528579.795288:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17179:x1875407735529856:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788528579.796536:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17179:x1875407735529856:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 1243us (1310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528579.796547:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788528579.796611:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c5180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17179:1875407735529856:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788528579.796646:0:17179:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788528579.796682:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17179:1875407735537664:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788528579.796717:0:17179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528579.796745:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ef8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788528579.796757:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735537664 00000100:00100000:3.0:1788528579.796762:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735537664 00000100:00100000:3.0:1788528579.796789:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788528579.796794:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17179:x1875407735537664:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788528579.796890:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17179:x1875407735537664:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 95us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528579.797301:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788528579.797414:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17179:1875407735537664:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788528579.797480:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17179:1875407735537792:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788528579.797510:0:17179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528579.797527:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ef8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788528579.797541:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735537792 00000100:00100000:3.0:1788528579.797545:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735537792 00000100:00100000:3.0:1788528579.797586:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788528579.797591:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17179:x1875407735537792:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788528579.797643:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17179:x1875407735537792:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 51us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528579.797650:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788528579.797672:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17179:1875407735537792:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788528579.797708:0:17179:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788528579.806795:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788528579.806890:0:17179:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:3.0:1788528579.806895:0:17179:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:3.0:1788528580.329177:0:18191:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788528580.330025:0:18191:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788528580.543256:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788528581.010879:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1788528581.242181:0:18242:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788528581.242482:0:18242:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788528581.567366:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788528582.542860:0:18291:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff792f1600 20000000:00000080:2.0:1788528582.542877:0:18291:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a90c6324400 uarg=0000000000000000 20000000:01000000:2.0:1788528582.542917:0:18291:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788528582.542925:0:18291:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788528582.542929:0:18291:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788528582.543430:0:18292:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788528582.543658:0:18291:0:(mgs_llog.c:1456:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788528582.550181:0:18291:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788528582.550211:0:18291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a9101851200/0x892c60dda91c8d2b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528582.550229:0:18291:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c1551800/0x892c60dda91c8bc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8bbf expref: 18 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528582.550237:0:18291:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c0030a00/0x892c60dda91c8cd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8cd0 expref: 18 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528582.550245:0:18291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a9101851200/0x892c60dda91c8d2b lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528582.550341:0:18291:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c0030a00/0x892c60dda91c8cd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c8cd0 expref: 18 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528582.550357:0:18291:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a90c0030a00/0x892c60dda91c8cd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c8cd0 expref: 18 pid: 17132 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528582.550380:0:18291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18291:1875407735537920:0@lo:104: 00000100:00100000:2.0:1788528582.550436:0:18291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788528582.550486:0:18291:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c1551800/0x892c60dda91c8bc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c8bbf expref: 18 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528582.550496:0:18291:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a90c1551800/0x892c60dda91c8bc6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c8bbf expref: 18 pid: 17130 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528582.550504:0:18291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18291:1875407735538048:0@lo:104: 00000100:00100000:2.0:1788528582.550522:0:18291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528582.550543:0:18291:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1fd6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788528582.550585:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735537920 00000100:00100000:0.0:1788528582.550594:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735537920 00000100:00100000:0.0:1788528582.550629:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735538048 00000100:00100000:0.0:1788528582.550632:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735538048 00000100:00100000:0.0:1788528582.550644:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788528582.550651:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:463b8984-c30b-4b73-b2f1-81113bd4e10a+4:18291:x1875407735537920:12345-0@lo:104: 00010000:00010000:0.0:1788528582.550663:0:17120:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c1550a00/0x892c60dda91c8cd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c8cd7 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528582.550717:0:17120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788528582.550723:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:463b8984-c30b-4b73-b2f1-81113bd4e10a+4:18291:x1875407735537920:12345-0@lo:104: Request processed in 73us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528582.550730:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788528582.550745:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788528582.550751:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:463b8984-c30b-4b73-b2f1-81113bd4e10a+3:18291:x1875407735538048:12345-0@lo:104: 00010000:00010000:0.0:1788528582.550759:0:17120:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8bbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c8bc6 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528582.550789:0:17120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788528582.550801:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:463b8984-c30b-4b73-b2f1-81113bd4e10a+3:18291:x1875407735538048:12345-0@lo:104: Request processed in 51us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528582.550807:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788528582.550823:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788528582.550828:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c1550a00/0x892c60dda91c8cd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c8cd7 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528582.550835:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c1550a00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:0.0:1788528582.550839:0:17125:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c1550a00/0x892c60dda91c8cd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c8cd7 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528582.550847:0:17125:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c1550a00/0x892c60dda91c8cd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c8cd7 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528582.550854:0:17125:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c1550a00/0x892c60dda91c8cd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c8cd7 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528582.550859:0:17125:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788528582.550885:0:17125:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c1550a00/0x892c60dda91c8cd0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8cd7 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528582.550891:0:17125:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788528582.550911:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c1550a00/0x892c60dda91c8cd0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8cd7 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528582.550917:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c1550a00/0x892c60dda91c8cd0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8cd7 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528582.550928:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528582.550932:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8bbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c8bc6 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528582.550948:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031c00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:0.0:1788528582.550951:0:17125:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8bbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c8bc6 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528582.550957:0:17125:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8bbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c8bc6 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528582.550963:0:17125:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8bbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c8bc6 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528582.550968:0:17125:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788528582.550980:0:17125:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8bbf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8bc6 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528582.550985:0:17125:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788528582.550999:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8bbf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8bc6 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528582.551005:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8bbf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8bc6 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528582.551017:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528582.551019:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528582.551020:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528582.551026:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528582.551042:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:463b8984-c30b-4b73-b2f1-81113bd4e10a:3640:1875407735538176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788528582.551071:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528582.551111:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:463b8984-c30b-4b73-b2f1-81113bd4e10a:3637:1875407735538304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788528582.551142:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528582.551193:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735538176 00000100:00100000:0.0:1788528582.551197:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735538176 00010000:00010000:0.0:1788528582.551214:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c0030a00/0x892c60dda91c8cd7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c8cd0 expref: 19 pid: 17132 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528582.551304:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735538304 00000100:00100000:0.0:1788528582.551309:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735538304 00010000:00010000:0.0:1788528582.551322:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c1551800/0x892c60dda91c8bc6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c8bbf expref: 20 pid: 17130 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528582.551337:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788528582.551342:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4675500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:463b8984-c30b-4b73-b2f1-81113bd4e10a+20:3640:x1875407735538176:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788528582.551346:0:18291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18291:1875407735537920:0@lo:104: 00010000:00010000:0.0:1788528582.551350:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788528582.551355:0:18291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18291:1875407735538048:0@lo:104: 00010000:00010000:0.0:1788528582.551356:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c0030a00/0x892c60dda91c8cd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c8cd0 expref: 20 pid: 17132 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528582.551365:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c0030a00/0x892c60dda91c8cd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c8cd0 expref: 20 pid: 17132 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528582.551374:0:18291:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a9101851200/0x892c60dda91c8d2b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528582.551378:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c0030a00/0x892c60dda91c8cd7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c8cd0 expref: 20 pid: 17132 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528582.551388:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528582.551421:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4675500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:3640:x1875407735538176:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528582.551427:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788528582.551440:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788528582.551446:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4677480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:463b8984-c30b-4b73-b2f1-81113bd4e10a+18:3637:x1875407735538304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788528582.551461:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528582.551467:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c1551800/0x892c60dda91c8bc6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c8bbf expref: 18 pid: 17130 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528582.551475:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c1551800/0x892c60dda91c8bc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c8bbf expref: 18 pid: 17130 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528582.551484:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c1551800/0x892c60dda91c8bc6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c8bbf expref: 18 pid: 17130 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528582.551490:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:463b8984-c30b-4b73-b2f1-81113bd4e10a:3640:1875407735538176:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788528582.551494:0:17124:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a9101851200/0x892c60dda91c8d2b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528582.551502:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101851200/0x892c60dda91c8d2b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528582.551514:0:17124:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9101851200/0x892c60dda91c8d2b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528582.551521:0:17124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9101851200/0x892c60dda91c8d2b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528582.551528:0:17124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a9101851200/0x892c60dda91c8d2b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528582.551535:0:17124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a9101851200/0x892c60dda91c8d2b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528582.551540:0:17124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101851200 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528582.551544:0:17124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a9101851200/0x892c60dda91c8d2b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528582.551585:0:17124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a9101851200/0x892c60dda91c8d2b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528582.551599:0:17124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a9101851200/0x892c60dda91c8d2b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528582.551607:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528582.551636:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4677480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:463b8984-c30b-4b73-b2f1-81113bd4e10a+17:3637:x1875407735538304:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528582.551642:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788528582.551672:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:463b8984-c30b-4b73-b2f1-81113bd4e10a:3637:1875407735538304:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788528582.552402:0:18291:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a9101851200/0x892c60dda91c8d2b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528582.552412:0:18291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a9101851200/0x892c60dda91c8d2b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528582.552418:0:18291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101851200/0x892c60dda91c8d2b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528582.590793:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528583.616883:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788528584.126701:0:17134:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:0.0:1788528584.126710:0:17134:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a90f6c03000 from 13 10000000:01000000:0.0:1788528584.126715:0:17134:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788528584.126765:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8d32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528584.126777:0:17134:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8d32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528584.126789:0:17134:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8d32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528584.126818:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735538432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788528584.126900:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528584.126948:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f8e3cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788528584.126961:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735538432 00000100:00100000:2.0:1788528584.126981:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735538432 00000100:00100000:2.0:1788528584.127041:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788528584.127051:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+17:17134:x1875407735538432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528584.127064:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528584.127077:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9101851800/0x892c60dda91c8d39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8d32 expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528584.127100:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101851800/0x892c60dda91c8d39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8d32 expref: 18 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528584.127111:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9101851800/0x892c60dda91c8d39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8d32 expref: 18 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528584.127121:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101851800, rc 0) 00000100:00100000:2.0:1788528584.127176:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+18:17134:x1875407735538432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528584.127183:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788528584.127716:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735538432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788528584.127732:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8d32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8d39 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528584.127749:0:17134:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8d32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8d39 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788528584.127969:0:17134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 13 count 13 00000040:00080000:0.0:1788528584.128284:0:17134:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788528584.128497:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].1, 224 off8416 00000040:00080000:0.0:1788528584.128521:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].2, 112 off8528 00000040:00080000:0.0:1788528584.128536:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].3, 224 off8752 00000040:00080000:0.0:1788528584.128588:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].4, 224 off8976 00000040:00080000:0.0:1788528584.128624:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].5, 112 off9088 00000040:00080000:0.0:1788528584.128641:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].6, 224 off9312 00000040:00080000:0.0:1788528584.128657:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].7, 224 off9536 00000040:00080000:0.0:1788528584.128670:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].8, 128 off9664 00000040:00080000:0.0:1788528584.128684:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].9, 224 off9888 00000040:00080000:0.0:1788528584.128696:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].10, 224 off10112 00000040:00080000:0.0:1788528584.128712:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].11, 128 off10240 00000040:00080000:0.0:1788528584.128729:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].12, 224 off10464 00000040:00080000:0.0:1788528584.128735:0:17134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 12 count 13 00000100:00100000:0.0:1788528584.128804:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735538560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788528584.131237:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528584.131320:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f8e3cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788528584.131590:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735538560 00000100:00100000:2.0:1788528584.131602:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735538560 00000100:00100000:2.0:1788528584.131671:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788528584.131680:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+18:17134:x1875407735538560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528584.131832:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+18:17134:x1875407735538560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (2971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528584.131839:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788528584.132054:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735538560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788528584.132107:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735538688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788528584.132176:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528584.132210:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f8e3cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788528584.132774:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735538688 00000100:00100000:1.0:1788528584.132780:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735538688 00000100:00100000:1.0:1788528584.132820:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788528584.132827:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+18:17134:x1875407735538688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788528584.132941:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+18:17134:x1875407735538688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528584.132948:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788528584.133116:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735538688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788528584.133709:0:17134:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788528584.133785:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735538816:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788528584.133830:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528584.133881:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f8e3cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788528584.134005:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735538816 00000100:00100000:3.0:1788528584.134010:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735538816 00000100:00100000:3.0:1788528584.134045:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788528584.134051:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+18:17134:x1875407735538816:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788528584.134157:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+18:17134:x1875407735538816:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 105us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528584.134169:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788528584.134284:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735538816:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788528584.134427:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].1, 224 off8416 00000040:00080000:0.0:1788528584.134450:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].2, 112 off8528 00000040:00080000:0.0:1788528584.134462:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].3, 224 off8752 00000040:00080000:0.0:1788528584.134473:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].4, 224 off8976 00000040:00080000:0.0:1788528584.134484:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].5, 112 off9088 00000040:00080000:0.0:1788528584.134495:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].6, 224 off9312 00000040:00080000:0.0:1788528584.134506:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].7, 224 off9536 00000040:00080000:0.0:1788528584.134517:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].8, 128 off9664 00000040:00080000:0.0:1788528584.134527:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].9, 224 off9888 00000040:00080000:0.0:1788528584.134539:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].10, 224 off10112 00000040:00080000:0.0:1788528584.134550:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].11, 128 off10240 00000100:00100000:0.0:1788528584.134594:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735538944:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788528584.134628:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528584.134660:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f8e3cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788528584.134706:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735538944 00000100:00100000:1.0:1788528584.134711:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735538944 00000100:00100000:1.0:1788528584.134751:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788528584.134758:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+18:17134:x1875407735538944:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788528584.134828:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+18:17134:x1875407735538944:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 70us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528584.134835:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788528584.135028:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735538944:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788528584.135062:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].12, 224 off10464 00000040:00080000:0.0:1788528584.135070:0:17134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000040:00080000:2.0:1788528584.138017:0:18352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 64768 count 13 00000020:01000000:0.0:1788528584.140318:0:17134:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788528584.140341:0:17134:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788528584.140353:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8d32 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8d39 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528584.140366:0:17134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8d32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8d39 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528584.140398:0:17134:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:0.0:1788528584.140401:0:17134:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a8fc477d800 from 13 10000000:01000000:0.0:1788528584.140403:0:17134:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788528584.140441:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c8d40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528584.140449:0:17134:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c8d40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528584.140459:0:17134:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c8d40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528584.140482:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735539072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788528584.140538:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528584.140755:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f8e3cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788528584.141131:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735539072 00000100:00100000:1.0:1788528584.141147:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735539072 00000100:00100000:1.0:1788528584.141234:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788528584.141244:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+18:17134:x1875407735539072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788528584.141259:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528584.141272:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c1551c00/0x892c60dda91c8d47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8d40 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528584.141304:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c1551c00/0x892c60dda91c8d47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8d40 expref: 19 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528584.141314:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c1551c00/0x892c60dda91c8d47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8d40 expref: 19 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528584.141322:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c1551c00, rc 0) 00000100:00100000:1.0:1788528584.141407:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:17134:x1875407735539072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528584.141414:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788528584.141534:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735539072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788528584.141549:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c8d40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8d47 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528584.141599:0:17134:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c8d40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8d47 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528584.141637:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735539200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788528584.141666:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528584.141683:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f8e3cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788528584.141743:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735539200 00000100:00100000:3.0:1788528584.141748:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735539200 00000100:00100000:3.0:1788528584.141777:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788528584.141784:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:17134:x1875407735539200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528584.142143:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:17134:x1875407735539200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 350us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528584.142151:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788528584.142405:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735539200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788528584.142434:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735539328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788528584.142477:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528584.142498:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f8e3cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788528584.142575:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735539328 00000100:00100000:2.0:1788528584.142579:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735539328 00000100:00100000:2.0:1788528584.142603:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788528584.142610:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:17134:x1875407735539328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788528584.142699:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:17134:x1875407735539328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528584.142706:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788528584.142841:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735539328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788528584.149426:0:18353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788528584.149642:0:17134:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788528584.149655:0:17134:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788528584.149666:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c8d40 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8d47 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528584.149677:0:17134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c8d40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8d47 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528584.391243:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735539456:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788528584.391313:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528584.391367:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735539456 00000100:00100000:0.0:1788528584.391374:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735539456 00000100:00100000:0.0:1788528584.391416:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788528584.391424:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4675c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735539456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788528584.391458:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788528584.391634:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4675c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735539456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 210us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528584.391641:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788528584.391685:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735539456:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788528584.639704:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528584.894658:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788528574/real 1788528574] req@ffff8a8fc4676300 x1875407735533312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528584 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528584.894689:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a8fc4676300 x1875407735533312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528584 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528584.894712:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788528584.894718:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788528574/real 1788528574] req@ffff8a90f58c1c00 x1875407735533184/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528584 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528584.894730:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735539584:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788528584.894735:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a90f58c1c00 x1875407735533184/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528584 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528584.894748:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788528569/real 1788528569] req@ffff8a90f58c2680 x1875407735530880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528584 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528584.894762:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a90f58c2680 x1875407735530880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528584 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528584.894770:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788528569/real 1788528569] req@ffff8a90f58c2d80 x1875407735531008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528584 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528584.894782:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a90f58c2d80 x1875407735531008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528584 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788528584.894797:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90f58dd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1788528584.894801:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788528584.894810:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788528584.894815:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4676300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735533312:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788528584.894822:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90f6ee8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788528584.894827:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788528584.894831:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735533184:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788528584.894836:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d08800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788528584.894842:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788528584.894845:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735530880:0@lo:8:kworker.0 00000100:00080000:0.0:1788528584.894860:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90de3f4000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788528584.894867:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788528584.894871:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735539584 00000100:00100000:0.0:1788528584.894871:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735531008:0@lo:8:kworker.0 00000100:00100000:1.0:1788528584.894881:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735539584 00000100:00100000:1.0:1788528584.894926:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788528584.894936:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1875407735539584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788528584.894967:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788528584.895016:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1875407735539584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528584.895023:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788528584.895246:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735539584:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1788528584.895261:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788528584.895266:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:463b8984-c30b-4b73-b2f1-81113bd4e10a:3640:1875407735539712:0@lo:400:kworker.0 00000100:00080000:3.0:1788528584.895267:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788528584.895272:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d08800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788528584.895279:0:469:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 438 00000100:00080000:3.0:1788528584.895284:0:469:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788528584.895289:0:469:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a8fc1d08800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528584.895310:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90f58c2d80 x1875407735539840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788528584.895324:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528584.895327:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788528584.895329:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a90de3f4000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788528584.895332:0:469:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 438 00000100:00080000:3.0:1788528584.895334:0:469:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788528584.895337:0:469:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a90de3f4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1788528584.895348:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528584.895351:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90f58c2680 x1875407735539968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788528584.895398:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735539712 00000100:00100000:0.0:1788528584.895403:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735539712 00000100:00080000:3.0:1788528584.895405:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528584.895409:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788528584.895412:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a90f6ee8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788528584.895415:0:469:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 443 00000100:00080000:3.0:1788528584.895418:0:469:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788528584.895422:0:469:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a90f6ee8800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528584.895435:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90f58c1880 x1875407735540352/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788528584.895440:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1788528584.895451:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788528584.895452:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:3640:x1875407735539712:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788528584.895458:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788528584.895461:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a90f58dd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788528584.895465:0:469:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 443 00000100:00080000:3.0:1788528584.895468:0:469:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788528584.895471:0:469:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a90f58dd000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528584.895484:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90f58c2a00 x1875407735540480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788528584.895492:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:3640:x1875407735539712:12345-0@lo:400:kworker.0 Request processed in 42us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528584.895501:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788528584.895531:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735540224:0@lo:400:kworker.0 00000100:00100000:1.0:1788528584.895574:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735540608:0@lo:400:kworker.0 00000100:00100000:0.0:1788528584.895575:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528584.895609:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788528584.895616:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528584.895619:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735540096:0@lo:400:kworker.0 00000100:00100000:0.0:1788528584.895649:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528584.895683:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735540608 00000100:00100000:0.0:1788528584.895686:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735540608 00000100:00100000:0.0:1788528584.895708:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735540096 00000100:00100000:0.0:1788528584.895891:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735540096 00000100:00100000:0.0:1788528584.895913:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788528584.895919:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735540608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528584.895954:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735540608:12345-0@lo:400:kworker.0 Request processed in 35us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528584.895967:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788528584.895981:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788528584.895987:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735540096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528584.896022:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735540096:12345-0@lo:400:kworker.0 Request processed in 36us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528584.896028:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788528584.896137:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a90f58c1c00 x1875407735540096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528584.896149:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735540096:0@lo:400:kworker.0 00010000:00080000:1.0:1788528584.896160:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a90f58c1f80 x1875407735540608/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528584.896173:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735539840:0@lo:8:kworker.0 00000100:00100000:1.0:1788528584.896174:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735540608:0@lo:400:kworker.0 00000400:00000100:0.0:1788528584.896198:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875407735539840 offset 0 length 520: 4 00000100:00100000:0.0:1788528584.896221:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735539968:0@lo:8:kworker.0 00000400:00000100:0.0:1788528584.896234:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875407735539968 offset 0 length 520: 4 00000100:00100000:0.0:1788528584.896246:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735540352:0@lo:8:kworker.0 00000100:00100000:3.0:1788528584.896260:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735540224 00000100:00100000:3.0:1788528584.896266:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735540224 00000400:00000100:0.0:1788528584.896266:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875407735540352 offset 0 length 520: 4 00000100:00100000:0.0:1788528584.896282:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735540480:0@lo:8:kworker.0 00000400:00000100:0.0:1788528584.896302:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875407735540480 offset 0 length 520: 4 00000100:00100000:3.0:1788528584.896309:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788528584.896319:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4676300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735540224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528584.896336:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:463b8984-c30b-4b73-b2f1-81113bd4e10a:3640:1875407735539712:0@lo:400:kworker.0 00000100:00100000:3.0:1788528584.896367:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4676300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735540224:12345-0@lo:400:kworker.0 Request processed in 49us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528584.896374:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788528584.896397:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735540224:0@lo:400:kworker.0 00010000:00010000:3.0:1788528585.663747:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788528585.923295:0:17870:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:0.0:1788528586.624715:0:17889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788528586.686885:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528587.710841:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528588.735719:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788528589.418981:0:18639:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:3.0:1788528589.418985:0:18639:0:(obd_mount.c:928:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788528589.418987:0:18639:0:(obd_mount.c:931:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788528589.419092:0:18639:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a90fe6bc000 00000020:01000004:3.0:1788528589.419118:0:18639:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788528589.419132:0:18639:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788528589.419147:0:18639:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8a8fc35e4c80) 00000020:00000080:3.0:1788528589.419163:0:18639:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788528589.476270:0:18639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788528589.478703:0:18639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788528589.479182:0:18639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788528589.479395:0:18639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788528589.479620:0:18639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788528589.479836:0:18639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788528589.480058:0:18639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:2.0:1788528589.482031:0:18639:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788528589.482271:0:18639:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788528589.482285:0:18639:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788528589.482296:0:18639:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x892c60dda91c8d55 00000020:01000004:2.0:1788528589.482302:0:18639:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788528589.482322:0:18639:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.138@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788528589.482326:0:18639:0:(mgc_request.c:1317:mgc_set_info_async()) InitRecov MGC192.168.203.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788528589.482331:0:18639:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788528589.482336:0:18639:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788528589.482345:0:18639:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8a90f7dee600) 00000020:00000080:2.0:1788528589.482356:0:18639:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1788528589.483526:0:18639:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788528589.483718:0:18639:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788528589.483727:0:18639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788528589.487795:0:18639:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788528589.487807:0:18639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788528589.495665:0:18639:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788528589.496275:0:18639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788528589.498018:0:18639:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788528589.498204:0:18639:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788528589.498215:0:18639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788528589.499072:0:18639:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788528589.499079:0:18639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788528589.517377:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735540736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788528589.517450:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528589.523344:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735540736 00000100:00100000:3.0:1788528589.523358:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735540736 00000100:00100000:3.0:1788528589.523417:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788528589.523426:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735540736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788528589.523461:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788528589.530379:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735540736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6945us (12919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528589.530393:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788528589.533457:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735540736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788528589.540232:0:18639:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788528589.540471:0:18639:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788528589.540477:0:18639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788528589.546748:0:18639:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788528589.546767:0:18639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788528589.548214:0:18639:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788528589.548282:0:18639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788528589.552785:0:18639:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788528589.553143:0:18639:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788528589.553149:0:18639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788528589.553767:0:18639:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788528589.553785:0:18639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788528589.670692:0:18639:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788528589.671085:0:18639:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788528589.671093:0:18639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788528589.674824:0:18639:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788528589.674853:0:18639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788528589.676084:0:18639:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788528589.676137:0:18639:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.138@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788528589.676143:0:18639:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788528589.676145:0:18639:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788528589.676147:0:18639:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788528589.676148:0:18639:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788528589.676149:0:18639:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788528589.676151:0:18639:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788528589.676152:0:18639:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788528589.676154:0:18639:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788528589.676155:0:18639:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788528589.676158:0:18639:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788528589.676160:0:18639:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788528589.676161:0:18639:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788528589.676162:0:18639:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788528589.676163:0:18639:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788528589.676164:0:18639:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788528589.676165:0:18639:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788528589.676166:0:18639:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788528589.676167:0:18639:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788528589.676167:0:18639:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788528589.676192:0:18639:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788528589.676212:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735540864:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788528589.676285:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528589.676384:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d61c46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528589.676424:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735540864 00000100:00100000:1.0:1788528589.676431:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735540864 00000100:00100000:1.0:1788528589.676479:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788528589.676488:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:18639:x1875407735540864:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788528589.676809:0:17132:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788528589.676813:0:17132:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788528589.676817:0:17132:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788528589.677521:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:18639:x1875407735540864:12345-0@lo:253:mount.lustre.0 Request processed in 1032us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528589.677530:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788528589.680021:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735540864:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788528589.680041:0:18639:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788528589.680044:0:18639:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788528589.680046:0:18639:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788528589.680047:0:18639:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788528589.680048:0:18639:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788528589.680050:0:18639:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788528589.680051:0:18639:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788528589.680055:0:18639:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788528589.680056:0:18639:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788528589.680072:0:18639:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788528589.680121:0:18639:0:(tgt_mount.c:115:server_register_mount()) register mount ffff8a90fe6bc000 from lustre-OST0000 10000000:01000000:2.0:1788528589.680152:0:18639:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788528589.680155:0:18639:0:(mgc_request.c:423:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788528589.680161:0:18639:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8a90fe6bc000 10000000:01000000:2.0:1788528589.680166:0:18639:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788528589.680192:0:18639:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-OST0000-osd 00000040:01000000:3.0:1788528589.697209:0:18639:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788528589.709115:0:18639:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788528589.709142:0:18639:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff8a90fe6bc000 from 1 10000000:01000000:3.0:1788528589.709146:0:18639:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788528589.709186:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428800/0x892c60dda91c8d63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528589.709197:0:18639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428800/0x892c60dda91c8d63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528589.709208:0:18639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428800/0x892c60dda91c8d63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528589.709290:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735540992:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788528589.709352:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528589.709459:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de34bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528589.710624:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735540992 00000100:00100000:0.0:1788528589.710694:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735540992 00000100:00100000:0.0:1788528589.710798:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788528589.710810:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+19:18639:x1875407735540992:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788528589.710834:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528589.710851:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c0030800/0x892c60dda91c8d6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8d63 expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528589.710877:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c0030800/0x892c60dda91c8d6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8d63 expref: 20 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528589.710888:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c0030800/0x892c60dda91c8d6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8d63 expref: 20 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528589.710898:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0030800, rc 0) 00000100:00100000:0.0:1788528589.710972:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+20:18639:x1875407735540992:12345-0@lo:101:mount.lustre.0 Request processed in 165us (1620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528589.710978:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788528589.711054:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735540992:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788528589.711070:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428800/0x892c60dda91c8d63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8d6a expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528589.711081:0:18639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428800/0x892c60dda91c8d63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8d6a expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528589.711173:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735541120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788528589.711205:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528589.711463:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de34bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528589.711540:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735541120 00000100:00100000:2.0:1788528589.711546:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735541120 00000100:00100000:2.0:1788528589.711605:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788528589.711612:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+20:18639:x1875407735541120:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788528589.712175:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+20:18639:x1875407735541120:12345-0@lo:501:mount.lustre.0 Request processed in 562us (968us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788528589.712184:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788528589.716486:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735541120:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788528589.716517:0:18639:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.203.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:3.0:1788528589.716623:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735541248:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788528589.716874:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528589.716911:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de34bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528589.716962:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735541248 00000100:00100000:2.0:1788528589.716968:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735541248 00000100:00100000:2.0:1788528589.717013:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788528589.717022:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+20:18639:x1875407735541248:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788528589.717106:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+20:18639:x1875407735541248:12345-0@lo:501:mount.lustre.0 Request processed in 76us (222us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788528589.717113:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788528589.717288:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735541248:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788528589.717312:0:18639:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788528589.717333:0:18639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428800/0x892c60dda91c8d63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8d6a expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528589.717343:0:18639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428800/0x892c60dda91c8d63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8d6a expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528589.717354:0:18639:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff8a90fe6bc000 10000000:01000000:3.0:1788528589.717359:0:18639:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788528589.717396:0:18639:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-OST0000-osd 00000040:01000000:3.0:1788528589.717473:0:18639:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788528589.717479:0:18639:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788528589.717488:0:18639:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788528589.717492:0:18639:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788528589.717517:0:18639:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-OST0000-osd 00000040:01000000:3.0:1788528589.717546:0:18639:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788528589.717551:0:18639:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788528589.717624:0:18639:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788528589.717628:0:18639:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788528589.717770:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429600/0x892c60dda91c8d71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528589.717778:0:18639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429600/0x892c60dda91c8d71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528589.717786:0:18639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429600/0x892c60dda91c8d71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528589.717812:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735541376:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788528589.717845:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528589.718015:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de34bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788528589.718432:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735541376 00000100:00100000:1.0:1788528589.718439:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735541376 00000100:00100000:1.0:1788528589.718530:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788528589.718539:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+20:18639:x1875407735541376:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788528589.718580:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528589.718594:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c1551800/0x892c60dda91c8d78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8d71 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528589.718618:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c1551800/0x892c60dda91c8d78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8d71 expref: 21 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528589.718629:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c1551800/0x892c60dda91c8d78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8d71 expref: 21 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528589.718647:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c1551800, rc 0) 00000100:00100000:1.0:1788528589.718701:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+21:18639:x1875407735541376:12345-0@lo:101:mount.lustre.0 Request processed in 164us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528589.718709:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788528589.718807:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735541376:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788528589.718834:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429600/0x892c60dda91c8d71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8d78 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528589.718843:0:18639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429600/0x892c60dda91c8d71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8d78 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788528589.720379:0:18639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000040:00080000:3.0:1788528589.721135:0:18639:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788528589.725039:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].1, 224 off8416 00000040:00080000:3.0:1788528589.725109:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].2, 128 off8544 00000040:00080000:3.0:1788528589.725128:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].3, 112 off8656 00000040:00080000:3.0:1788528589.725142:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].4, 224 off8880 00000040:00080000:3.0:1788528589.725155:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].5, 224 off9104 00000040:00080000:3.0:1788528589.725168:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].6, 80 off9184 00000040:00080000:3.0:1788528589.725180:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].7, 224 off9408 00000040:00080000:3.0:1788528589.725192:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].8, 224 off9632 00000040:00080000:3.0:1788528589.725204:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].9, 80 off9712 00000040:00080000:3.0:1788528589.725358:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].10, 224 off9936 00000040:00080000:3.0:1788528589.725382:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].11, 224 off10160 00000040:00080000:3.0:1788528589.725396:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].12, 120 off10280 00000040:00080000:3.0:1788528589.725423:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].13, 224 off10504 00000040:00080000:3.0:1788528589.725428:0:18639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 13 count 14 00000100:00100000:3.0:1788528589.725530:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735541504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788528589.725624:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528589.725674:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d146e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788528589.725811:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735541504 00000100:00100000:0.0:1788528589.725875:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735541504 00000100:00100000:0.0:1788528589.725930:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788528589.725938:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+21:18639:x1875407735541504:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788528589.726091:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+21:18639:x1875407735541504:12345-0@lo:501:mount.lustre.0 Request processed in 152us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528589.726106:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788528589.726301:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735541504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788528589.726331:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735541632:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788528589.726369:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528589.726396:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d146e600 going to sleep for 11 seconds 00000100:00100000:1.0:1788528589.726582:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735541632 00000100:00100000:1.0:1788528589.726589:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735541632 00000100:00100000:1.0:1788528589.726622:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788528589.726629:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+21:18639:x1875407735541632:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788528589.728155:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+21:18639:x1875407735541632:12345-0@lo:503:mount.lustre.0 Request processed in 1521us (1779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528589.728167:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788528589.728305:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735541632:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788528589.729037:0:18639:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788528589.729139:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735541760:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788528589.729189:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528589.729351:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d146e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788528589.729394:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735541760 00000100:00100000:2.0:1788528589.729401:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735541760 00000100:00100000:2.0:1788528589.729488:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788528589.729499:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+21:18639:x1875407735541760:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788528589.730002:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+21:18639:x1875407735541760:12345-0@lo:502:mount.lustre.0 Request processed in 504us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528589.730010:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788528589.730091:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735541760:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788528589.730287:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].1, 224 off8416 00000040:00080000:3.0:1788528589.730314:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].2, 128 off8544 00000040:00080000:3.0:1788528589.730328:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].3, 112 off8656 00000040:00080000:3.0:1788528589.730343:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].4, 224 off8880 00000040:00080000:3.0:1788528589.730357:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].5, 224 off9104 00000040:00080000:3.0:1788528589.730371:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].6, 80 off9184 00000040:00080000:3.0:1788528589.730383:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].7, 224 off9408 00000040:00080000:3.0:1788528589.730395:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].8, 224 off9632 00000040:00080000:3.0:1788528589.730620:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].9, 80 off9712 00000040:00080000:3.0:1788528589.730654:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].10, 224 off9936 00000040:00080000:3.0:1788528589.730669:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].11, 224 off10160 00000040:00080000:3.0:1788528589.730680:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].12, 120 off10280 00000100:00100000:3.0:1788528589.730705:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735541888:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788528589.730746:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528589.731647:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d146e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788528589.731868:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735541888 00000100:00100000:0.0:1788528589.731877:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735541888 00000100:00100000:0.0:1788528589.731917:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788528589.732078:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+21:18639:x1875407735541888:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788528589.732331:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+21:18639:x1875407735541888:12345-0@lo:502:mount.lustre.0 Request processed in 257us (1583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528589.732340:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788528589.732487:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735541888:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788528589.732877:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].13, 224 off10504 00000040:00080000:3.0:1788528589.732893:0:18639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788528589.734372:0:18656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788528589.734383:0:18656:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788528589.734390:0:18656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528589.734393:0:18656:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788528589.734398:0:18656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788528589.734413:0:18656:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8a90ce96cc80) 00000020:00000080:1.0:1788528589.734439:0:18656:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788528589.734445:0:18656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788528589.734529:0:18656:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a90fe6bc000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788528589.734537:0:18656:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788528589.734545:0:18656:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x892c60dda91c8d86 00010000:00010000:1.0:1788528589.744163:0:18656:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1788528589.745644:0:18656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1788528589.753237:0:18656:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1788528589.755016:0:18656:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788528589.755029:0:18656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788528589.755036:0:18656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528589.755038:0:18656:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788528589.755041:0:18656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788528589.755044:0:18656:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1788528589.755045:0:18656:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788528589.755047:0:18656:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788528589.755049:0:18656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788528589.755051:0:18656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528589.755052:0:18656:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788528589.755055:0:18656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788528589.755058:0:18656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528589.755059:0:18656:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788528589.755062:0:18656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788528589.755064:0:18656:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788528589.755067:0:18656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788528589.755069:0:18656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528589.755070:0:18656:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788528589.755072:0:18656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788528589.755074:0:18656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528589.755076:0:18656:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788528589.755079:0:18656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788528589.755116:0:18656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788528589.755119:0:18656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528589.755121:0:18656:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788528589.755124:0:18656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 14 count 14 00000020:01000000:3.0:1788528589.755348:0:18639:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788528589.755362:0:18639:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788528589.755385:0:18639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429600/0x892c60dda91c8d71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8d78 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528589.755397:0:18639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429600/0x892c60dda91c8d71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8d78 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528589.755406:0:18639:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a90fe6bc000 from 1 10000000:01000000:3.0:1788528589.755409:0:18639:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788528589.755444:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429200/0x892c60dda91c8d8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528589.755452:0:18639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429200/0x892c60dda91c8d8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528589.755462:0:18639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429200/0x892c60dda91c8d8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528589.755485:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735542016:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788528589.755582:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528589.755613:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d146e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788528589.756664:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735542016 00000100:00100000:2.0:1788528589.756674:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735542016 00000100:00100000:2.0:1788528589.756721:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788528589.756731:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+21:18639:x1875407735542016:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788528589.756745:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528589.756759:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9101850a00/0x892c60dda91c8d94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8d8d expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528589.756798:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101850a00/0x892c60dda91c8d94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8d8d expref: 22 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528589.756808:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9101850a00/0x892c60dda91c8d94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8d8d expref: 22 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528589.756817:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101850a00, rc 0) 00000100:00100000:2.0:1788528589.756869:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+22:18639:x1875407735542016:12345-0@lo:101:mount.lustre.0 Request processed in 140us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528589.756875:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788528589.758497:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735542016:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788528589.758527:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429200/0x892c60dda91c8d8d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8d94 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528589.758538:0:18639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429200/0x892c60dda91c8d8d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8d94 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528589.759692:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788528589.761451:0:18639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 13 count 13 00000040:00080000:3.0:1788528589.762040:0:18639:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788528589.764916:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].1, 224 off8416 00000040:00080000:3.0:1788528589.764966:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].2, 112 off8528 00000040:00080000:3.0:1788528589.764981:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].3, 224 off8752 00000040:00080000:3.0:1788528589.764991:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].4, 224 off8976 00000040:00080000:3.0:1788528589.765001:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].5, 112 off9088 00000040:00080000:3.0:1788528589.765011:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].6, 224 off9312 00000040:00080000:3.0:1788528589.765021:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].7, 224 off9536 00000040:00080000:3.0:1788528589.765030:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].8, 128 off9664 00000040:00080000:3.0:1788528589.765040:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].9, 224 off9888 00000040:00080000:3.0:1788528589.765052:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].10, 224 off10112 00000040:00080000:3.0:1788528589.765063:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].11, 128 off10240 00000040:00080000:3.0:1788528589.765081:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].12, 224 off10464 00000040:00080000:3.0:1788528589.765085:0:18639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 12 count 13 00000100:00100000:3.0:1788528589.765204:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735542144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788528589.765263:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528589.765304:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d146e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528589.766017:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735542144 00000100:00100000:0.0:1788528589.766027:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735542144 00000100:00100000:0.0:1788528589.766124:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788528589.766134:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+22:18639:x1875407735542144:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788528589.766281:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+22:18639:x1875407735542144:12345-0@lo:501:mount.lustre.0 Request processed in 149us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528589.766289:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788528589.766404:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735542144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788528589.766441:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735542272:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788528589.766491:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528589.768665:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d146e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528589.768851:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735542272 00000100:00100000:2.0:1788528589.768860:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735542272 00000100:00100000:2.0:1788528589.768902:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788528589.768911:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+22:18639:x1875407735542272:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788528589.769055:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+22:18639:x1875407735542272:12345-0@lo:503:mount.lustre.0 Request processed in 145us (2564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528589.769063:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788528589.769177:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735542272:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788528589.769615:0:18639:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788528589.769698:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735542400:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788528589.769743:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528589.769769:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de34b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528589.770034:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735542400 00000100:00100000:2.0:1788528589.770039:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735542400 00000100:00100000:2.0:1788528589.770064:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788528589.770071:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+22:18639:x1875407735542400:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788528589.770176:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+22:18639:x1875407735542400:12345-0@lo:502:mount.lustre.0 Request processed in 104us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528589.770183:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788528589.770342:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735542400:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788528589.770582:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].1, 224 off8416 00000040:00080000:3.0:1788528589.770621:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].2, 112 off8528 00000040:00080000:3.0:1788528589.770634:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].3, 224 off8752 00000040:00080000:3.0:1788528589.770648:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].4, 224 off8976 00000040:00080000:3.0:1788528589.770660:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].5, 112 off9088 00000040:00080000:3.0:1788528589.770671:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].6, 224 off9312 00000040:00080000:3.0:1788528589.770684:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].7, 224 off9536 00000040:00080000:3.0:1788528589.770696:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].8, 128 off9664 00000040:00080000:3.0:1788528589.770708:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].9, 224 off9888 00000040:00080000:3.0:1788528589.770720:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].10, 224 off10112 00000040:00080000:3.0:1788528589.770732:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].11, 128 off10240 00000100:00100000:3.0:1788528589.770754:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735542528:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788528589.770792:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528589.770810:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de34b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528589.771369:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735542528 00000100:00100000:2.0:1788528589.771377:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735542528 00000100:00100000:2.0:1788528589.771414:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788528589.771420:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+22:18639:x1875407735542528:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788528589.771519:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+22:18639:x1875407735542528:12345-0@lo:502:mount.lustre.0 Request processed in 98us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528589.771527:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788528589.771683:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735542528:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788528589.771735:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].12, 224 off10464 00000040:00080000:3.0:1788528589.771745:0:18639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788528589.772437:0:18660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788528589.772448:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528589.772450:0:18660:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788528589.772457:0:18660:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a90fe6bc000 00000020:00000080:3.0:1788528589.772460:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788528589.772467:0:18660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788528589.772469:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528589.772471:0:18660:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788528589.772473:0:18660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788528589.772476:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528589.772477:0:18660:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788528589.772488:0:18660:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a90fe6bc000 00000020:00000080:3.0:1788528589.772490:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788528589.772536:0:18660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788528589.772539:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528589.772540:0:18660:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788528589.772543:0:18660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788528589.772546:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528589.772547:0:18660:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788528589.772579:0:18660:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a90fe6bc000 00000020:00000080:3.0:1788528589.772583:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788528589.772603:0:18660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788528589.772606:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528589.772607:0:18660:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788528589.772610:0:18660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788528589.772613:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528589.772614:0:18660:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788528589.772617:0:18660:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a90fe6bc000 00000020:00000080:3.0:1788528589.772619:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788528589.772641:0:18660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788528589.772644:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528589.772645:0:18660:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788528589.772649:0:18660:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 13 count 13 00000020:01000000:2.0:1788528589.773432:0:18639:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788528589.773446:0:18639:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788528589.773463:0:18639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429200/0x892c60dda91c8d8d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8d94 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528589.773474:0:18639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429200/0x892c60dda91c8d8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8d94 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528589.773540:0:18639:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788528589.773543:0:18639:0:(mgc_request.c:423:config_log_add()) add config log lustre-client-ffff8a90fe6bc000 10000000:01000000:2.0:1788528589.773547:0:18639:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff8a90fe6bc000 10000000:01000000:2.0:1788528589.773551:0:18639:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788528589.773582:0:18639:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-OST0000-osd 00000040:01000000:2.0:1788528589.773631:0:18639:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788528589.773638:0:18639:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788528589.773656:0:18639:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff8a90fe6bc000 from 1 10000000:01000000:2.0:1788528589.773659:0:18639:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788528589.773692:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851000/0x892c60dda91c8d9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528589.773701:0:18639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a9101851000/0x892c60dda91c8d9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528589.773710:0:18639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a9101851000/0x892c60dda91c8d9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528589.773744:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735542656:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788528589.773801:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528589.773845:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f8db7780 going to sleep for 11 seconds 00000100:00100000:1.0:1788528589.774421:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735542656 00000100:00100000:1.0:1788528589.774429:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735542656 00000100:00100000:1.0:1788528589.774478:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788528589.774488:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+22:18639:x1875407735542656:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788528589.774511:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528589.774524:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c8da2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8d9b expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528589.774547:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c8da2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8d9b expref: 23 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528589.776833:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c8da2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8d9b expref: 23 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528589.776845:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c1550a00, rc 0) 00000100:00100000:1.0:1788528589.776927:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:18639:x1875407735542656:12345-0@lo:101:mount.lustre.0 Request processed in 2439us (3129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528589.776935:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788528589.779461:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735542656:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788528589.779487:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a9101851000/0x892c60dda91c8d9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8da2 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528589.779499:0:18639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a9101851000/0x892c60dda91c8d9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8da2 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788528589.781977:0:18639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1788528589.782270:0:18639:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788528589.782470:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].1, 224 off8416 00000040:00080000:3.0:1788528589.782518:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].2, 120 off8536 00000040:00080000:3.0:1788528589.782535:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].3, 168 off8704 00000040:00080000:3.0:1788528589.782548:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].4, 224 off8928 00000040:00080000:3.0:1788528589.782585:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].5, 224 off9152 00000040:00080000:3.0:1788528589.782600:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].6, 120 off9272 00000040:00080000:3.0:1788528589.782615:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].7, 168 off9440 00000040:00080000:3.0:1788528589.782629:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].8, 224 off9664 00000040:00080000:3.0:1788528589.782643:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].9, 224 off9888 00000040:00080000:3.0:1788528589.782656:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].10, 120 off10008 00000040:00080000:3.0:1788528589.782669:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].11, 224 off10232 00000040:00080000:3.0:1788528589.782681:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].12, 224 off10456 00000040:00080000:3.0:1788528589.782695:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].13, 88 off10544 00000040:00080000:3.0:1788528589.782710:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].14, 128 off10672 00000040:00080000:3.0:1788528589.782726:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].15, 144 off10816 00000040:00080000:3.0:1788528589.782756:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].16, 160 off10976 00000040:00080000:3.0:1788528589.782771:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].17, 224 off11200 00000040:00080000:3.0:1788528589.782782:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].18, 224 off11424 00000040:00080000:3.0:1788528589.782793:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].19, 80 off11504 00000040:00080000:3.0:1788528589.782804:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].20, 224 off11728 00000040:00080000:3.0:1788528589.782816:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].21, 224 off11952 00000040:00080000:3.0:1788528589.782828:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].22, 88 off12040 00000040:00080000:3.0:1788528589.782840:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].23, 128 off12168 00000040:00080000:3.0:1788528589.782852:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].24, 144 off12312 00000040:00080000:3.0:1788528589.782864:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].25, 160 off12472 00000040:00080000:3.0:1788528589.782876:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].26, 224 off12696 00000040:00080000:3.0:1788528589.782888:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].27, 224 off12920 00000040:00080000:3.0:1788528589.782902:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].28, 80 off13000 00000040:00080000:3.0:1788528589.782915:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].29, 224 off13224 00000040:00080000:3.0:1788528589.782929:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].30, 224 off13448 00000040:00080000:3.0:1788528589.782943:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].31, 88 off13536 00000040:00080000:3.0:1788528589.782973:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].32, 128 off13664 00000040:00080000:3.0:1788528589.782988:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].33, 144 off13808 00000040:00080000:3.0:1788528589.783000:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].34, 128 off13936 00000040:00080000:3.0:1788528589.783025:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].35, 224 off14160 00000040:00080000:3.0:1788528589.783038:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].36, 224 off14384 00000040:00080000:3.0:1788528589.783049:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].37, 80 off14464 00000040:00080000:3.0:1788528589.783063:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].38, 224 off14688 00000040:00080000:3.0:1788528589.783076:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].39, 224 off14912 00000040:00080000:3.0:1788528589.783090:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].40, 88 off15000 00000040:00080000:3.0:1788528589.783119:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].41, 128 off15128 00000040:00080000:3.0:1788528589.783136:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].42, 144 off15272 00000040:00080000:3.0:1788528589.783149:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].43, 128 off15400 00000040:00080000:3.0:1788528589.783162:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].44, 224 off15624 00000040:00080000:3.0:1788528589.783175:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].45, 224 off15848 00000040:00080000:3.0:1788528589.783187:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].46, 80 off15928 00000040:00080000:3.0:1788528589.783197:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].47, 224 off16152 00000040:00080000:3.0:1788528589.783224:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].48, 232 off16384 00000040:00080000:3.0:1788528589.783347:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].49, 224 off16608 00000040:00080000:3.0:1788528589.783370:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].50, 120 off16728 00000040:00080000:3.0:1788528589.783389:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].51, 224 off16952 00000040:00080000:3.0:1788528589.783395:0:18639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1788528589.783486:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735542784:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788528589.783576:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528589.783618:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d146e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788528589.783919:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735542784 00000100:00100000:1.0:1788528589.783927:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735542784 00000100:00100000:1.0:1788528589.783981:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788528589.783990:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:18639:x1875407735542784:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788528589.784127:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:18639:x1875407735542784:12345-0@lo:501:mount.lustre.0 Request processed in 137us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528589.784134:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788528589.787479:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735542784:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788528589.787778:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735542912:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788528589.787850:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528589.787892:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d146e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788528589.787965:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735542912 00000100:00100000:1.0:1788528589.787972:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735542912 00000100:00100000:1.0:1788528589.788025:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788528589.788033:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:18639:x1875407735542912:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788528589.788152:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:18639:x1875407735542912:12345-0@lo:503:mount.lustre.0 Request processed in 118us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528589.788169:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788528589.788630:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735542912:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788528589.789019:0:18639:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788528589.789087:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735543040:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788528589.789150:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528589.789179:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735543040 00000100:00100000:3.0:1788528589.789184:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735543040 00000100:00100000:3.0:1788528589.789228:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788528589.789236:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:18639:x1875407735543040:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788528589.789321:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:18639:x1875407735543040:12345-0@lo:502:mount.lustre.0 Request processed in 86us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528589.789329:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788528589.789373:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d146e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788528589.789387:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735543040:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788528589.789543:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].1, 224 off8416 00000040:00080000:3.0:1788528589.789590:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].2, 120 off8536 00000040:00080000:3.0:1788528589.789604:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].3, 168 off8704 00000040:00080000:3.0:1788528589.789620:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].4, 224 off8928 00000040:00080000:3.0:1788528589.789634:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].5, 224 off9152 00000040:00080000:3.0:1788528589.789647:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].6, 120 off9272 00000040:00080000:3.0:1788528589.789659:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].7, 168 off9440 00000040:00080000:3.0:1788528589.789672:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].8, 224 off9664 00000040:00080000:3.0:1788528589.789683:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].9, 224 off9888 00000040:00080000:3.0:1788528589.789693:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].10, 120 off10008 00000040:00080000:3.0:1788528589.789720:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].11, 224 off10232 00000040:00080000:3.0:1788528589.789736:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].12, 224 off10456 00000040:00080000:3.0:1788528589.789748:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].13, 88 off10544 00000040:00080000:3.0:1788528589.789762:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].14, 128 off10672 00000040:00080000:3.0:1788528589.789775:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].15, 144 off10816 00000040:00080000:3.0:1788528589.789788:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].16, 160 off10976 00000040:00080000:3.0:1788528589.789802:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].17, 224 off11200 00000040:00080000:3.0:1788528589.789816:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].18, 224 off11424 00000040:00080000:3.0:1788528589.789831:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].19, 80 off11504 00000040:00080000:3.0:1788528589.789856:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].20, 224 off11728 00000040:00080000:3.0:1788528589.789869:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].21, 224 off11952 00000040:00080000:3.0:1788528589.789881:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].22, 88 off12040 00000040:00080000:3.0:1788528589.789894:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].23, 128 off12168 00000040:00080000:3.0:1788528589.789907:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].24, 144 off12312 00000040:00080000:3.0:1788528589.789920:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].25, 160 off12472 00000040:00080000:3.0:1788528589.789934:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].26, 224 off12696 00000040:00080000:3.0:1788528589.789960:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].27, 224 off12920 00000040:00080000:3.0:1788528589.789976:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].28, 80 off13000 00000040:00080000:3.0:1788528589.789990:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].29, 224 off13224 00000040:00080000:3.0:1788528589.790003:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].30, 224 off13448 00000040:00080000:3.0:1788528589.790013:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].31, 88 off13536 00000040:00080000:3.0:1788528589.790024:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].32, 128 off13664 00000040:00080000:3.0:1788528589.790035:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].33, 144 off13808 00000040:00080000:3.0:1788528589.790047:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].34, 128 off13936 00000040:00080000:3.0:1788528589.790060:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].35, 224 off14160 00000040:00080000:3.0:1788528589.790074:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].36, 224 off14384 00000040:00080000:3.0:1788528589.790087:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].37, 80 off14464 00000040:00080000:3.0:1788528589.790115:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].38, 224 off14688 00000040:00080000:3.0:1788528589.790131:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].39, 224 off14912 00000040:00080000:3.0:1788528589.790143:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].40, 88 off15000 00000040:00080000:3.0:1788528589.790155:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].41, 128 off15128 00000040:00080000:3.0:1788528589.790168:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].42, 144 off15272 00000040:00080000:3.0:1788528589.790192:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].43, 128 off15400 00000040:00080000:3.0:1788528589.790207:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].44, 224 off15624 00000040:00080000:3.0:1788528589.790220:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].45, 224 off15848 00000040:00080000:3.0:1788528589.790233:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].46, 80 off15928 00000040:00080000:3.0:1788528589.790245:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].47, 224 off16152 00000040:00080000:3.0:1788528589.790258:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].48, 232 off16384 00000100:00100000:3.0:1788528589.790292:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735543168:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788528589.790339:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528589.790379:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735543168 00000100:00100000:3.0:1788528589.790389:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735543168 00000100:00100000:3.0:1788528589.790420:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788528589.790427:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:18639:x1875407735543168:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788528589.790505:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:18639:x1875407735543168:12345-0@lo:502:mount.lustre.0 Request processed in 78us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528589.790512:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788528589.790548:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d146e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788528589.790585:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735543168:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788528589.790719:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].49, 224 off16608 00000040:00080000:3.0:1788528589.790740:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].50, 120 off16728 00000100:00100000:3.0:1788528589.790759:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735543296:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788528589.790791:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528589.790814:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735543296 00000100:00100000:3.0:1788528589.790818:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735543296 00000100:00100000:3.0:1788528589.790841:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788528589.790847:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:18639:x1875407735543296:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788528589.790907:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:18639:x1875407735543296:12345-0@lo:502:mount.lustre.0 Request processed in 59us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528589.790913:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788528589.790944:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d146e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788528589.790958:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735543296:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788528589.790992:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].51, 224 off16952 00000040:00080000:3.0:1788528589.790999:0:18639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788528589.801216:0:18663:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788528589.801297:0:18663:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8a90ce968000) 00000020:00000080:1.0:1788528589.801320:0:18663:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1788528589.801494:0:18663:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a90fe6bc000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788528589.801499:0:18663:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8a90fe6bc000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788528589.801512:0:18663:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a90fe6bc000 3 00010000:00080000:1.0:1788528589.801540:0:18663:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a8fc3109000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.138@tcp at head 00010000:00010000:3.0:1788528589.810609:0:18663:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1788528589.810817:0:18663:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788528589.810865:0:18663:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788528589.810885:0:18663:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x892c60dda91c8db0 00000100:00080000:3.0:1788528589.810895:0:18663:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788528589.810900:0:18663:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a8fc3109000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528589.810935:0:18663:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90f58c1180 x1875407735543424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788528589.810982:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1875407735543424:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788528589.811044:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528589.811114:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735543424 00000100:00100000:3.0:1788528589.811122:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735543424 00000100:00100000:3.0:1788528589.811150:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788528589.811156:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1875407735543424:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788528589.811179:0:17139:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:3.0:1788528589.811218:0:17139:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x892c60dda91c8db7 00000004:00100000:3.0:1788528589.811233:0:17139:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788528589.811263:0:17139:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3026800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788528589.811311:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875407735543424:12345-0@lo:38:llog_process_th.0 Request processed in 153us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528589.811318:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788528589.811354:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f58c1180 x1875407735543424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788528599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528589.811364:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788528589.811370:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788528589.811377:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788528589.811380:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788528589.811382:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3109000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788528589.811387:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1875407735543424:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788528589.811413:0:18663:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788528589.813175:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788528589.813181:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788528589.813184:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788528589.813188:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788528589.813215:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788528589.813219:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788528589.813222:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788528589.813225:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788528589.813265:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735543680:0@lo:400:kworker.0 00000100:00100000:2.0:1788528589.813321:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528589.813355:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788528589.813361:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735543552:0@lo:400:kworker.0 00000100:00100000:2.0:1788528589.813392:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528589.813421:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735543808:0@lo:400:kworker.0 00000100:00100000:2.0:1788528589.813444:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528589.813470:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788528589.813476:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735543936:0@lo:400:kworker.0 00000100:00100000:2.0:1788528589.813502:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528589.813572:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735543680 00000100:00100000:2.0:1788528589.813584:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735543680 00000100:00100000:2.0:1788528589.813624:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735543936 00000100:00100000:2.0:1788528589.813627:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735543936 00000100:00100000:2.0:1788528589.813738:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788528589.813745:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735543680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528589.813795:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735543680:12345-0@lo:400:kworker.0 Request processed in 51us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528589.813801:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788528589.813816:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788528589.813822:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735543936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528589.813852:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735543936:12345-0@lo:400:kworker.0 Request processed in 30us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528589.813857:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788528589.813880:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735543552 00000100:00100000:3.0:1788528589.814059:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735543808 00000100:00100000:3.0:1788528589.814064:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735543808 00000100:00100000:3.0:1788528589.814085:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788528589.814153:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735543808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528589.814191:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735543808:12345-0@lo:400:kworker.0 Request processed in 100us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528589.814197:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000020:01000004:3.0:1788528589.814484:0:18663:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788528589.814498:0:18663:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8a8fc35e0000) 00000100:00100000:2.0:1788528589.814577:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735543552 00000100:00100000:2.0:1788528589.814608:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788528589.814613:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735543552:12345-0@lo:400:kworker.0 00000020:00000080:3.0:1788528589.814616:0:18663:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000100:00100000:2.0:1788528589.814647:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735543552:12345-0@lo:400:kworker.0 Request processed in 34us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528589.814653:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000020:01000004:3.0:1788528589.814693:0:18663:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a90fe6bc000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788528589.814697:0:18663:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8a90fe6bc000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788528589.814699:0:18663:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a90fe6bc000 3 00000100:00100000:2.0:1788528589.814708:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735543552:0@lo:400:kworker.0 00010000:00080000:2.0:1788528589.814723:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f6da2a00 x1875407735543680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788528589.814725:0:18663:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a8fc3020000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.138@tcp at head 00000100:00100000:2.0:1788528589.814733:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735543680:0@lo:400:kworker.0 00010000:00080000:2.0:1788528589.814764:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f6da1c00 x1875407735543936/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528589.814782:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735543936:0@lo:400:kworker.0 00000100:00100000:2.0:1788528589.814794:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735543808:0@lo:400:kworker.0 00010000:00010000:3.0:1788528589.819807:0:18663:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788528589.819992:0:18663:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788528589.820036:0:18663:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788528589.820049:0:18663:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x892c60dda91c8dc5 00000100:00080000:3.0:1788528589.820059:0:18663:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788528589.820064:0:18663:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8a8fc3020000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528589.822887:0:18663:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90f58c1180 x1875407735544064/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788528589.822929:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1875407735544064:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788528589.822999:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528589.823064:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735544064 00000100:00100000:3.0:1788528589.823071:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735544064 00000100:00100000:3.0:1788528589.825433:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788528589.825443:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1875407735544064:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788528589.825476:0:17138:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:3.0:1788528589.825539:0:17138:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x892c60dda91c8dcc 00000004:00100000:3.0:1788528589.825568:0:17138:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788528589.825603:0:17138:0:(import.c:65:import_set_state_nolock()) ffff8a90f6eec000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788528589.825677:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875407735544064:12345-0@lo:38:llog_process_th.0 Request processed in 234us (2678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528589.825685:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788528589.825738:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f58c1180 x1875407735544064/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788528599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528589.825749:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788528589.825757:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788528589.825764:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788528589.825768:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788528589.825770:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3020000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788528589.825777:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1875407735544064:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788528589.825798:0:18663:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788528589.825822:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528589.825827:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788528589.825829:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528589.825833:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788528589.825836:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528589.825839:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788528589.825848:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528589.825850:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788528589.828603:0:18663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 52 count 51 00000020:01000000:3.0:1788528589.828665:0:18639:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788528589.828678:0:18639:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788528589.828701:0:18639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851000/0x892c60dda91c8d9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8da2 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528589.828714:0:18639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a9101851000/0x892c60dda91c8d9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8da2 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788528589.828766:0:18639:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788528589.828769:0:18639:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788528589.828770:0:18639:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788528589.828771:0:18639:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788528589.828772:0:18639:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788528589.828774:0:18639:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788528589.828775:0:18639:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788528589.828777:0:18639:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788528589.828778:0:18639:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788528589.828783:0:18639:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788528589.828785:0:18639:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788528589.828787:0:18639:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788528589.828788:0:18639:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788528589.828789:0:18639:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788528589.828790:0:18639:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788528589.828791:0:18639:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788528589.828793:0:18639:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788528589.828794:0:18639:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788528589.828794:0:18639:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788528589.828819:0:18639:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788528589.828837:0:18639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735544192:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788528589.828900:0:18639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528589.828943:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735544192 00000100:00100000:3.0:1788528589.828950:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735544192 00000100:00100000:3.0:1788528589.828989:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788528589.828998:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:18639:x1875407735544192:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788528589.829023:0:17132:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788528589.829037:0:17132:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788528589.832296:0:18639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de34b9c0 going to sleep for 11 seconds 20000000:01000000:3.0:1788528589.834868:0:17132:0:(mgs_nids.c:820:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788528589.834887:0:17132:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788528589.835124:0:17153:0:(mgs_nids.c:717:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788528589.835129:0:17153:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788528589.835154:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a90c1550600/0x892c60dda91c8dd3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528589.835173:0:17153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c1550200/0x892c60dda91c8d0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8d08 expref: 23 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528589.835181:0:17153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c1550800/0x892c60dda91c8d1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8d16 expref: 23 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528589.835188:0:17153:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a90c1550600/0x892c60dda91c8dd3 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528589.835287:0:17153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c1550800/0x892c60dda91c8d1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c8d16 expref: 23 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528589.835302:0:17153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a90c1550800/0x892c60dda91c8d1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c8d16 expref: 23 pid: 17131 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528589.835316:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17153:1875407735544320:0@lo:104: 00000100:00100000:1.0:1788528589.835452:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788528589.835520:0:17153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c1550200/0x892c60dda91c8d0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c8d08 expref: 23 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528589.835529:0:17153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a90c1550200/0x892c60dda91c8d0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c8d08 expref: 23 pid: 17131 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528589.835537:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c6a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17153:1875407735544448:0@lo:104: 00000100:00100000:1.0:1788528589.835585:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528589.835601:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16ac000 going to sleep for 11 seconds 00000100:00100000:1.0:1788528589.835625:0:17121:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788528589.835655:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735544320 00000100:00100000:1.0:1788528589.835661:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735544320 00000100:00100000:1.0:1788528589.835694:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735544448 00000100:00100000:1.0:1788528589.835697:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735544448 00000100:00100000:1.0:1788528589.835711:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788528589.835718:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:463b8984-c30b-4b73-b2f1-81113bd4e10a+4:17153:x1875407735544320:12345-0@lo:104: 00010000:00010000:1.0:1788528589.835730:0:17121:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c0031200/0x892c60dda91c8d16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c8d1d expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528589.835785:0:17121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788528589.835792:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:463b8984-c30b-4b73-b2f1-81113bd4e10a+4:17153:x1875407735544320:12345-0@lo:104: Request processed in 74us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528589.835798:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788528589.835815:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788528589.835822:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fc34a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:463b8984-c30b-4b73-b2f1-81113bd4e10a+3:17153:x1875407735544448:12345-0@lo:104: 00010000:00010000:1.0:1788528589.835830:0:17121:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8d08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c8d0f expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528589.835860:0:17121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788528589.835871:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fc34a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:463b8984-c30b-4b73-b2f1-81113bd4e10a+3:17153:x1875407735544448:12345-0@lo:104: Request processed in 50us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528589.835877:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788528589.835909:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788528589.835915:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c0031200/0x892c60dda91c8d16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c8d1d expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528589.835923:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031200 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528589.835926:0:17126:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0031200/0x892c60dda91c8d16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c8d1d expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528589.835934:0:17126:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c0031200/0x892c60dda91c8d16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c8d1d expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528589.835941:0:17126:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0031200/0x892c60dda91c8d16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c8d1d expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528589.835946:0:17126:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788528589.835971:0:17126:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c0031200/0x892c60dda91c8d16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8d1d expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528589.835978:0:17126:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528589.835997:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c0031200/0x892c60dda91c8d16 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8d1d expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528589.836005:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c0031200/0x892c60dda91c8d16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8d1d expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528589.836016:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528589.836020:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8d08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c8d0f expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528589.836036:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030600 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528589.836040:0:17126:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8d08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c8d0f expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528589.836046:0:17126:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8d08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c8d0f expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528589.836052:0:17126:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8d08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c8d0f expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528589.836057:0:17126:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788528589.836069:0:17126:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8d08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8d0f expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528589.836075:0:17126:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528589.836080:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8d08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8d0f expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528589.836087:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8d08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8d0f expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528589.836111:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528589.836113:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528589.836114:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528589.836137:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17153:1875407735544320:0@lo:104: 00000100:00100000:1.0:1788528589.836145:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c6a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17153:1875407735544448:0@lo:104: 00010000:00010000:1.0:1788528589.836163:0:17153:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a90c1550600/0x892c60dda91c8dd3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528589.836282:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:463b8984-c30b-4b73-b2f1-81113bd4e10a:3637:1875407735544576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788528589.836314:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528589.836484:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788528589.836491:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:463b8984-c30b-4b73-b2f1-81113bd4e10a:3637:1875407735544704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788528589.836526:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528589.836587:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735544576 00000100:00100000:3.0:1788528589.836592:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735544576 00010000:00010000:3.0:1788528589.836611:0:17123:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c1550800/0x892c60dda91c8d1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c8d16 expref: 24 pid: 17131 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528589.836632:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735544704 00000100:00100000:3.0:1788528589.836635:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735544704 00010000:00010000:3.0:1788528589.836646:0:17123:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c1550200/0x892c60dda91c8d0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c8d08 expref: 25 pid: 17131 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528589.836658:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788528589.836664:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:463b8984-c30b-4b73-b2f1-81113bd4e10a+25:3637:x1875407735544576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788528589.836674:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528589.836679:0:17123:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c1550800/0x892c60dda91c8d1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c8d16 expref: 25 pid: 17131 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528589.836700:0:17123:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c1550800/0x892c60dda91c8d1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c8d16 expref: 25 pid: 17131 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528589.836713:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c1550800/0x892c60dda91c8d1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c8d16 expref: 25 pid: 17131 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528589.836727:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528589.836755:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:463b8984-c30b-4b73-b2f1-81113bd4e10a+24:3637:x1875407735544576:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528589.836762:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788528589.836777:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788528589.836784:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6dd3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:3637:x1875407735544704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788528589.836791:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528589.836795:0:17123:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c1550200/0x892c60dda91c8d0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c8d08 expref: 23 pid: 17131 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528589.836804:0:17123:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c1550200/0x892c60dda91c8d0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c8d08 expref: 23 pid: 17131 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528589.836814:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c1550200/0x892c60dda91c8d0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c8d08 expref: 23 pid: 17131 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528589.836824:0:17123:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a90c1550600/0x892c60dda91c8dd3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528589.836831:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c1550600/0x892c60dda91c8dd3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788528589.836843:0:17123:0:(mgs_nids.c:693:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009285697s 00010000:00010000:3.0:1788528589.836854:0:17123:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a90c1550600/0x892c60dda91c8dd3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528589.836862:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a90c1550600/0x892c60dda91c8dd3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528589.836869:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a90c1550600/0x892c60dda91c8dd3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528589.836876:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a90c1550600/0x892c60dda91c8dd3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528589.836882:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c1550600 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528589.836886:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a90c1550600/0x892c60dda91c8dd3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528589.836893:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a90c1550600/0x892c60dda91c8dd3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528589.836908:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a90c1550600/0x892c60dda91c8dd3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528589.836918:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528589.836941:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6dd3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:463b8984-c30b-4b73-b2f1-81113bd4e10a+22:3637:x1875407735544704:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528589.836948:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788528589.836997:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:463b8984-c30b-4b73-b2f1-81113bd4e10a:3637:1875407735544704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788528589.837005:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:463b8984-c30b-4b73-b2f1-81113bd4e10a:3637:1875407735544576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788528589.837060:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+21:18639:x1875407735544192:12345-0@lo:253:mount.lustre.0 Request processed in 8062us (8159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528589.837076:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00010000:3.0:1788528589.837116:0:17153:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a90c1550600/0x892c60dda91c8dd3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528589.837124:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a90c1550600/0x892c60dda91c8dd3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528589.837132:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c1550600/0x892c60dda91c8dd3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528589.837161:0:18639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:18639:1875407735544192:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788528589.837171:0:18639:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788528589.837174:0:18639:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788528589.837176:0:18639:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788528589.837177:0:18639:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788528589.837178:0:18639:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788528589.837179:0:18639:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788528589.837181:0:18639:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788528589.837182:0:18639:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788528589.837184:0:18639:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788528589.837185:0:18639:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788528589.837194:0:18639:0:(tgt_mount.c:2815:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788528589.838427:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788528589.848686:0:18639:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788528589.852446:0:18639:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788528589.852455:0:18639:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788528589.852494:0:18639:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788528589.852524:0:18639:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788528589.853348:0:18639:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788528589.853597:0:18639:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788528590.016687:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788528590.016708:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735544832:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788528590.016770:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528590.016937:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735544832 00000100:00100000:2.0:1788528590.016944:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735544832 00000100:00100000:2.0:1788528590.017002:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788528590.017011:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4676a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735544832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788528590.017043:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788528590.017113:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4676a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735544832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528590.017120:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788528590.017162:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735544832:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788528590.782883:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788528590.836129:0:18719:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788528590.836420:0:18719:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1788528590.911879:0:17134:0:(mgc_request.c:714:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788528590.911887:0:17134:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff8a90f6c03000 from 9 10000000:01000000:1.0:1788528590.911891:0:17134:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788528590.911938:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c1550600/0x892c60dda91c8dda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528590.911950:0:17134:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c1550600/0x892c60dda91c8dda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528590.911961:0:17134:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c1550600/0x892c60dda91c8dda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528590.911985:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735544960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788528590.912046:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528590.912083:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3eef180 going to sleep for 11 seconds 00000100:00100000:1.0:1788528590.912125:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735544960 00000100:00100000:1.0:1788528590.912132:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735544960 00000100:00100000:1.0:1788528590.912182:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788528590.912191:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+21:17134:x1875407735544960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788528590.912204:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528590.912227:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c1550200/0x892c60dda91c8de1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8dda expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528590.912249:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c1550200/0x892c60dda91c8de1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8dda expref: 22 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528590.912261:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c1550200/0x892c60dda91c8de1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8dda expref: 22 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528590.912276:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c1550200, rc 0) 00000100:00100000:1.0:1788528590.912314:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+22:17134:x1875407735544960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528590.912320:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788528590.912364:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735544960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788528590.912379:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c1550600/0x892c60dda91c8dda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8de1 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528590.912388:0:17134:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c1550600/0x892c60dda91c8dda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8de1 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528590.912435:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735545088:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788528590.912464:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528590.912477:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3eef180 going to sleep for 11 seconds 00000100:00100000:1.0:1788528590.912490:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735545088 00000100:00100000:1.0:1788528590.912494:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735545088 00000100:00100000:1.0:1788528590.912515:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788528590.912521:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+22:17134:x1875407735545088:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788528590.912534:0:17132:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788528590.912548:0:17132:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788528590.912568:0:17132:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1788528590.912643:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+22:17134:x1875407735545088:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528590.916133:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788528590.916291:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735545088:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788528590.916373:0:17134:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788528590.916383:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c1550600/0x892c60dda91c8dda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8de1 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528590.916393:0:17134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c1550600/0x892c60dda91c8dda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8de1 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528590.916405:0:17134:0:(mgc_request.c:714:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788528590.916408:0:17134:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff8a8fc477d800 from 9 10000000:01000000:1.0:1788528590.916411:0:17134:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788528590.916441:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c8de8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528590.916450:0:17134:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c8de8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528590.916459:0:17134:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c8de8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528590.916477:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735545216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788528590.916528:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528590.916600:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3eef180 going to sleep for 11 seconds 00000100:00100000:1.0:1788528590.916621:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735545216 00000100:00100000:1.0:1788528590.916627:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735545216 00000100:00100000:1.0:1788528590.917487:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788528590.917500:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+22:17134:x1875407735545216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788528590.917514:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528590.917529:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c1551600/0x892c60dda91c8def lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8de8 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528590.917588:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c1551600/0x892c60dda91c8def lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8de8 expref: 23 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528590.917600:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c1551600/0x892c60dda91c8def lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8de8 expref: 23 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528590.917609:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c1551600, rc 0) 00000100:00100000:1.0:1788528590.917667:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:17134:x1875407735545216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528590.917674:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788528590.917715:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735545216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788528590.917730:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c8de8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8def expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528590.917739:0:17134:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c8de8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8def expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528590.917787:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735545344:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788528590.917818:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528590.917841:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3eef180 going to sleep for 11 seconds 00000100:00100000:1.0:1788528590.917854:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735545344 00000100:00100000:1.0:1788528590.917859:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735545344 00000100:00100000:1.0:1788528590.917880:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788528590.917885:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:17134:x1875407735545344:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788528590.917898:0:17130:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788528590.917912:0:17130:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788528590.917918:0:17130:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1788528590.917982:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:17134:x1875407735545344:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 96us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528590.917989:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788528590.918015:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735545344:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788528590.918060:0:17134:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788528590.918067:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c8de8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8def expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528590.918075:0:17134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c8de8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8def expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788528591.231256:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788528591.806655:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528592.831189:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528593.856229:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528594.636431:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788528594.636455:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735545472:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788528594.636518:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528594.636679:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735545472 00000100:00100000:0.0:1788528594.636689:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735545472 00000100:00100000:0.0:1788528594.636744:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788528594.636754:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735545472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788528594.636785:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788528594.636848:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735545472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528594.636855:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788528594.636936:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735545472:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788528594.880921:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788528595.135298:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528595.135304:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788528595.135306:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528595.135309:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788528595.135346:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528595.135349:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788528595.135352:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528595.135354:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788528595.135424:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:463b8984-c30b-4b73-b2f1-81113bd4e10a:3637:1875407735545600:0@lo:400:kworker.0 00000100:00100000:3.0:1788528595.135497:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528595.135542:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735546112:0@lo:400:kworker.0 00000100:00100000:3.0:1788528595.135594:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528595.135619:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788528595.135626:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735545728:0@lo:400:kworker.0 00000100:00100000:3.0:1788528595.135651:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528595.135672:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735546240:0@lo:400:kworker.0 00000100:00100000:3.0:1788528595.135693:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528595.135728:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735545856:0@lo:400:kworker.0 00000100:00100000:3.0:1788528595.135749:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528595.135764:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735546368:0@lo:400:kworker.0 00000100:00100000:3.0:1788528595.135781:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528595.135791:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788528595.135796:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735545984:0@lo:400:kworker.0 00000100:00100000:3.0:1788528595.135815:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528595.135847:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735545600 00000100:00100000:3.0:1788528595.135854:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735545600 00000100:00100000:3.0:1788528595.135895:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788528595.135903:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:3637:x1875407735545600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528595.135959:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:3637:x1875407735545600:12345-0@lo:400:kworker.0 Request processed in 56us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528595.135966:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788528595.136001:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735546112 00000100:00100000:3.0:1788528595.136005:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735546112 00000100:00100000:3.0:1788528595.136024:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735546240 00000100:00100000:3.0:1788528595.136026:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735546240 00000100:00100000:3.0:1788528595.136045:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735545856 00000100:00100000:3.0:1788528595.136048:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735545856 00000100:00100000:3.0:1788528595.136076:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735546368 00000100:00100000:3.0:1788528595.136079:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735546368 00000100:00100000:3.0:1788528595.136096:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788528595.136102:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735546112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528595.136134:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735546112:12345-0@lo:400:kworker.0 Request processed in 33us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528595.136141:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788528595.136153:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788528595.136159:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735546240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528595.136185:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735546240:12345-0@lo:400:kworker.0 Request processed in 26us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528595.136190:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788528595.136202:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788528595.136208:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735545856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528595.136240:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735545856:12345-0@lo:400:kworker.0 Request processed in 32us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528595.136246:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788528595.136257:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788528595.136272:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735546368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528595.136302:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735546368:12345-0@lo:400:kworker.0 Request processed in 32us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528595.136308:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788528595.136328:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735545728 00000100:00100000:3.0:1788528595.136331:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735545728 00000100:00100000:3.0:1788528595.136348:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735545984 00000100:00100000:3.0:1788528595.136350:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735545984 00000100:00100000:3.0:1788528595.136362:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788528595.136368:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735545728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528595.136398:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735545728:12345-0@lo:400:kworker.0 Request processed in 30us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528595.136404:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788528595.136415:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788528595.136421:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735545984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528595.136446:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735545984:12345-0@lo:400:kworker.0 Request processed in 25us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528595.136451:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788528595.136495:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735545984:0@lo:400:kworker.0 00010000:00080000:3.0:1788528595.136509:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f58c0e00 x1875407735545856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528595.136519:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735545856:0@lo:400:kworker.0 00010000:00080000:3.0:1788528595.136528:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f58c1c00 x1875407735546368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528595.136536:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735546368:0@lo:400:kworker.0 00000100:00100000:3.0:1788528595.136596:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735545728:0@lo:400:kworker.0 00010000:00080000:3.0:1788528595.136606:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f58c1f80 x1875407735546240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528595.136614:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735546240:0@lo:400:kworker.0 00000100:00100000:3.0:1788528595.136621:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:463b8984-c30b-4b73-b2f1-81113bd4e10a:3637:1875407735545600:0@lo:400:kworker.0 00010000:00080000:3.0:1788528595.136629:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f58c0a80 x1875407735546112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528595.136637:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735546112:0@lo:400:kworker.0 00000100:00080000:2.0:1788528595.137572:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788528595.137578:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788528595.137687:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735546496:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788528595.137738:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528595.138017:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735546496 00000100:00100000:2.0:1788528595.138023:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735546496 00000100:00100000:2.0:1788528595.138246:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788528595.138256:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735546496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788528595.138287:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788528595.138339:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735546496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528595.138344:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788528595.138407:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735546496:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1788528595.834639:0:19009:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788528595.903750:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788528596.762341:0:19061:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788528596.763693:0:19061:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1788528596.866224:0:17889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788528596.927014:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788528597.565370:0:19111:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788528597.565750:0:19111:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788528597.952871:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528598.977255:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528599.038657:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788528584/real 1788528584] req@ffff8a90f58c1880 x1875407735540352/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528599 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528599.038688:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a90f58c1880 x1875407735540352/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528599 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528599.038698:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788528584/real 1788528584] req@ffff8a90f58c2a00 x1875407735540480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528599 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528599.038708:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a90f58c2a00 x1875407735540480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528599 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788528599.038729:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90f6ee8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788528599.038749:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788528599.038753:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735540352:0@lo:8:kworker.0 00000100:00080000:0.0:1788528599.038758:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90f58dd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788528599.038763:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788528599.038765:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735540480:0@lo:8:kworker.0 00000100:00080000:3.0:1788528599.039955:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528599.039961:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788528599.039964:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528599.039966:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788528599.040106:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:463b8984-c30b-4b73-b2f1-81113bd4e10a:3637:1875407735546624:0@lo:400:kworker.0 00000100:00100000:2.0:1788528599.040187:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788528599.044125:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528599.044131:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788528599.044134:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a90f6ee8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788528599.044142:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 454 00000100:00080000:3.0:1788528599.044147:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788528599.044153:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a90f6ee8800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528599.044175:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90c81a3b80 x1875407735547136/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788528599.048853:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788528599.048873:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735546752:0@lo:400:kworker.0 00000100:00100000:2.0:1788528599.048936:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528599.058287:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735546880:0@lo:400:kworker.0 00000100:00100000:2.0:1788528599.058354:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528599.058391:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788528599.058397:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735547008:0@lo:400:kworker.0 00000100:00100000:2.0:1788528599.058418:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528599.058450:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735546752 00000100:00100000:2.0:1788528599.058457:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735546752 00000100:00100000:2.0:1788528599.058487:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735547008 00000100:00100000:2.0:1788528599.058489:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735547008 00000100:00100000:2.0:1788528599.058502:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788528599.058509:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735546752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528599.058579:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735546752:12345-0@lo:400:kworker.0 Request processed in 70us (9643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528599.058595:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788528599.058610:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788528599.058615:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735547008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528599.058644:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735547008:12345-0@lo:400:kworker.0 Request processed in 29us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528599.058650:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788528599.058691:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735547008:0@lo:400:kworker.0 00000100:00100000:2.0:1788528599.058717:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735546752:0@lo:400:kworker.0 00000100:00100000:0.0:1788528599.060650:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735546624 00000100:00100000:0.0:1788528599.060661:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735546624 00000100:00100000:0.0:1788528599.060799:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788528599.060818:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:3637:x1875407735546624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528599.060893:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:3637:x1875407735546624:12345-0@lo:400:kworker.0 Request processed in 77us (20707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528599.060900:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788528599.060945:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:463b8984-c30b-4b73-b2f1-81113bd4e10a:3637:1875407735546624:0@lo:400:kworker.0 00000100:00080000:3.0:1788528599.061080:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528599.061086:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788528599.061090:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a90f58dd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788528599.061094:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 454 00000100:00080000:3.0:1788528599.061098:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788528599.061103:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a90f58dd000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528599.061115:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735546880 00000100:00100000:3.0:1788528599.061120:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735546880 00000100:00100000:2.0:1788528599.061239:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788528599.061249:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735546880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528599.061296:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735546880:12345-0@lo:400:kworker.0 Request processed in 50us (2943us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528599.061302:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788528599.061334:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90c81a2a00 x1875407735546880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528599.061346:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735546880:0@lo:400:kworker.0 00000100:00100000:3.0:1788528599.061417:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90c81a0a80 x1875407735547264/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788528599.061495:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735547136:0@lo:8:kworker.0 00000100:00100000:3.0:1788528599.061539:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528599.061588:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735547264:0@lo:8:kworker.0 00000100:00100000:3.0:1788528599.061613:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528599.061849:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735547136 00000100:00100000:2.0:1788528599.061854:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735547136 00000100:00100000:2.0:1788528599.061871:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735547264 00000100:00100000:2.0:1788528599.061873:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735547264 00000100:00100000:2.0:1788528599.061882:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788528599.061887:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1875407735547136:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788528599.061910:0:18643:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:2.0:1788528599.061936:0:18643:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x892c60dda91c8df6 00002000:00100000:2.0:1788528599.061955:0:18643:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8a90f5adc800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788528599.061958:0:18643:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788528599.061961:0:18643:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788528599.062223:0:18643:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788528599.062248:0:18643:0:(import.c:65:import_set_state_nolock()) ffff8a90f5ad8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788528599.062295:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1875407735547136:12345-0@lo:8:kworker.0 Request processed in 406us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528599.062302:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788528599.062318:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788528599.062323:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1875407735547264:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788528599.062335:0:18643:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1788528599.063842:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90c81a3b80 x1875407735547136/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788528619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528599.063856:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788528599.063864:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788528599.063873:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788528599.063879:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788528599.063882:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90f6ee8800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788528599.063907:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788528599.063913:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735547136:0@lo:8:kworker.0 00000100:00100000:3.0:1788528599.063961:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735547520:0@lo:400:kworker.0 00000100:00100000:3.0:1788528599.064021:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528599.064065:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788528599.064072:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875407735547392:0@lo:400:kworker.0 00000100:00100000:3.0:1788528599.064094:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528599.064121:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735547520 00000100:00100000:3.0:1788528599.064127:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735547520 00000100:00100000:3.0:1788528599.064165:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735547392 00000100:00100000:3.0:1788528599.064168:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735547392 00000100:00100000:3.0:1788528599.064182:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788528599.064190:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735547520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528599.064238:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735547520:12345-0@lo:400:kworker.0 Request processed in 48us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528599.064245:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788528599.064259:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788528599.064266:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875407735547392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528599.064291:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875407735547392:12345-0@lo:400:kworker.0 Request processed in 26us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528599.064297:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788528599.064324:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90c81a2300 x1875407735547392/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528599.064334:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875407735547392:0@lo:400:kworker.0 00010000:00080000:3.0:1788528599.064343:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90c81a3480 x1875407735547520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528599.064350:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735547520:0@lo:400:kworker.0 00000100:00100000:3.0:1788528599.064382:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735547648:0@lo:400:kworker.0 00000100:00100000:3.0:1788528599.064411:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528599.064433:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735547648 00000100:00100000:3.0:1788528599.064436:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735547648 00000100:00100000:3.0:1788528599.064455:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788528599.064461:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735547648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528599.064489:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735547648:12345-0@lo:400:kworker.0 Request processed in 29us (78us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528599.064495:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788528599.064516:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90c81a1c00 x1875407735547648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528599.064524:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735547648:0@lo:400:kworker.0 00000100:00080000:3.0:1788528599.064543:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788528599.064546:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1788528599.064620:0:17880:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788528599.064636:0:17880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17880:1875407735547904:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788528599.064659:0:17880:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528599.064672:0:17880:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90fa9aef00 going to sleep for 11 seconds 00000004:00080000:1.0:1788528599.065233:0:17879:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788528599.065322:0:17879:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 468282767600ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788528599.065329:0:17879:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788528599.065886:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735547776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788528599.065936:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528599.067200:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735547776 00000100:00100000:0.0:1788528599.067210:0:18647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735547776 00000100:00100000:0.0:1788528599.067264:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788528599.067273:0:18647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4674a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1875407735547776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788528599.067304:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528599.067364:0:18647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4674a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1875407735547776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (1427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528599.067371:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788528599.067389:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788528599.067417:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90c81a1c00 x1875407735547776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528615 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528599.067436:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735547776:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788528599.067520:0:18644:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788528599.067530:0:18644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000004:00080000:0.0:1788528599.074918:0:17870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1788528599.074928:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735547904 00000100:00100000:3.0:1788528599.074944:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735547904 00000100:00100000:0.0:1788528599.075480:0:19172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788528599.075502:0:19172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17880:x1875407735547904:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:3.0:1788528599.079432:0:19172:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1788528599.079445:0:19172:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788528599.079544:0:19172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17880:x1875407735547904:12345-0@lo:7:osp-pre-0-1.0 Request processed in 4047us (14879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528599.079600:0:19172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788528599.079656:0:17880:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90c81a2300 x1875407735547904/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788528615 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528599.079675:0:17880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17880:1875407735547904:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788528599.079714:0:17880:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788528599.079773:0:17880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17880:1875407735548032:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788528599.079832:0:17880:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528599.079873:0:17880:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6efde40 going to sleep for 11 seconds 00000100:00100000:3.0:1788528599.080151:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735548032 00000100:00100000:3.0:1788528599.080171:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735548032 00000100:00100000:3.0:1788528599.080226:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788528599.080234:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4677100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17880:x1875407735548032:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788528599.080263:0:18644:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1788528599.080310:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4677100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17880:x1875407735548032:12345-0@lo:5:osp-pre-0-1.0 Request processed in 77us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528599.080316:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788528599.080378:0:17880:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a8fc4677800 x1875407735548032/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788528615 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528599.080390:0:17880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17880:1875407735548032:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788528599.080400:0:17880:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788528599.080432:0:17880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17880:1875407735548160:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788528599.080461:0:17880:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528599.080538:0:17880:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6efde40 going to sleep for 11 seconds 00000100:00100000:3.0:1788528599.086100:0:19172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735548160 00000100:00100000:3.0:1788528599.086131:0:19172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735548160 00000100:00100000:3.0:1788528599.086461:0:19172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788528599.086475:0:19172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4675180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17880:x1875407735548160:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788528599.086585:0:19172:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1788528599.110965:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1875407735547264:12345-0@lo:8:kworker.0 Request processed in 48628us (49338us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788528599.110982:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788528599.112550:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90f58dd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788528599.112579:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788528599.112585:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735547264:0@lo:8:kworker.0 00000001:00080000:1.0:1788528599.144924:0:18640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1788528599.144946:0:18640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788528599.145195:0:19172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4675180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17880:x1875407735548160:12345-0@lo:5:osp-pre-0-1.0 Request processed in 58714us (64723us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788528599.145212:0:19172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788528599.145276:0:17880:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a8fc4677800 x1875407735548160/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788528615 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528599.145292:0:17880:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788528599.145299:0:17880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17880:1875407735548160:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788528599.145320:0:17880:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1788528599.145384:0:17880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17880:1875407735548288:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788528599.145441:0:17880:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528599.145480:0:17880:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6efde40 going to sleep for 11 seconds 00000100:00100000:1.0:1788528599.145699:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735548288 00000100:00100000:1.0:1788528599.145707:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735548288 00000100:00100000:1.0:1788528599.145763:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788528599.145773:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4675500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17880:x1875407735548288:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788528599.145854:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4675500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17880:x1875407735548288:12345-0@lo:900:osp-pre-0-1.0 Request processed in 82us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528599.145862:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788528599.146004:0:17880:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a8fc4677800 x1875407735548288/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788528615 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528599.146016:0:17880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17880:1875407735548288:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788528599.745484:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735548416:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788528599.745612:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528599.745751:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735548416 00000100:00100000:2.0:1788528599.745761:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735548416 00000100:00100000:2.0:1788528599.745826:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788528599.745838:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735548416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788528599.745881:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788528599.745956:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735548416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528599.745963:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788528599.746044:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735548416:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788528599.998765:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528600.260439:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735548544:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788528600.260502:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528600.268376:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735548544 00000100:00100000:2.0:1788528600.268390:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735548544 00000100:00100000:2.0:1788528600.268446:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788528600.268456:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735548544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788528600.268490:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788528600.268578:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735548544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (8075us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528600.268584:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788528600.268631:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735548544:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788528601.025604:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788528601.471871:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788528602.047071:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528603.071968:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528604.095781:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528604.158655:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788528584/real 1788528584] req@ffff8a90f58c2d80 x1875407735539840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528604 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528604.158684:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a90f58c2d80 x1875407735539840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528604 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528604.158694:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788528584/real 1788528584] req@ffff8a90f58c2680 x1875407735539968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528604 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528604.158704:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a90f58c2680 x1875407735539968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528604 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788528604.158722:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d08800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788528604.158744:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788528604.158748:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735539840:0@lo:8:kworker.0 00000100:00080000:2.0:1788528604.158754:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90de3f4000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788528604.158759:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788528604.158762:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735539968:0@lo:8:kworker.0 00000100:00080000:1.0:1788528604.158905:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788528604.158910:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788528604.158912:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d08800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788528604.158917:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 454 00000100:00080000:1.0:1788528604.158922:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788528604.158929:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a8fc1d08800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1788528604.158948:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc44c4e00 x1875407735548928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788528604.158962:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788528604.158966:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788528604.158967:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a90de3f4000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788528604.158970:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 454 00000100:00080000:1.0:1788528604.158973:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788528604.158976:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a90de3f4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1788528604.158988:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90ffa6a300 x1875407735549056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788528604.159038:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788528604.159042:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788528604.159044:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a90f58dd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788528604.159047:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 468 00000100:00080000:1.0:1788528604.159050:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788528604.159062:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a90f58dd000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1788528604.159074:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90ffa6aa00 x1875407735549568/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788528604.159120:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735549184:0@lo:400:kworker.0 00000100:00100000:2.0:1788528604.159403:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735548800:0@lo:400:kworker.0 00000100:00100000:2.0:1788528604.159435:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528604.159477:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735549696:0@lo:400:kworker.0 00000100:00100000:2.0:1788528604.159506:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735548800 00000100:00100000:2.0:1788528604.159513:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735548800 00000100:00100000:2.0:1788528604.159583:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788528604.159593:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735548800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528604.159644:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735548800:12345-0@lo:400:kworker.0 Request processed in 53us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528604.159652:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788528604.159763:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528604.159800:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735549824:0@lo:400:kworker.0 00000100:00100000:1.0:1788528604.159828:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528604.159849:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788528604.159854:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735549312:0@lo:400:kworker.0 00000100:00100000:1.0:1788528604.159875:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528604.159892:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735549952:0@lo:400:kworker.0 00000100:00100000:1.0:1788528604.159915:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528604.159951:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735549184 00000100:00100000:1.0:1788528604.159956:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735549184 00000100:00100000:1.0:1788528604.159977:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735549824 00000100:00100000:1.0:1788528604.159980:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735549824 00000100:00100000:1.0:1788528604.160017:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735549952 00000100:00100000:1.0:1788528604.160020:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735549952 00000100:00100000:1.0:1788528604.160036:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788528604.160042:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735549184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528604.160078:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735549184:12345-0@lo:400:kworker.0 Request processed in 36us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528604.160084:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788528604.160098:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788528604.160103:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735549824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528604.160130:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735549824:12345-0@lo:400:kworker.0 Request processed in 27us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528604.160144:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788528604.160157:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788528604.160163:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735549952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528604.160511:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:463b8984-c30b-4b73-b2f1-81113bd4e10a:3639:1875407735548672:0@lo:400:kworker.0 00000100:00100000:3.0:1788528604.160547:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528604.160664:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735549440:0@lo:400:kworker.0 00000100:00100000:3.0:1788528604.160701:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528604.160741:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735549440 00000100:00100000:3.0:1788528604.160746:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735549440 00000100:00100000:3.0:1788528604.160777:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788528604.160784:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735549440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528604.160818:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735549440:12345-0@lo:400:kworker.0 Request processed in 35us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528604.160825:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788528604.160860:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90ffa69c00 x1875407735549440/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528604.160872:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735549440:0@lo:400:kworker.0 00000100:00100000:1.0:1788528604.161393:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735549952:12345-0@lo:400:kworker.0 Request processed in 28us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528604.161401:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788528604.161422:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788528604.161427:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788528604.161429:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788528604.161440:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735548672 00000100:00100000:1.0:1788528604.161444:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735548672 00000100:00100000:1.0:1788528604.161477:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788528604.161484:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:3639:x1875407735548672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528604.161527:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:3639:x1875407735548672:12345-0@lo:400:kworker.0 Request processed in 43us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528604.161533:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788528604.161647:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528604.161685:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735548800:0@lo:400:kworker.0 00000100:00100000:1.0:1788528604.161705:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735549696 00000100:00100000:1.0:1788528604.161709:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735549696 00000100:00100000:1.0:1788528604.161733:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788528604.161739:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735549696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528604.161774:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735549696:12345-0@lo:400:kworker.0 Request processed in 35us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528604.161781:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788528604.161805:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90ffa6ad80 x1875407735549696/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528604.161821:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735549696:0@lo:400:kworker.0 00000100:00100000:1.0:1788528604.161842:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735548928:0@lo:8:kworker.0 00000100:00100000:1.0:1788528604.161884:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528604.161906:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735549056:0@lo:8:kworker.0 00000100:00100000:1.0:1788528604.161928:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528604.161942:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735549568:0@lo:8:kworker.0 00000100:00100000:1.0:1788528604.161961:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528604.161992:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735548928 00000100:00100000:1.0:1788528604.162006:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735548928 00000100:00100000:1.0:1788528604.162022:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735549056 00000100:00100000:1.0:1788528604.162025:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735549056 00000100:00100000:1.0:1788528604.162033:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735549568 00000100:00100000:1.0:1788528604.162035:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735549568 00000100:00100000:1.0:1788528604.162050:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788528604.162055:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1875407735548928:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788528604.162078:0:18646:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:1.0:1788528604.162103:0:18646:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x892c60dda91c8dfd 00002000:00100000:1.0:1788528604.162116:0:18646:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8a90d00cb000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788528604.162120:0:18646:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788528604.162122:0:18646:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788528604.162187:0:18646:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1788528604.162308:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788528604.162325:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1875407735549056:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788528604.162339:0:18643:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1788528604.165456:0:18646:0:(import.c:65:import_set_state_nolock()) ffff8a90d00ca800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788528604.165978:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1875407735548928:12345-0@lo:8:kworker.0 Request processed in 3917us (4089us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528604.165989:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788528604.166032:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788528604.166039:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1875407735549568:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788528604.166063:0:18646:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788528604.166095:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1875407735549568:12345-0@lo:8:kworker.0 Request processed in 55us (4132us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788528604.166102:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788528604.166128:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735549312 00000100:00100000:1.0:1788528604.166135:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735549312 00000100:00100000:1.0:1788528604.166172:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788528604.166179:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735549312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528604.166231:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735549312:12345-0@lo:400:kworker.0 Request processed in 53us (6355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528604.166237:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788528604.166290:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:463b8984-c30b-4b73-b2f1-81113bd4e10a:3639:1875407735548672:0@lo:400:kworker.0 00000100:00100000:1.0:1788528604.166339:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735549312:0@lo:400:kworker.0 00010000:00080000:1.0:1788528604.166352:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90ffa69f80 x1875407735549952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528604.166362:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735549952:0@lo:400:kworker.0 00010000:00080000:1.0:1788528604.166374:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90ffa6b800 x1875407735549184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528604.166382:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735549184:0@lo:400:kworker.0 00010000:00080000:1.0:1788528604.166394:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90ffa69180 x1875407735549824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528604.166401:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735549824:0@lo:400:kworker.0 00010000:00080000:2.0:1788528604.171642:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a8fc44c4e00 x1875407735548928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788528629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528604.171658:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788528604.171669:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788528604.171678:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788528604.171684:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788528604.171688:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d08800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788528604.171714:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788528604.171721:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735548928:0@lo:8:kworker.0 00000100:00080000:2.0:1788528604.171738:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90f58dd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788528604.171743:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788528604.171747:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735549568:0@lo:8:kworker.0 00000004:00080000:1.0:1788528604.171944:0:17162:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:1.0:1788528604.171966:0:17162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa6b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17162:1875407735550208:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788528604.172036:0:17162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528604.172062:0:17162:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de6c5300 going to sleep for 11 seconds 00000100:00100000:1.0:1788528604.172074:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788528604.172086:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735550080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788528604.172109:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528604.172144:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735550080 00000100:00100000:1.0:1788528604.172151:0:18647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735550080 00000100:00100000:2.0:1788528604.172656:0:19172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735550208 00000100:00100000:2.0:1788528604.172661:0:19172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735550208 00000100:00100000:2.0:1788528604.172696:0:19172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788528604.172719:0:19172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:17162:x1875407735550208:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788528604.172722:0:17161:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788528604.172821:0:17161:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 473390266834ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788528604.172827:0:17161:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788528604.173660:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788528604.173673:0:18647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1875407735550080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788528604.173698:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528604.173762:0:18647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1875407735550080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528604.173768:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788528604.173794:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788528604.173831:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90ffa69180 x1875407735550080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528620 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528604.173850:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735550080:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1788528604.183315:0:19172:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788528604.183326:0:19172:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788528604.183332:0:19172:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00000100:00100000:3.0:1788528604.189206:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1875407735549056:12345-0@lo:8:kworker.0 Request processed in 26885us (27271us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788528604.189219:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788528604.189279:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90de3f4000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788528604.189286:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788528604.189290:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735549056:0@lo:8:kworker.0 00000004:00080000:3.0:1788528604.194035:0:17117:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788528604.206889:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788528604.206911:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084527d05/0x892c60dda91c8e04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.206930:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1788528604.206935:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788528604.206952:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084527d05/0x892c60dda91c8e04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.206971:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084527d05/0x892c60dda91c8e04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.206981:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084527d05/0x892c60dda91c8e04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.206990:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084527d05/0x892c60dda91c8e04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.207021:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788528604.207034:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528604.207040:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084527d05/0x892c60dda91c8e04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.207061:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030c00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528604.207066:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084527d05/0x892c60dda91c8e04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.207075:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084527d05/0x892c60dda91c8e04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.207092:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084527d05/0x892c60dda91c8e04 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.207101:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084527d05/0x892c60dda91c8e04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.207120:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528604.207123:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528604.207134:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788528604.208259:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788528604.208270:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a78950f/0x892c60dda91c8e0b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.208284:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1788528604.208288:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788528604.208293:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a78950f/0x892c60dda91c8e0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.208304:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a78950f/0x892c60dda91c8e0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.208322:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a78950f/0x892c60dda91c8e0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.208329:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a78950f/0x892c60dda91c8e0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.208387:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788528604.208937:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788528604.208944:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054738cc3/0x892c60dda91c8e12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.208954:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1788528604.208957:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788528604.208961:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054738cc3/0x892c60dda91c8e12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.208970:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054738cc3/0x892c60dda91c8e12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.208978:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054738cc3/0x892c60dda91c8e12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.208985:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054738cc3/0x892c60dda91c8e12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.209471:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788528604.209479:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a78950f/0x892c60dda91c8e0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.209488:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031200 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528604.209492:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a78950f/0x892c60dda91c8e0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.209502:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a78950f/0x892c60dda91c8e0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.209521:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a78950f/0x892c60dda91c8e0b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.209529:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a78950f/0x892c60dda91c8e0b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.209550:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788528604.209580:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054738cc3/0x892c60dda91c8e12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.209587:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030600 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528604.209590:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054738cc3/0x892c60dda91c8e12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.209620:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054738cc3/0x892c60dda91c8e12 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.209631:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054738cc3/0x892c60dda91c8e12 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.209639:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528604.209642:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528604.209643:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528604.209829:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788528604.209835:0:19172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054738cc3/0x892c60dda91c8e12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788528604.210436:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788528604.210445:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf8b8e97/0x892c60dda91c8e19 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.210455:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1788528604.210459:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788528604.210464:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf8b8e97/0x892c60dda91c8e19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.210474:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf8b8e97/0x892c60dda91c8e19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.210484:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf8b8e97/0x892c60dda91c8e19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.210492:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf8b8e97/0x892c60dda91c8e19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528604.210529:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528604.210535:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf8b8e97/0x892c60dda91c8e19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528604.210543:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031e00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528604.210547:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf8b8e97/0x892c60dda91c8e19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528604.210605:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf8b8e97/0x892c60dda91c8e19 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528604.210622:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf8b8e97/0x892c60dda91c8e19 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528604.210633:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528604.210636:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528604.210638:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528604.210823:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788528604.210829:0:19172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf8b8e97/0x892c60dda91c8e19 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788528604.211550:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788528604.211585:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acd1bc08/0x892c60dda91c8e20 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.211604:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1788528604.211609:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788528604.211614:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acd1bc08/0x892c60dda91c8e20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.211624:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acd1bc08/0x892c60dda91c8e20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.211634:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acd1bc08/0x892c60dda91c8e20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.211641:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acd1bc08/0x892c60dda91c8e20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.211685:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788528604.211692:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acd1bc08/0x892c60dda91c8e20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.211699:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031a00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528604.211703:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acd1bc08/0x892c60dda91c8e20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.211712:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acd1bc08/0x892c60dda91c8e20 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.211725:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acd1bc08/0x892c60dda91c8e20 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.211733:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528604.211735:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528604.211736:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528604.211811:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788528604.211817:0:19172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acd1bc08/0x892c60dda91c8e20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528604.212549:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788528604.212749:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528604.212756:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ac40608/0x892c60dda91c8e27 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.213231:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788528604.213237:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528604.213243:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ac40608/0x892c60dda91c8e27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.213256:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ac40608/0x892c60dda91c8e27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.213266:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ac40608/0x892c60dda91c8e27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.213274:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ac40608/0x892c60dda91c8e27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.213381:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788528604.214071:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528604.214079:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ddab49b/0x892c60dda91c8e2e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.214100:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788528604.214104:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528604.214109:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ddab49b/0x892c60dda91c8e2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.214186:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788528604.214193:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ac40608/0x892c60dda91c8e27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.214202:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850200 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528604.214206:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ac40608/0x892c60dda91c8e27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.214215:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ac40608/0x892c60dda91c8e27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.214237:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ac40608/0x892c60dda91c8e27 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.214245:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ac40608/0x892c60dda91c8e27 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.214261:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528604.214263:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528604.214265:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528604.214304:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ddab49b/0x892c60dda91c8e2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.214314:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ddab49b/0x892c60dda91c8e2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.214321:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ddab49b/0x892c60dda91c8e2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.214378:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788528604.214735:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528604.214742:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069e4eb91/0x892c60dda91c8e35 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.214750:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788528604.214754:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528604.214759:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069e4eb91/0x892c60dda91c8e35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.214769:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069e4eb91/0x892c60dda91c8e35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.214787:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069e4eb91/0x892c60dda91c8e35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.214794:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069e4eb91/0x892c60dda91c8e35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.215205:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788528604.215212:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ddab49b/0x892c60dda91c8e2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.215231:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428600 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528604.215235:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ddab49b/0x892c60dda91c8e2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.215243:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ddab49b/0x892c60dda91c8e2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.215256:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ddab49b/0x892c60dda91c8e2e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.215263:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ddab49b/0x892c60dda91c8e2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.215279:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528604.215282:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069e4eb91/0x892c60dda91c8e35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.215288:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428e00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528604.215292:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069e4eb91/0x892c60dda91c8e35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.215300:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069e4eb91/0x892c60dda91c8e35 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.215309:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069e4eb91/0x892c60dda91c8e35 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.215323:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528604.215325:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528604.215326:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528604.215390:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788528604.215395:0:19172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069e4eb91/0x892c60dda91c8e35 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788528604.215845:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528604.215851:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd488e82/0x892c60dda91c8e3c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.215871:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788528604.215876:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528604.215880:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd488e82/0x892c60dda91c8e3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.215891:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd488e82/0x892c60dda91c8e3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.215899:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd488e82/0x892c60dda91c8e3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.215927:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd488e82/0x892c60dda91c8e3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.216094:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788528604.216100:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd488e82/0x892c60dda91c8e3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.216108:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428200 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528604.216112:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd488e82/0x892c60dda91c8e3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.216127:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd488e82/0x892c60dda91c8e3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.216139:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd488e82/0x892c60dda91c8e3c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.216294:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788528604.216300:0:19172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd488e82/0x892c60dda91c8e3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.216321:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528604.216323:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528604.216339:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528604.216361:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788528604.217668:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528604.217677:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083f9d3e3/0x892c60dda91c8e43 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.217695:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788528604.217699:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528604.217704:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083f9d3e3/0x892c60dda91c8e43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.217716:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083f9d3e3/0x892c60dda91c8e43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.217725:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083f9d3e3/0x892c60dda91c8e43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.217732:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083f9d3e3/0x892c60dda91c8e43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.217748:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788528604.218232:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528604.218239:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083f9d3e3/0x892c60dda91c8e43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.218247:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850400 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528604.218252:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083f9d3e3/0x892c60dda91c8e43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.218260:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083f9d3e3/0x892c60dda91c8e43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.218276:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083f9d3e3/0x892c60dda91c8e43 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.218284:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083f9d3e3/0x892c60dda91c8e43 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.218299:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528604.218301:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528604.218302:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788528604.218387:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528604.218392:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd730657/0x892c60dda91c8e4a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.218401:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788528604.218404:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528604.218408:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd730657/0x892c60dda91c8e4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.218418:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd730657/0x892c60dda91c8e4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.218436:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd730657/0x892c60dda91c8e4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.218442:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd730657/0x892c60dda91c8e4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.218464:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788528604.218704:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528604.218710:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd730657/0x892c60dda91c8e4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.218723:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850600 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528604.218726:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd730657/0x892c60dda91c8e4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.218734:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd730657/0x892c60dda91c8e4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.218745:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd730657/0x892c60dda91c8e4a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.218752:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd730657/0x892c60dda91c8e4a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.218764:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528604.218766:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528604.218767:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788528604.219194:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528604.219201:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acf2d2f3/0x892c60dda91c8e51 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.219210:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788528604.219213:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528604.219218:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acf2d2f3/0x892c60dda91c8e51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.219227:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acf2d2f3/0x892c60dda91c8e51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.219235:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acf2d2f3/0x892c60dda91c8e51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.219242:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acf2d2f3/0x892c60dda91c8e51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.219302:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788528604.219872:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528604.219878:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ac40608/0x892c60dda91c8e58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.219888:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788528604.219891:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528604.219895:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ac40608/0x892c60dda91c8e58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.219916:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ac40608/0x892c60dda91c8e58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.219925:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ac40608/0x892c60dda91c8e58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.219932:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ac40608/0x892c60dda91c8e58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.220115:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788528604.220133:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acf2d2f3/0x892c60dda91c8e51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.220140:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850800 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528604.220144:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acf2d2f3/0x892c60dda91c8e51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.220153:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acf2d2f3/0x892c60dda91c8e51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.220175:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acf2d2f3/0x892c60dda91c8e51 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.220182:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acf2d2f3/0x892c60dda91c8e51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.220197:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528604.220201:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ac40608/0x892c60dda91c8e58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.220207:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850200 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528604.220210:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ac40608/0x892c60dda91c8e58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.220218:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ac40608/0x892c60dda91c8e58 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.220227:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ac40608/0x892c60dda91c8e58 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.220233:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528604.220235:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528604.220237:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528604.220309:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788528604.220314:0:19172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ac40608/0x892c60dda91c8e58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788528604.220652:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528604.220658:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000efde389/0x892c60dda91c8e5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.220671:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788528604.220675:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528604.220679:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000efde389/0x892c60dda91c8e5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.220690:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000efde389/0x892c60dda91c8e5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.220698:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000efde389/0x892c60dda91c8e5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.220705:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000efde389/0x892c60dda91c8e5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.220717:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788528604.221075:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528604.221081:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fef232b8/0x892c60dda91c8e66 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.221091:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788528604.221094:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528604.221098:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fef232b8/0x892c60dda91c8e66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.221108:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fef232b8/0x892c60dda91c8e66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.221137:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fef232b8/0x892c60dda91c8e66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.221144:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fef232b8/0x892c60dda91c8e66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.221152:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788528604.221406:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788528604.221413:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000efde389/0x892c60dda91c8e5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.221432:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101851400 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528604.221436:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000efde389/0x892c60dda91c8e5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.221444:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000efde389/0x892c60dda91c8e5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.221457:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000efde389/0x892c60dda91c8e5f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.221464:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000efde389/0x892c60dda91c8e5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.221478:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528604.221481:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fef232b8/0x892c60dda91c8e66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.221487:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850000 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528604.221490:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fef232b8/0x892c60dda91c8e66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.221497:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fef232b8/0x892c60dda91c8e66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.221506:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fef232b8/0x892c60dda91c8e66 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.221518:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fef232b8/0x892c60dda91c8e66 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.221530:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528604.221532:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528604.221533:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528604.221541:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788528604.221660:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528604.221666:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c17ff65d/0x892c60dda91c8e6d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.221673:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788528604.221676:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528604.221680:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c17ff65d/0x892c60dda91c8e6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.221688:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c17ff65d/0x892c60dda91c8e6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.221696:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c17ff65d/0x892c60dda91c8e6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.221703:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c17ff65d/0x892c60dda91c8e6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.221733:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788528604.221985:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528604.221990:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c17ff65d/0x892c60dda91c8e6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.222007:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101851200 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528604.222011:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c17ff65d/0x892c60dda91c8e6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.222020:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c17ff65d/0x892c60dda91c8e6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.222030:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c17ff65d/0x892c60dda91c8e6d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.222038:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c17ff65d/0x892c60dda91c8e6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.222051:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528604.222052:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528604.222059:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788528604.222166:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528604.222172:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090ef57cc/0x892c60dda91c8e74 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.222180:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788528604.222183:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528604.222188:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090ef57cc/0x892c60dda91c8e74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.222196:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090ef57cc/0x892c60dda91c8e74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.222205:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090ef57cc/0x892c60dda91c8e74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.222212:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090ef57cc/0x892c60dda91c8e74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.222255:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788528604.222627:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528604.222633:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050a2f966/0x892c60dda91c8e7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.222641:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788528604.222649:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528604.222653:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050a2f966/0x892c60dda91c8e7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.222661:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050a2f966/0x892c60dda91c8e7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.222668:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050a2f966/0x892c60dda91c8e7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.222675:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050a2f966/0x892c60dda91c8e7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.222759:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788528604.222764:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090ef57cc/0x892c60dda91c8e74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.222771:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c13fde00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528604.222774:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090ef57cc/0x892c60dda91c8e74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.222781:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090ef57cc/0x892c60dda91c8e74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.222791:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090ef57cc/0x892c60dda91c8e74 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.222798:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090ef57cc/0x892c60dda91c8e74 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.222811:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528604.222815:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050a2f966/0x892c60dda91c8e7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.222821:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c13fc200 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528604.222824:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050a2f966/0x892c60dda91c8e7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.222830:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050a2f966/0x892c60dda91c8e7b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.222847:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050a2f966/0x892c60dda91c8e7b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.222855:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528604.222856:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528604.222858:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528604.223754:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788528604.223761:0:19172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050a2f966/0x892c60dda91c8e7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.224830:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788528604.225390:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528604.225399:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066f1c529/0x892c60dda91c8e82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.225414:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788528604.225418:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528604.225424:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066f1c529/0x892c60dda91c8e82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.225437:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066f1c529/0x892c60dda91c8e82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.225452:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066f1c529/0x892c60dda91c8e82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.225460:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066f1c529/0x892c60dda91c8e82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.225515:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788528604.226040:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528604.226046:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b6f8c89/0x892c60dda91c8e89 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.226056:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788528604.226059:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528604.226064:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b6f8c89/0x892c60dda91c8e89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.226073:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b6f8c89/0x892c60dda91c8e89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.226081:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b6f8c89/0x892c60dda91c8e89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.226088:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b6f8c89/0x892c60dda91c8e89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.226302:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788528604.226309:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066f1c529/0x892c60dda91c8e82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.226317:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c13fc400 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528604.226321:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066f1c529/0x892c60dda91c8e82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.226331:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066f1c529/0x892c60dda91c8e82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.226346:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066f1c529/0x892c60dda91c8e82 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.226353:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066f1c529/0x892c60dda91c8e82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.226369:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528604.226372:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b6f8c89/0x892c60dda91c8e89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.226385:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c13fc600 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528604.226388:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b6f8c89/0x892c60dda91c8e89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.226396:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b6f8c89/0x892c60dda91c8e89 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.226407:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b6f8c89/0x892c60dda91c8e89 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.226414:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528604.226416:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528604.226418:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528604.226478:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788528604.226484:0:19172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b6f8c89/0x892c60dda91c8e89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788528604.227037:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528604.227044:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3272649/0x892c60dda91c8e90 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.227054:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788528604.227058:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528604.227063:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3272649/0x892c60dda91c8e90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.227073:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3272649/0x892c60dda91c8e90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.227081:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3272649/0x892c60dda91c8e90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.227088:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3272649/0x892c60dda91c8e90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.227155:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528604.227161:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3272649/0x892c60dda91c8e90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.227168:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c13fd400 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528604.227171:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3272649/0x892c60dda91c8e90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.227180:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3272649/0x892c60dda91c8e90 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.227192:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3272649/0x892c60dda91c8e90 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.227206:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528604.227208:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528604.227210:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528604.227356:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788528604.227361:0:19172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3272649/0x892c60dda91c8e90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788528604.228418:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528604.228427:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd488e82/0x892c60dda91c8e97 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.228438:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788528604.228442:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528604.228446:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd488e82/0x892c60dda91c8e97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.228456:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd488e82/0x892c60dda91c8e97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.228465:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd488e82/0x892c60dda91c8e97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.228472:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd488e82/0x892c60dda91c8e97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.228544:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528604.228569:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd488e82/0x892c60dda91c8e97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.228577:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428200 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528604.228581:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd488e82/0x892c60dda91c8e97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.228589:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd488e82/0x892c60dda91c8e97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.228670:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd488e82/0x892c60dda91c8e97 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.228679:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528604.228681:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528604.228682:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528604.229057:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788528604.229064:0:19172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd488e82/0x892c60dda91c8e97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788528604.229493:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528604.229500:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069e4eb91/0x892c60dda91c8e9e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.229510:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788528604.229513:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528604.229518:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069e4eb91/0x892c60dda91c8e9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.229528:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069e4eb91/0x892c60dda91c8e9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.229536:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069e4eb91/0x892c60dda91c8e9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.229543:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069e4eb91/0x892c60dda91c8e9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.229711:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528604.229717:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069e4eb91/0x892c60dda91c8e9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.229725:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428e00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528604.229729:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069e4eb91/0x892c60dda91c8e9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.229744:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069e4eb91/0x892c60dda91c8e9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.229757:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069e4eb91/0x892c60dda91c8e9e lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528604.229765:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528604.229767:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528604.229769:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528604.232411:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788528604.232424:0:19172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069e4eb91/0x892c60dda91c8e9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788528604.233284:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528604.233294:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ddab49b/0x892c60dda91c8ea5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.233307:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788528604.233312:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528604.233319:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ddab49b/0x892c60dda91c8ea5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.233332:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ddab49b/0x892c60dda91c8ea5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.233340:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ddab49b/0x892c60dda91c8ea5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.233348:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ddab49b/0x892c60dda91c8ea5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.233373:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788528604.233756:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528604.233762:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000122a572b/0x892c60dda91c8eac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.233772:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788528604.233776:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528604.233787:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000122a572b/0x892c60dda91c8eac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.233797:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000122a572b/0x892c60dda91c8eac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.233806:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000122a572b/0x892c60dda91c8eac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.233813:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000122a572b/0x892c60dda91c8eac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.233822:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788528604.234242:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788528604.234251:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ddab49b/0x892c60dda91c8ea5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.234260:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428600 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528604.234265:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ddab49b/0x892c60dda91c8ea5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.234275:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ddab49b/0x892c60dda91c8ea5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.234291:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ddab49b/0x892c60dda91c8ea5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.234298:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ddab49b/0x892c60dda91c8ea5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.234317:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788528604.234320:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000122a572b/0x892c60dda91c8eac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.234327:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784e400 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528604.234330:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000122a572b/0x892c60dda91c8eac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.234350:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000122a572b/0x892c60dda91c8eac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.234360:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000122a572b/0x892c60dda91c8eac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.234367:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000122a572b/0x892c60dda91c8eac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.234381:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528604.234383:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528604.234384:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528604.234470:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788528604.234544:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528604.234550:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de53e17f/0x892c60dda91c8eb3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.234762:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788528604.234765:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528604.234770:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de53e17f/0x892c60dda91c8eb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.234781:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de53e17f/0x892c60dda91c8eb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.234789:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de53e17f/0x892c60dda91c8eb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.234808:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de53e17f/0x892c60dda91c8eb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528604.240691:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788528604.241699:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788528604.241710:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003c263a9/0x892c60dda91c8eba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528604.241726:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1788528604.241730:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788528604.241736:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003c263a9/0x892c60dda91c8eba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528604.241751:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003c263a9/0x892c60dda91c8eba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528604.241762:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003c263a9/0x892c60dda91c8eba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528604.241783:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003c263a9/0x892c60dda91c8eba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.244032:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788528604.244047:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de53e17f/0x892c60dda91c8eb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.244061:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784ee00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528604.244067:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de53e17f/0x892c60dda91c8eb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.244078:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de53e17f/0x892c60dda91c8eb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.244273:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de53e17f/0x892c60dda91c8eb3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.244296:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de53e17f/0x892c60dda91c8eb3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.244319:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788528604.244324:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003c263a9/0x892c60dda91c8eba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.244331:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c14aa000 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528604.244335:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003c263a9/0x892c60dda91c8eba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.244342:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003c263a9/0x892c60dda91c8eba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.244352:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003c263a9/0x892c60dda91c8eba lrc: 2/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.244359:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528604.244361:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528604.244363:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528604.244772:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788528604.244780:0:19172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003c263a9/0x892c60dda91c8eba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.252787:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788528604.254028:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528604.254041:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076b26676/0x892c60dda91c8ec1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.254059:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1788528604.254064:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528604.254071:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076b26676/0x892c60dda91c8ec1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.254086:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076b26676/0x892c60dda91c8ec1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.254097:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076b26676/0x892c60dda91c8ec1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.254105:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076b26676/0x892c60dda91c8ec1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.254844:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788528604.255021:0:19172:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:3.0:1788528604.256244:0:19172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17162:x1875407735550208:12345-0@lo:5:osp-pre-0-0.0 Request processed in 83518us (84199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528604.256275:0:19172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1788528604.256429:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788528604.256438:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076b26676/0x892c60dda91c8ec1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.256451:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784f000 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528604.256463:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076b26676/0x892c60dda91c8ec1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.256475:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076b26676/0x892c60dda91c8ec1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.256494:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076b26676/0x892c60dda91c8ec1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.256501:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076b26676/0x892c60dda91c8ec1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.256520:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528604.256522:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528604.256523:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528604.256741:0:17162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa6b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17162:1875407735550208:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788528604.256756:0:17162:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:2.0:1788528604.256803:0:17162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17162:1875407735550336:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788528604.256851:0:17162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528604.256879:0:17162:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f5a63840 going to sleep for 11 seconds 00000100:00100000:3.0:1788528604.257253:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735550336 00000100:00100000:3.0:1788528604.257261:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735550336 00000100:00100000:3.0:1788528604.257313:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788528604.257323:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17162:x1875407735550336:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788528604.257357:0:18644:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:0.0:1788528604.271467:0:18640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1788528604.271526:0:18640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788528604.271890:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17162:x1875407735550336:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14564us (15035us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788528604.271901:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788528604.272054:0:17162:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1788528604.272063:0:17162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17162:1875407735550336:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788528604.272078:0:17162:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000100:00100000:2.0:1788528604.351137:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788528604.351159:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735550464:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788528604.351228:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528604.351365:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735550464 00000100:00100000:0.0:1788528604.351373:0:18647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735550464 00000100:00100000:0.0:1788528604.351430:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788528604.351439:0:18647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735550464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788528604.351459:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528604.351509:0:18647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735550464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528604.351516:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788528604.351628:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735550464:0@lo:13:osp-pre-0-1.0 00000020:01000004:3.0:1788528604.691548:0:19457:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:3.0:1788528604.691579:0:19457:0:(obd_mount.c:928:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788528604.691581:0:19457:0:(obd_mount.c:931:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788528604.691729:0:19457:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a90c81b5800 00000020:01000004:3.0:1788528604.691743:0:19457:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788528604.691756:0:19457:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788528604.691770:0:19457:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8a90fa608000) 00000020:00000080:3.0:1788528604.691786:0:19457:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788528604.785347:0:19457:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788528604.806643:0:19457:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788528604.808014:0:19457:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788528604.808651:0:19457:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788528604.809043:0:19457:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788528604.809697:0:19457:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788528604.810172:0:19457:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:1.0:1788528604.815422:0:19457:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788528604.815662:0:19457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788528604.815678:0:19457:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788528604.815690:0:19457:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x892c60dda91c8ecf 00000020:01000004:1.0:1788528604.815696:0:19457:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788528604.815716:0:19457:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.138@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788528604.815719:0:19457:0:(mgc_request.c:1317:mgc_set_info_async()) InitRecov MGC192.168.203.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788528604.815725:0:19457:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788528604.815753:0:19457:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.138@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788528604.815757:0:19457:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788528604.815761:0:19457:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788528604.815762:0:19457:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788528604.815763:0:19457:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788528604.815764:0:19457:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788528604.815765:0:19457:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788528604.815766:0:19457:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788528604.815767:0:19457:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788528604.815768:0:19457:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788528604.815771:0:19457:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788528604.815773:0:19457:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788528604.815774:0:19457:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788528604.815775:0:19457:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788528604.815776:0:19457:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788528604.815776:0:19457:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788528604.815777:0:19457:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788528604.815778:0:19457:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788528604.815779:0:19457:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788528604.815779:0:19457:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788528604.815806:0:19457:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788528604.815824:0:19457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa69180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735550592:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788528604.816032:0:19457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528604.816084:0:19457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695900 going to sleep for 11 seconds 00000100:00100000:3.0:1788528604.816314:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735550592 00000100:00100000:3.0:1788528604.816322:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735550592 00000100:00100000:3.0:1788528604.816370:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788528604.816377:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:19457:x1875407735550592:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788528604.816404:0:17130:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788528604.816407:0:17130:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788528604.816411:0:17130:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788528604.820969:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:19457:x1875407735550592:12345-0@lo:253:mount.lustre.0 Request processed in 4515us (4861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528604.821016:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788528604.821672:0:19457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa69180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735550592:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788528604.821689:0:19457:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788528604.821692:0:19457:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788528604.821693:0:19457:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788528604.821695:0:19457:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788528604.821696:0:19457:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788528604.821697:0:19457:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788528604.821698:0:19457:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788528604.821699:0:19457:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788528604.821700:0:19457:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788528604.821701:0:19457:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788528604.821722:0:19457:0:(tgt_mount.c:115:server_register_mount()) register mount ffff8a90c81b5800 from lustre-OST0001 10000000:01000000:1.0:1788528604.821754:0:19457:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788528604.821756:0:19457:0:(mgc_request.c:423:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788528604.821766:0:19457:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8a90c81b5800 10000000:01000000:1.0:1788528604.821778:0:19457:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788528604.821798:0:19457:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-OST0001-osd 00000040:01000000:1.0:1788528604.833299:0:19457:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788528604.856050:0:19457:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788528604.856079:0:19457:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff8a90c81b5800 from 1 10000000:01000000:3.0:1788528604.856083:0:19457:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788528604.856136:0:19457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c784e000/0x892c60dda91c8ed6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.856154:0:19457:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c784e000/0x892c60dda91c8ed6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.856166:0:19457:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c784e000/0x892c60dda91c8ed6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528604.856711:0:19457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735550720:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788528604.856775:0:19457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528604.856862:0:19457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d9d04a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788528604.860316:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735550720 00000100:00100000:2.0:1788528604.860333:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735550720 00000100:00100000:2.0:1788528604.860435:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788528604.860447:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:19457:x1875407735550720:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788528604.860469:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528604.860492:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c13fc600/0x892c60dda91c8edd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8ed6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.860522:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c13fc600/0x892c60dda91c8edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8ed6 expref: 24 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.860545:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c13fc600/0x892c60dda91c8edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8ed6 expref: 24 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.860574:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c13fc600, rc 0) 00000100:00100000:2.0:1788528604.860655:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+24:19457:x1875407735550720:12345-0@lo:101:mount.lustre.0 Request processed in 209us (3879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528604.860661:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788528604.860754:0:19457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735550720:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788528604.860773:0:19457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c784e000/0x892c60dda91c8ed6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8edd expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.860783:0:19457:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c784e000/0x892c60dda91c8ed6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8edd expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528604.860875:0:19457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735550848:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788528604.860922:0:19457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528604.869397:0:19457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d9d04a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788528604.871154:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735550976:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788528604.871232:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528604.871295:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735550976 00000100:00100000:3.0:1788528604.871303:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735550976 00000100:00100000:3.0:1788528604.871345:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788528604.871352:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735550976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788528604.871388:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788528604.871445:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735550976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528604.871452:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788528604.871502:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735550976:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788528604.873318:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735550848 00000100:00100000:1.0:1788528604.873331:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735550848 00000100:00100000:1.0:1788528604.874694:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788528604.874704:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+24:19457:x1875407735550848:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788528604.874833:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+24:19457:x1875407735550848:12345-0@lo:501:mount.lustre.0 Request processed in 130us (13910us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788528604.874841:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788528604.874935:0:19457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735550848:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788528604.874956:0:19457:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.203.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:3.0:1788528604.875021:0:19457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735551104:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788528604.875053:0:19457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528604.875085:0:19457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d9d04a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788528604.875279:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735551104 00000100:00100000:1.0:1788528604.875285:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735551104 00000100:00100000:1.0:1788528604.875303:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788528604.875307:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+24:19457:x1875407735551104:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788528604.875359:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+24:19457:x1875407735551104:12345-0@lo:501:mount.lustre.0 Request processed in 50us (306us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788528604.875365:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788528604.875419:0:19457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735551104:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788528604.875437:0:19457:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788528604.875457:0:19457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c784e000/0x892c60dda91c8ed6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8edd expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.875467:0:19457:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c784e000/0x892c60dda91c8ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8edd expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528604.875479:0:19457:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff8a90c81b5800 10000000:01000000:3.0:1788528604.875485:0:19457:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788528604.875507:0:19457:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-OST0001-osd 00000040:01000000:3.0:1788528604.875636:0:19457:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788528604.875642:0:19457:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788528604.875653:0:19457:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788528604.875656:0:19457:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788528604.875678:0:19457:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-OST0001-osd 00000040:01000000:3.0:1788528604.875701:0:19457:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788528604.875705:0:19457:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788528604.875716:0:19457:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788528604.875718:0:19457:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788528604.875742:0:19457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c784ec00/0x892c60dda91c8ee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.875749:0:19457:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c784ec00/0x892c60dda91c8ee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.875757:0:19457:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c784ec00/0x892c60dda91c8ee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528604.875768:0:19457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735551232:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788528604.875792:0:19457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528604.875815:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735551232 00000100:00100000:3.0:1788528604.875818:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735551232 00000100:00100000:3.0:1788528604.875835:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788528604.875839:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+24:19457:x1875407735551232:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788528604.875847:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528604.875856:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c784f200/0x892c60dda91c8eeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8ee4 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.875877:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c784f200/0x892c60dda91c8eeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8ee4 expref: 25 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.875886:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c784f200/0x892c60dda91c8eeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8ee4 expref: 25 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.875894:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c784f200, rc 0) 00000100:00100000:3.0:1788528604.875929:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+25:19457:x1875407735551232:12345-0@lo:101:mount.lustre.0 Request processed in 88us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528604.875944:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788528604.875971:0:19457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d9d046c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528604.875984:0:19457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735551232:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788528604.876006:0:19457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c784ec00/0x892c60dda91c8ee4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8eeb expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.876015:0:19457:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c784ec00/0x892c60dda91c8ee4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8eeb expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788528604.878205:0:19457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788528604.879066:0:19457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788528604.883781:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788528604.883835:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 128 off8544 00000040:00080000:3.0:1788528604.883848:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 112 off8656 00000040:00080000:3.0:1788528604.883858:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8880 00000040:00080000:3.0:1788528604.883868:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9104 00000040:00080000:3.0:1788528604.883878:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 80 off9184 00000040:00080000:3.0:1788528604.883890:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9408 00000040:00080000:3.0:1788528604.884266:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9632 00000040:00080000:3.0:1788528604.884298:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 120 off9752 00000040:00080000:3.0:1788528604.884321:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off9976 00000040:00080000:3.0:1788528604.884326:0:19457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 11 00000100:00100000:3.0:1788528604.884424:0:19457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735551360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788528604.884487:0:19457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528604.885024:0:19457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d61c4300 going to sleep for 11 seconds 00000100:00100000:1.0:1788528604.886472:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735551360 00000100:00100000:1.0:1788528604.886484:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735551360 00000100:00100000:1.0:1788528604.886563:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788528604.886573:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+25:19457:x1875407735551360:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788528604.886741:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+25:19457:x1875407735551360:12345-0@lo:501:mount.lustre.0 Request processed in 169us (2253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528604.886748:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788528604.887093:0:19457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735551360:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788528604.887153:0:19457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735551488:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788528604.887309:0:19457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528604.887341:0:19457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c5ade540 going to sleep for 11 seconds 00000100:00100000:2.0:1788528604.887416:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735551488 00000100:00100000:2.0:1788528604.887421:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735551488 00000100:00100000:2.0:1788528604.887456:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788528604.887463:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+25:19457:x1875407735551488:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788528604.888282:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+25:19457:x1875407735551488:12345-0@lo:503:mount.lustre.0 Request processed in 816us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528604.888290:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788528604.888387:0:19457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735551488:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788528604.888897:0:19457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788528604.889060:0:19457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735551616:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788528604.889103:0:19457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528604.889745:0:19457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c5ade540 going to sleep for 11 seconds 00000100:00100000:2.0:1788528604.889809:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735551616 00000100:00100000:2.0:1788528604.889823:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735551616 00000100:00100000:2.0:1788528604.889911:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788528604.889919:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+25:19457:x1875407735551616:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788528604.891809:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+25:19457:x1875407735551616:12345-0@lo:502:mount.lustre.0 Request processed in 1884us (2698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528604.891821:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788528604.891948:0:19457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735551616:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788528604.892213:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788528604.892239:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 128 off8544 00000040:00080000:0.0:1788528604.892250:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 112 off8656 00000040:00080000:0.0:1788528604.892273:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8880 00000040:00080000:0.0:1788528604.892284:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9104 00000040:00080000:0.0:1788528604.892293:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 80 off9184 00000040:00080000:0.0:1788528604.892302:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9408 00000040:00080000:0.0:1788528604.892312:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9632 00000040:00080000:0.0:1788528604.892321:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 120 off9752 00000100:00100000:0.0:1788528604.892350:0:19457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735551744:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788528604.892389:0:19457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528604.894595:0:19457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c5ade540 going to sleep for 11 seconds 00000100:00100000:1.0:1788528604.900503:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735551744 00000100:00100000:1.0:1788528604.900519:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735551744 00000100:00100000:1.0:1788528604.900594:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788528604.900605:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+25:19457:x1875407735551744:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788528604.900789:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+25:19457:x1875407735551744:12345-0@lo:502:mount.lustre.0 Request processed in 186us (8398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528604.900797:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788528604.902131:0:19457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735551744:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788528604.902219:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off9976 00000040:00080000:0.0:1788528604.902232:0:19457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1788528604.903843:0:19461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788528604.903853:0:19461:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788528604.903860:0:19461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528604.903862:0:19461:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788528604.903874:0:19461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788528604.903887:0:19461:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8a90fa60e600) 00000020:00000080:3.0:1788528604.903911:0:19461:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788528604.903915:0:19461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788528604.903976:0:19461:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a90c81b5800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788528604.903985:0:19461:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788528604.904001:0:19461:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x892c60dda91c8ef9 00010000:00010000:3.0:1788528604.910478:0:19461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1788528604.911702:0:19461:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1788528604.913234:0:19461:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1788528604.915029:0:19461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788528604.915042:0:19461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528604.915048:0:19461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528604.915050:0:19461:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788528604.915054:0:19461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528604.915059:0:19461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528604.915060:0:19461:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788528604.915063:0:19461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788528604.915065:0:19461:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788528604.915067:0:19461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528604.915070:0:19461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528604.915072:0:19461:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788528604.915074:0:19461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528604.915077:0:19461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528604.915078:0:19461:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788528604.915082:0:19461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788528604.915109:0:19461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528604.915112:0:19461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528604.915114:0:19461:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788528604.915117:0:19461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 11 count 11 00000020:01000000:3.0:1788528604.915227:0:19457:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788528604.915245:0:19457:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788528604.915271:0:19457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c784ec00/0x892c60dda91c8ee4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8eeb expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.915284:0:19457:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c784ec00/0x892c60dda91c8ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8eeb expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528604.915292:0:19457:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a90c81b5800 from 1 10000000:01000000:3.0:1788528604.915296:0:19457:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788528604.915331:0:19457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c784f600/0x892c60dda91c8f00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.915339:0:19457:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c784f600/0x892c60dda91c8f00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.915349:0:19457:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c784f600/0x892c60dda91c8f00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528604.915373:0:19457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735551872:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788528604.915446:0:19457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528604.915486:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735551872 00000100:00100000:3.0:1788528604.915501:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735551872 00000100:00100000:3.0:1788528604.915544:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788528604.915576:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+25:19457:x1875407735551872:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788528604.915590:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528604.915602:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c784ea00/0x892c60dda91c8f07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8f00 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.915625:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c784ea00/0x892c60dda91c8f07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8f00 expref: 26 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.915636:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c784ea00/0x892c60dda91c8f07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8f00 expref: 26 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.915644:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c784ea00, rc 0) 00000100:00100000:3.0:1788528604.915678:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+26:19457:x1875407735551872:12345-0@lo:101:mount.lustre.0 Request processed in 126us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528604.915684:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788528604.915729:0:19457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc36e5840 going to sleep for 11 seconds 00000100:00100000:3.0:1788528604.915751:0:19457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735551872:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788528604.915765:0:19457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c784f600/0x892c60dda91c8f00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8f07 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.915774:0:19457:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c784f600/0x892c60dda91c8f00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8f07 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788528604.921327:0:19457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000040:00080000:2.0:1788528604.921781:0:19457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788528604.921972:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1788528604.922016:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 112 off8528 00000040:00080000:2.0:1788528604.922032:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 224 off8752 00000040:00080000:2.0:1788528604.922046:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8976 00000040:00080000:2.0:1788528604.922063:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 112 off9088 00000040:00080000:2.0:1788528604.922078:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 224 off9312 00000040:00080000:2.0:1788528604.922106:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 224 off9536 00000040:00080000:2.0:1788528604.922139:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 128 off9664 00000040:00080000:2.0:1788528604.922155:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1788528604.922167:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 224 off10112 00000040:00080000:2.0:1788528604.922180:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 128 off10240 00000040:00080000:2.0:1788528604.922198:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10464 00000040:00080000:2.0:1788528604.922204:0:19457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 12 count 13 00000100:00100000:2.0:1788528604.922283:0:19457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735552000:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788528604.922352:0:19457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528604.922397:0:19457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d9f956c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528604.922610:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735552000 00000100:00100000:3.0:1788528604.922619:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735552000 00000100:00100000:3.0:1788528604.922669:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788528604.922774:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+26:19457:x1875407735552000:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788528604.922899:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+26:19457:x1875407735552000:12345-0@lo:501:mount.lustre.0 Request processed in 223us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528604.922907:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788528604.924405:0:19457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735552000:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788528604.924460:0:19457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735552128:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788528604.924752:0:19457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528604.924806:0:19457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d9f956c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528604.924807:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735552128 00000100:00100000:3.0:1788528604.924815:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735552128 00000100:00100000:3.0:1788528604.924872:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788528604.924882:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+26:19457:x1875407735552128:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788528604.925024:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+26:19457:x1875407735552128:12345-0@lo:503:mount.lustre.0 Request processed in 144us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528604.925032:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788528604.925100:0:19457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735552128:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788528604.925516:0:19457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788528604.926278:0:19457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735552256:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788528604.926337:0:19457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528604.926376:0:19457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c2d793c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528604.926388:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735552256 00000100:00100000:1.0:1788528604.926395:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735552256 00000100:00100000:1.0:1788528604.926438:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788528604.926446:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+26:19457:x1875407735552256:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788528604.926571:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+26:19457:x1875407735552256:12345-0@lo:502:mount.lustre.0 Request processed in 126us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528604.926578:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788528604.926721:0:19457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735552256:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788528604.926923:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1788528604.926950:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 112 off8528 00000040:00080000:0.0:1788528604.926962:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 224 off8752 00000040:00080000:0.0:1788528604.926974:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8976 00000040:00080000:0.0:1788528604.926986:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 112 off9088 00000040:00080000:0.0:1788528604.927011:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 224 off9312 00000040:00080000:0.0:1788528604.927036:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 224 off9536 00000040:00080000:0.0:1788528604.927051:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 128 off9664 00000040:00080000:0.0:1788528604.927063:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1788528604.927076:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 224 off10112 00000040:00080000:0.0:1788528604.927088:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 128 off10240 00000100:00100000:0.0:1788528604.927112:0:19457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735552384:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788528604.927150:0:19457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528604.927184:0:19457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c5ade540 going to sleep for 11 seconds 00000100:00100000:2.0:1788528604.927190:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735552384 00000100:00100000:2.0:1788528604.927196:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735552384 00000100:00100000:2.0:1788528604.928205:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788528604.928218:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+26:19457:x1875407735552384:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788528604.928345:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+26:19457:x1875407735552384:12345-0@lo:502:mount.lustre.0 Request processed in 131us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528604.928353:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788528604.928400:0:19457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735552384:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788528604.928471:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10464 00000040:00080000:1.0:1788528604.928482:0:19457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788528604.929409:0:19465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528604.929420:0:19465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528604.929422:0:19465:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788528604.929429:0:19465:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a90c81b5800 00000020:00000080:1.0:1788528604.929666:0:19465:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788528604.929736:0:19465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528604.929740:0:19465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528604.929742:0:19465:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788528604.929745:0:19465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528604.929748:0:19465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528604.929749:0:19465:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788528604.929752:0:19465:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a90c81b5800 00000020:00000080:1.0:1788528604.929754:0:19465:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788528604.929850:0:19465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528604.929854:0:19465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528604.929856:0:19465:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788528604.929859:0:19465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528604.929861:0:19465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528604.929863:0:19465:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788528604.929866:0:19465:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a90c81b5800 00000020:00000080:1.0:1788528604.929868:0:19465:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788528604.932027:0:19465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528604.932334:0:19465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528604.932337:0:19465:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788528604.932342:0:19465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788528604.932346:0:19465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528604.932347:0:19465:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788528604.932352:0:19465:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a90c81b5800 00000020:00000080:0.0:1788528604.932355:0:19465:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788528604.932408:0:19465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528604.932411:0:19465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528604.932412:0:19465:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788528604.932415:0:19465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 13 count 13 00000020:01000000:1.0:1788528604.932815:0:19457:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788528604.932829:0:19457:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788528604.932853:0:19457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c784f600/0x892c60dda91c8f00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8f07 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528604.932865:0:19457:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c784f600/0x892c60dda91c8f00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8f07 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528604.932942:0:19457:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788528604.932945:0:19457:0:(mgc_request.c:423:config_log_add()) add config log lustre-client-ffff8a90c81b5800 10000000:01000000:1.0:1788528604.932949:0:19457:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff8a90c81b5800 10000000:01000000:1.0:1788528604.932954:0:19457:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788528604.932969:0:19457:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-OST0001-osd 00000040:01000000:1.0:1788528604.933041:0:19457:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:1.0:1788528604.933048:0:19457:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:1.0:1788528604.933061:0:19457:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff8a90c81b5800 from 1 10000000:01000000:1.0:1788528604.933064:0:19457:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788528604.933100:0:19457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab200/0x892c60dda91c8f0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528604.933109:0:19457:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab200/0x892c60dda91c8f0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528604.933120:0:19457:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab200/0x892c60dda91c8f0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528604.933144:0:19457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa69180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735552512:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788528604.933206:0:19457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528604.933247:0:19457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6efd780 going to sleep for 11 seconds 00000100:00100000:2.0:1788528604.933405:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735552512 00000100:00100000:2.0:1788528604.933415:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735552512 00000100:00100000:2.0:1788528604.933472:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788528604.933483:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+26:19457:x1875407735552512:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788528604.933499:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528604.933515:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c13fc200/0x892c60dda91c8f15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8f0e expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.933576:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c13fc200/0x892c60dda91c8f15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8f0e expref: 27 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.933589:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c13fc200/0x892c60dda91c8f15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8f0e expref: 27 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528604.933597:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c13fc200, rc 0) 00000100:00100000:2.0:1788528604.933655:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:19457:x1875407735552512:12345-0@lo:101:mount.lustre.0 Request processed in 174us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528604.933662:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788528604.933852:0:19457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa69180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735552512:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788528604.933869:0:19457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab200/0x892c60dda91c8f0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8f15 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528604.933878:0:19457:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab200/0x892c60dda91c8f0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8f15 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788528604.935386:0:19457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 52 count 51 00000040:00080000:3.0:1788528604.935871:0:19457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788528604.936083:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].1, 224 off8416 00000040:00080000:3.0:1788528604.936111:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].2, 120 off8536 00000040:00080000:3.0:1788528604.936154:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].3, 168 off8704 00000040:00080000:3.0:1788528604.936170:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].4, 224 off8928 00000040:00080000:3.0:1788528604.936182:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].5, 224 off9152 00000040:00080000:3.0:1788528604.936192:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].6, 120 off9272 00000040:00080000:3.0:1788528604.936203:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].7, 168 off9440 00000040:00080000:3.0:1788528604.936215:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].8, 224 off9664 00000040:00080000:3.0:1788528604.936227:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].9, 224 off9888 00000040:00080000:3.0:1788528604.936251:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].10, 120 off10008 00000040:00080000:3.0:1788528604.936265:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].11, 224 off10232 00000040:00080000:3.0:1788528604.936277:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].12, 224 off10456 00000040:00080000:3.0:1788528604.936291:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].13, 88 off10544 00000040:00080000:3.0:1788528604.936305:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].14, 128 off10672 00000040:00080000:3.0:1788528604.936317:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].15, 144 off10816 00000040:00080000:3.0:1788528604.936331:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].16, 160 off10976 00000040:00080000:3.0:1788528604.936344:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].17, 224 off11200 00000040:00080000:3.0:1788528604.936358:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].18, 224 off11424 00000040:00080000:3.0:1788528604.936385:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].19, 80 off11504 00000040:00080000:3.0:1788528604.936401:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].20, 224 off11728 00000040:00080000:3.0:1788528604.936415:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].21, 224 off11952 00000040:00080000:3.0:1788528604.936430:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].22, 88 off12040 00000040:00080000:3.0:1788528604.936446:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].23, 128 off12168 00000040:00080000:3.0:1788528604.936460:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].24, 144 off12312 00000040:00080000:3.0:1788528604.936476:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].25, 160 off12472 00000040:00080000:3.0:1788528604.936491:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].26, 224 off12696 00000040:00080000:3.0:1788528604.936506:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].27, 224 off12920 00000040:00080000:3.0:1788528604.936520:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].28, 80 off13000 00000040:00080000:3.0:1788528604.936582:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].29, 224 off13224 00000040:00080000:3.0:1788528604.936603:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].30, 224 off13448 00000040:00080000:3.0:1788528604.936621:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].31, 88 off13536 00000040:00080000:3.0:1788528604.936638:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].32, 128 off13664 00000040:00080000:3.0:1788528604.936654:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].33, 144 off13808 00000040:00080000:3.0:1788528604.936671:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].34, 128 off13936 00000040:00080000:3.0:1788528604.936702:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].35, 224 off14160 00000040:00080000:3.0:1788528604.936719:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].36, 224 off14384 00000040:00080000:3.0:1788528604.936732:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].37, 80 off14464 00000040:00080000:3.0:1788528604.936744:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].38, 224 off14688 00000040:00080000:3.0:1788528604.936757:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].39, 224 off14912 00000040:00080000:3.0:1788528604.936770:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].40, 88 off15000 00000040:00080000:3.0:1788528604.936783:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].41, 128 off15128 00000040:00080000:3.0:1788528604.936798:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].42, 144 off15272 00000040:00080000:3.0:1788528604.936823:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].43, 128 off15400 00000040:00080000:3.0:1788528604.936841:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].44, 224 off15624 00000040:00080000:3.0:1788528604.936862:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].45, 224 off15848 00000040:00080000:3.0:1788528604.936882:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].46, 80 off15928 00000040:00080000:3.0:1788528604.936903:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].47, 224 off16152 00000040:00080000:3.0:1788528604.936923:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].48, 232 off16384 00000040:00080000:3.0:1788528604.937097:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].49, 224 off16608 00000040:00080000:3.0:1788528604.937122:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].50, 120 off16728 00000040:00080000:3.0:1788528604.937146:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].51, 224 off16952 00000040:00080000:3.0:1788528604.937153:0:19457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 51 count 51 00000100:00100000:3.0:1788528604.937249:0:19457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735552640:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788528604.937315:0:19457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528604.937359:0:19457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc36e5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788528604.937708:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735552640 00000100:00100000:2.0:1788528604.937715:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735552640 00000100:00100000:2.0:1788528604.937761:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788528604.937769:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:19457:x1875407735552640:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788528604.937897:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:19457:x1875407735552640:12345-0@lo:501:mount.lustre.0 Request processed in 128us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528604.937904:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788528604.939260:0:19457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735552640:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788528604.939316:0:19457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735552768:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788528604.939380:0:19457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528604.939465:0:19457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc36e5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788528604.941908:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735552768 00000100:00100000:2.0:1788528604.941923:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735552768 00000100:00100000:2.0:1788528604.944157:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788528604.944177:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:19457:x1875407735552768:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788528604.944339:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:19457:x1875407735552768:12345-0@lo:503:mount.lustre.0 Request processed in 169us (4957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528604.944347:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788528604.945261:0:19457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735552768:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788528604.946447:0:19457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788528604.946851:0:19457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735552896:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788528604.946933:0:19457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528604.947024:0:19457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc36e56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528604.950300:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735552896 00000100:00100000:2.0:1788528604.950313:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735552896 00000100:00100000:2.0:1788528604.950380:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788528604.950391:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:19457:x1875407735552896:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788528604.950768:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:19457:x1875407735552896:12345-0@lo:502:mount.lustre.0 Request processed in 379us (3834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528604.950777:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788528604.951841:0:19457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735552896:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788528604.952080:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].1, 224 off8416 00000040:00080000:3.0:1788528604.952115:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].2, 120 off8536 00000040:00080000:3.0:1788528604.952129:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].3, 168 off8704 00000040:00080000:3.0:1788528604.952141:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].4, 224 off8928 00000040:00080000:3.0:1788528604.952163:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].5, 224 off9152 00000040:00080000:3.0:1788528604.952176:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].6, 120 off9272 00000040:00080000:3.0:1788528604.952188:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].7, 168 off9440 00000040:00080000:3.0:1788528604.952199:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].8, 224 off9664 00000040:00080000:3.0:1788528604.952211:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].9, 224 off9888 00000040:00080000:3.0:1788528604.952223:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].10, 120 off10008 00000040:00080000:3.0:1788528604.952237:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].11, 224 off10232 00000040:00080000:3.0:1788528604.952251:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].12, 224 off10456 00000040:00080000:3.0:1788528604.953389:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].13, 88 off10544 00000040:00080000:3.0:1788528604.953415:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].14, 128 off10672 00000040:00080000:3.0:1788528604.953427:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].15, 144 off10816 00000040:00080000:3.0:1788528604.953440:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].16, 160 off10976 00000040:00080000:3.0:1788528604.953452:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].17, 224 off11200 00000040:00080000:3.0:1788528604.953464:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].18, 224 off11424 00000040:00080000:3.0:1788528604.953477:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].19, 80 off11504 00000040:00080000:3.0:1788528604.953489:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].20, 224 off11728 00000040:00080000:3.0:1788528604.953501:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].21, 224 off11952 00000040:00080000:3.0:1788528604.953513:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].22, 88 off12040 00000040:00080000:3.0:1788528604.953526:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].23, 128 off12168 00000040:00080000:3.0:1788528604.953540:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].24, 144 off12312 00000040:00080000:3.0:1788528604.953570:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].25, 160 off12472 00000040:00080000:3.0:1788528604.953586:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].26, 224 off12696 00000040:00080000:3.0:1788528604.953599:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].27, 224 off12920 00000040:00080000:3.0:1788528604.953611:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].28, 80 off13000 00000040:00080000:3.0:1788528604.953638:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].29, 224 off13224 00000040:00080000:3.0:1788528604.953653:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].30, 224 off13448 00000040:00080000:3.0:1788528604.953665:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].31, 88 off13536 00000040:00080000:3.0:1788528604.954810:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].32, 128 off13664 00000040:00080000:3.0:1788528604.954846:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].33, 144 off13808 00000040:00080000:3.0:1788528604.954860:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].34, 128 off13936 00000040:00080000:3.0:1788528604.954874:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].35, 224 off14160 00000040:00080000:3.0:1788528604.954889:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].36, 224 off14384 00000040:00080000:3.0:1788528604.954902:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].37, 80 off14464 00000040:00080000:3.0:1788528604.954929:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].38, 224 off14688 00000040:00080000:3.0:1788528604.954944:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].39, 224 off14912 00000040:00080000:3.0:1788528604.954958:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].40, 88 off15000 00000040:00080000:3.0:1788528604.954973:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].41, 128 off15128 00000040:00080000:3.0:1788528604.954987:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].42, 144 off15272 00000040:00080000:3.0:1788528604.955017:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].43, 128 off15400 00000040:00080000:3.0:1788528604.955035:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].44, 224 off15624 00000040:00080000:3.0:1788528604.955067:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].45, 224 off15848 00000040:00080000:3.0:1788528604.955087:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].46, 80 off15928 00000040:00080000:3.0:1788528604.955104:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].47, 224 off16152 00000040:00080000:3.0:1788528604.955121:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].48, 232 off16384 00000100:00100000:3.0:1788528604.955180:0:19457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735553024:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788528604.955257:0:19457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528604.955303:0:19457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc36e56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528604.955490:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735553024 00000100:00100000:0.0:1788528604.955498:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735553024 00000100:00100000:0.0:1788528604.955549:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788528604.955584:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:19457:x1875407735553024:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788528604.955725:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:19457:x1875407735553024:12345-0@lo:502:mount.lustre.0 Request processed in 142us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528604.955733:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788528604.955973:0:19457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735553024:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788528604.956164:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].49, 224 off16608 00000040:00080000:3.0:1788528604.957512:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].50, 120 off16728 00000100:00100000:3.0:1788528604.957591:0:19457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735553152:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788528604.957657:0:19457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528604.957695:0:19457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc36e56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528604.957930:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735553152 00000100:00100000:0.0:1788528604.957937:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735553152 00000100:00100000:0.0:1788528604.957978:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788528604.957987:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:19457:x1875407735553152:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788528604.958116:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:19457:x1875407735553152:12345-0@lo:502:mount.lustre.0 Request processed in 130us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528604.958124:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788528604.958207:0:19457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735553152:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788528604.958273:0:19457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].51, 224 off16952 00000040:00080000:3.0:1788528604.958283:0:19457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788528604.962846:0:19470:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788528604.962864:0:19470:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8a90fa609980) 00000020:00000080:3.0:1788528604.962903:0:19470:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1788528604.963007:0:19470:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a90c81b5800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788528604.963011:0:19470:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8a90c81b5800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788528604.963014:0:19470:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a90c81b5800 3 00010000:00080000:3.0:1788528604.963055:0:19470:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a8fc3144000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.138@tcp at head 00010000:00010000:2.0:1788528604.974232:0:19470:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1788528604.974429:0:19470:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788528604.974484:0:19470:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788528604.974507:0:19470:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x892c60dda91c8f23 00000100:00080000:2.0:1788528604.974518:0:19470:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788528604.974536:0:19470:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a8fc3144000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1788528604.974600:0:19470:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90f6da3b80 x1875407735553280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788528604.974836:0:19470:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788528604.975647:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1875407735553280:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788528604.975720:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528604.975790:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735553280 00000100:00100000:2.0:1788528604.975797:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735553280 00000100:00100000:2.0:1788528604.975832:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788528604.975840:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1875407735553280:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788528604.975867:0:17139:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:2.0:1788528604.975915:0:17139:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x892c60dda91c8f2a 00000004:00100000:2.0:1788528604.975929:0:17139:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788528604.975967:0:17139:0:(import.c:65:import_set_state_nolock()) ffff8a8fc25a8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788528604.976024:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875407735553280:12345-0@lo:38:llog_process_th.0 Request processed in 183us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528604.976031:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788528604.976066:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f6da3b80 x1875407735553280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788528614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528604.976076:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788528604.976083:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788528604.976088:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788528604.976092:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788528604.976094:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3144000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788528604.976105:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1875407735553280:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788528604.977373:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735553408:0@lo:400:kworker.0 00000100:00100000:2.0:1788528604.977429:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788528604.977504:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788528604.977508:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788528604.977511:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a90de3f4000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788528604.977516:0:469:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 473 00000100:00080000:0.0:1788528604.977519:0:469:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788528604.977535:0:469:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a90de3f4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1788528604.977572:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc4677480 x1875407735553664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788528604.979647:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788528604.979666:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735553920:0@lo:400:kworker.0 00000100:00100000:2.0:1788528604.979735:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788528604.983654:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788528604.983663:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788528604.983666:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a90f58dd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788528604.983673:0:469:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 473 00000100:00080000:0.0:1788528604.983677:0:469:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788528604.983684:0:469:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a90f58dd000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1788528604.983722:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90ffa66680 x1875407735554048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788528604.983763:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875407735554176:0@lo:400:kworker.0 00000100:00100000:0.0:1788528604.983788:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735553536:0@lo:400:kworker.0 00000100:00100000:3.0:1788528604.985035:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735553408 00000100:00100000:3.0:1788528604.985048:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735553408 00000100:00100000:3.0:1788528604.985097:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788528604.985105:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735553408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528604.989687:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528604.989742:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1875407735554304:0@lo:400:kworker.0 00000100:00100000:0.0:1788528604.989793:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528604.989824:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788528604.989840:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735553792:0@lo:400:kworker.0 00000100:00100000:0.0:1788528604.989865:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528604.989885:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735554432:0@lo:400:kworker.0 00000100:00100000:0.0:1788528604.989911:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528604.989960:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735554304 00000100:00100000:0.0:1788528604.989968:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735554304 00000100:00100000:0.0:1788528604.990021:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735553792 00000100:00100000:0.0:1788528604.990025:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735553792 00000100:00100000:0.0:1788528604.990038:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735554432 00000100:00100000:0.0:1788528604.990040:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735554432 00000100:00100000:0.0:1788528604.990056:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788528604.990063:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875407735554304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528604.991851:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875407735554304:12345-0@lo:400:kworker.0 Request processed in 1779us (2048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528604.991864:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788528604.991897:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788528604.991909:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735553792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528604.997775:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735553920 00000100:00100000:2.0:1788528604.997787:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735553920 00000100:00100000:2.0:1788528604.997836:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735553536 00000100:00100000:2.0:1788528604.997840:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735553536 00000100:00100000:2.0:1788528604.997864:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788528604.997873:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735553920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528604.999692:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528605.000003:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735553408:12345-0@lo:400:kworker.0 Request processed in 14886us (22561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528605.000015:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788528605.000076:0:19172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788528605.000091:0:19172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735553536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528605.000149:0:19172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735553536:12345-0@lo:400:kworker.0 Request processed in 65us (10469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528605.000156:0:19172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788528605.001770:0:17139:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788528605.001784:0:17139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788528605.001798:0:17137:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788528605.001806:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735554176 00000100:00100000:2.0:1788528605.002034:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735553920:12345-0@lo:400:kworker.0 Request processed in 4158us (22294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528605.002046:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788528605.002109:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735554176 00000100:00100000:0.0:1788528605.002148:0:17137:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788528605.002157:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788528605.002167:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735554432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528605.002463:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735553408:0@lo:400:kworker.0 00000100:00100000:1.0:1788528605.002497:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735553920:0@lo:400:kworker.0 00000100:00100000:0.0:1788528605.002894:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735554432:12345-0@lo:400:kworker.0 Request processed in 729us (12981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528605.002914:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788528605.002940:0:17137:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788528605.002948:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788528605.002956:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875407735554176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528605.003019:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875407735554176:12345-0@lo:400:kworker.0 Request processed in 64us (3333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528605.003026:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788528605.003304:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735553664:0@lo:8:kworker.0 00000100:00100000:0.0:1788528605.003354:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528605.003380:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735554048:0@lo:8:kworker.0 00000100:00100000:0.0:1788528605.003400:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528605.003429:0:19172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735553664 00000100:00100000:0.0:1788528605.003433:0:19172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735553664 00000100:00100000:0.0:1788528605.003452:0:19172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735554048 00000100:00100000:0.0:1788528605.003455:0:19172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735554048 00000100:00100000:0.0:1788528605.003481:0:19172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788528605.003486:0:19172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1875407735553664:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788528605.003535:0:19172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1875407735553664:12345-0@lo:8:kworker.0 Request processed in 48us (182us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788528605.003541:0:19172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788528605.003868:0:19172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788528605.003874:0:19172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1875407735554048:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788528605.004043:0:19172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1875407735554048:12345-0@lo:8:kworker.0 Request processed in 166us (640us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788528605.004051:0:19172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788528605.004090:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788528605.004097:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90de3f4000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788528605.004102:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788528605.004114:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735553664:0@lo:8:kworker.0 00000100:00100000:0.0:1788528605.004128:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788528605.004131:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90f58dd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788528605.004135:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788528605.004139:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735554048:0@lo:8:kworker.0 00010000:00080000:0.0:1788528605.004236:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90ffa66a00 x1875407735554432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528605.004251:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735554432:0@lo:400:kworker.0 00000100:00100000:0.0:1788528605.004269:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735553536:0@lo:400:kworker.0 00010000:00080000:0.0:1788528605.004282:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90ffa65180 x1875407735554304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528605.004291:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1875407735554304:0@lo:400:kworker.0 00010000:00080000:2.0:1788528605.004459:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90ffa66d80 x1875407735554176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528605.004471:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875407735554176:0@lo:400:kworker.0 00000100:00100000:0.0:1788528605.004485:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735553792:12345-0@lo:400:kworker.0 Request processed in 12579us (14616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528605.004495:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788528605.005374:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a8fc4677800 x1875407735553792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528605.005400:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735553792:0@lo:400:kworker.0 00000020:01000004:0.0:1788528605.007117:0:19470:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788528605.007134:0:19470:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8a90fb079980) 00000020:00000080:0.0:1788528605.007158:0:19470:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788528605.007328:0:19470:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a90c81b5800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788528605.007333:0:19470:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8a90c81b5800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788528605.007336:0:19470:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a90c81b5800 3 00010000:00080000:0.0:1788528605.007364:0:19470:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a90c498e800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.138@tcp at head 00010000:00010000:0.0:1788528605.012179:0:19470:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1788528605.014018:0:19470:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788528605.014077:0:19470:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788528605.014099:0:19470:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x892c60dda91c8f38 00000100:00080000:0.0:1788528605.014112:0:19470:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788528605.014117:0:19470:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8a90c498e800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1788528605.014154:0:19470:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90ffa65180 x1875407735554560/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788528605.014185:0:19470:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788528605.014393:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1875407735554560:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788528605.014464:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528605.016854:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735554560 00000100:00100000:0.0:1788528605.016866:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735554560 00000100:00100000:0.0:1788528605.016919:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788528605.016927:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1875407735554560:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788528605.016961:0:17137:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:0.0:1788528605.017027:0:17137:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x892c60dda91c8f3f 00000004:00100000:0.0:1788528605.017043:0:17137:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788528605.017077:0:17137:0:(import.c:65:import_set_state_nolock()) ffff8a90d96b5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788528605.017160:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875407735554560:12345-0@lo:38:llog_process_th.0 Request processed in 233us (2695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528605.017168:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788528605.017228:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90ffa65180 x1875407735554560/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788528615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528605.017240:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788528605.017248:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788528605.017255:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788528605.017270:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788528605.017273:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90c498e800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788528605.017278:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1875407735554560:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788528605.017284:0:19470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 52 count 51 00000020:01000000:3.0:1788528605.017368:0:19457:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788528605.017382:0:19457:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788528605.017404:0:19457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab200/0x892c60dda91c8f0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8f15 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528605.017415:0:19457:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab200/0x892c60dda91c8f0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8f15 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788528605.017463:0:19457:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788528605.017466:0:19457:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788528605.017467:0:19457:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788528605.017468:0:19457:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788528605.017469:0:19457:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788528605.017471:0:19457:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788528605.017472:0:19457:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788528605.017474:0:19457:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788528605.017476:0:19457:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788528605.017479:0:19457:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788528605.017487:0:19457:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788528605.017488:0:19457:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788528605.017489:0:19457:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788528605.017490:0:19457:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788528605.017491:0:19457:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788528605.017492:0:19457:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788528605.017493:0:19457:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788528605.017494:0:19457:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788528605.017494:0:19457:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788528605.017513:0:19457:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788528605.017528:0:19457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735554688:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788528605.017592:0:19457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528605.017621:0:19457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc36e5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788528605.018768:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735554688 00000100:00100000:0.0:1788528605.018779:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735554688 00000100:00100000:0.0:1788528605.018843:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788528605.018853:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:19457:x1875407735554688:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788528605.018883:0:17130:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788528605.018898:0:17130:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788528605.027096:0:17130:0:(mgs_nids.c:820:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788528605.027119:0:17130:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788528605.027209:0:17153:0:(mgs_nids.c:717:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788528605.027214:0:17153:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788528605.027238:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a90c784e800/0x892c60dda91c8f46 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528605.027255:0:17153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c1550200/0x892c60dda91c8de1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8dda expref: 27 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528605.027263:0:17153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c1551600/0x892c60dda91c8def lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8de8 expref: 27 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528605.027270:0:17153:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a90c784e800/0x892c60dda91c8f46 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528605.027307:0:17153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c1551600/0x892c60dda91c8def lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c8de8 expref: 27 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528605.027319:0:17153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a90c1551600/0x892c60dda91c8def lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c8de8 expref: 27 pid: 17132 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528605.027331:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17153:1875407735554816:0@lo:104: 00000100:00100000:3.0:1788528605.027403:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788528605.027452:0:17153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c1550200/0x892c60dda91c8de1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c8dda expref: 27 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528605.027460:0:17153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a90c1550200/0x892c60dda91c8de1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c8dda expref: 27 pid: 17131 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528605.027468:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17153:1875407735554944:0@lo:104: 00000100:00100000:3.0:1788528605.027486:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528605.027512:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc36e5900 going to sleep for 11 seconds 00000100:00100000:2.0:1788528605.027600:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735554816 00000100:00100000:2.0:1788528605.027609:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735554816 00000100:00100000:2.0:1788528605.027649:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735554944 00000100:00100000:2.0:1788528605.027652:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735554944 00000100:00100000:2.0:1788528605.027666:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788528605.027677:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:463b8984-c30b-4b73-b2f1-81113bd4e10a+4:17153:x1875407735554816:12345-0@lo:104: 00010000:00010000:2.0:1788528605.027688:0:17121:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c8de8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c8def expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528605.027758:0:17121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788528605.027765:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:463b8984-c30b-4b73-b2f1-81113bd4e10a+4:17153:x1875407735554816:12345-0@lo:104: Request processed in 90us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528605.027772:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788528605.027790:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788528605.027794:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788528605.027799:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:463b8984-c30b-4b73-b2f1-81113bd4e10a+3:17153:x1875407735554944:12345-0@lo:104: 00010000:00010000:1.0:1788528605.027803:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c8de8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c8def expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528605.027809:0:17121:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c1550600/0x892c60dda91c8dda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c8de1 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528605.027811:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c1550800 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528605.027817:0:17126:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c8de8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c8def expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528605.027825:0:17126:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c8de8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c8def expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528605.027830:0:17126:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c8de8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c8def expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528605.027834:0:17126:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788528605.027846:0:17121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788528605.027852:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:463b8984-c30b-4b73-b2f1-81113bd4e10a+3:17153:x1875407735554944:12345-0@lo:104: Request processed in 56us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528605.027858:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788528605.027865:0:17126:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c8de8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8def expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528605.027871:0:17126:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788528605.027875:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528605.027902:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c8de8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8def expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528605.027909:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c1550800/0x892c60dda91c8de8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8def expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528605.027922:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528605.027925:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528605.027927:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528605.027984:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788528605.028004:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:463b8984-c30b-4b73-b2f1-81113bd4e10a:3638:1875407735555072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788528605.028031:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528605.028066:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735555072 00000100:00100000:2.0:1788528605.028070:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735555072 00010000:00010000:2.0:1788528605.028085:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c1551600/0x892c60dda91c8def lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c8de8 expref: 28 pid: 17132 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528605.028105:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788528605.028111:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:463b8984-c30b-4b73-b2f1-81113bd4e10a+28:3638:x1875407735555072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788528605.028133:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528605.028139:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c1551600/0x892c60dda91c8def lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c8de8 expref: 28 pid: 17132 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528605.028153:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c1551600/0x892c60dda91c8def lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c8de8 expref: 28 pid: 17132 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528605.028167:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528605.028192:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:463b8984-c30b-4b73-b2f1-81113bd4e10a+28:3638:x1875407735555072:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528605.028198:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788528605.028230:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:463b8984-c30b-4b73-b2f1-81113bd4e10a:3638:1875407735555072:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788528605.028306:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c1551600/0x892c60dda91c8def lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c8de8 expref: 27 pid: 17132 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528605.028316:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17153:1875407735554816:0@lo:104: 00000100:00100000:3.0:1788528605.028323:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17153:1875407735554944:0@lo:104: 00010000:00010000:3.0:1788528605.028338:0:17153:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a90c784e800/0x892c60dda91c8f46 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528605.028694:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+26:19457:x1875407735554688:12345-0@lo:253:mount.lustre.0 Request processed in 9843us (11101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528605.028703:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788528605.028805:0:19457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:463b8984-c30b-4b73-b2f1-81113bd4e10a:19457:1875407735554688:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788528605.028823:0:19457:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788528605.028826:0:19457:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788528605.028827:0:19457:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788528605.028828:0:19457:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788528605.028829:0:19457:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788528605.028830:0:19457:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788528605.028832:0:19457:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788528605.028833:0:19457:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788528605.028834:0:19457:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788528605.028836:0:19457:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788528605.028847:0:19457:0:(tgt_mount.c:2815:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788528605.030837:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528605.030844:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528605.030846:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528605.030903:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c1550600/0x892c60dda91c8dda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c8de1 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528605.030916:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c1550600 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:2.0:1788528605.030921:0:17125:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c1550600/0x892c60dda91c8dda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c8de1 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528605.030932:0:17125:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c1550600/0x892c60dda91c8dda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c8de1 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788528605.030940:0:17125:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c1550600/0x892c60dda91c8dda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c8de1 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528605.030946:0:17125:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788528605.031006:0:17125:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c1550600/0x892c60dda91c8dda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8de1 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528605.031013:0:17125:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788528605.031049:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c1550600/0x892c60dda91c8dda lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8de1 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528605.031067:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c1550600/0x892c60dda91c8dda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8de1 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528605.031087:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528605.031089:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528605.031091:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528605.031099:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788528605.031116:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:463b8984-c30b-4b73-b2f1-81113bd4e10a:3637:1875407735555200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788528605.031174:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528605.031236:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735555200 00000100:00100000:2.0:1788528605.031243:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735555200 00010000:00010000:2.0:1788528605.031271:0:17123:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c1550200/0x892c60dda91c8de1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c8dda expref: 26 pid: 17131 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528605.031299:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788528605.031308:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:463b8984-c30b-4b73-b2f1-81113bd4e10a+26:3637:x1875407735555200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788528605.031320:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528605.031324:0:17123:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c1550200/0x892c60dda91c8de1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c8dda expref: 26 pid: 17131 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528605.031335:0:17123:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c1550200/0x892c60dda91c8de1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c8dda expref: 26 pid: 17131 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528605.031349:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c1550200/0x892c60dda91c8de1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c8dda expref: 26 pid: 17131 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528605.031362:0:17123:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a90c784e800/0x892c60dda91c8f46 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528605.031382:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c784e800/0x892c60dda91c8f46 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788528605.031396:0:17123:0:(mgs_nids.c:693:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009285697s 00010000:00010000:2.0:1788528605.031401:0:17123:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a90c784e800/0x892c60dda91c8f46 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528605.031407:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a90c784e800/0x892c60dda91c8f46 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528605.031414:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a90c784e800/0x892c60dda91c8f46 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528605.031419:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a90c784e800/0x892c60dda91c8f46 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528605.031424:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784e800 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528605.031428:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a90c784e800/0x892c60dda91c8f46 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528605.031435:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a90c784e800/0x892c60dda91c8f46 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528605.031449:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a90c784e800/0x892c60dda91c8f46 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528605.031459:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528605.031493:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:463b8984-c30b-4b73-b2f1-81113bd4e10a+25:3637:x1875407735555200:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528605.031500:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788528605.031546:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:463b8984-c30b-4b73-b2f1-81113bd4e10a:3637:1875407735555200:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788528605.031606:0:17153:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a90c784e800/0x892c60dda91c8f46 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528605.031616:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a90c784e800/0x892c60dda91c8f46 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528605.031622:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c784e800/0x892c60dda91c8f46 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1788528605.048122:0:19457:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788528605.054465:0:19457:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788528605.054475:0:19457:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788528605.054514:0:19457:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788528605.054544:0:19457:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788528605.061334:0:19457:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788528605.061616:0:19457:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788528605.119385:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528605.376825:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788528605.376848:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735555328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788528605.376917:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528605.376956:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735555328 00000100:00100000:1.0:1788528605.376962:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735555328 00000100:00100000:1.0:1788528605.377016:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788528605.377025:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735555328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788528605.377058:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788528605.377102:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735555328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528605.377109:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788528605.377151:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735555328:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788528606.080346:0:17889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1788528606.103041:0:19526:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788528606.103322:0:19526:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788528606.142843:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788528606.659048:0:17134:0:(mgc_request.c:714:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788528606.659056:0:17134:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff8a90f6c03000 from 10 10000000:01000000:0.0:1788528606.659061:0:17134:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788528606.659109:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0030c00/0x892c60dda91c8f4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528606.659120:0:17134:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c0030c00/0x892c60dda91c8f4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528606.659130:0:17134:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c0030c00/0x892c60dda91c8f4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528606.659154:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735555456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788528606.659224:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528606.659268:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6fa2840 going to sleep for 11 seconds 00000100:00100000:2.0:1788528606.659989:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735555456 00000100:00100000:2.0:1788528606.659998:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735555456 00000100:00100000:2.0:1788528606.660055:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788528606.660064:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+25:17134:x1875407735555456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528606.660078:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528606.660094:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c13fd000/0x892c60dda91c8f54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8f4d expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528606.660133:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c13fd000/0x892c60dda91c8f54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8f4d expref: 26 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528606.660144:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c13fd000/0x892c60dda91c8f54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8f4d expref: 26 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528606.660153:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c13fd000, rc 0) 00000100:00100000:2.0:1788528606.660203:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+26:17134:x1875407735555456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528606.660210:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788528606.661310:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735555456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788528606.661334:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c0030c00/0x892c60dda91c8f4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8f54 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528606.661345:0:17134:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c0030c00/0x892c60dda91c8f4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8f54 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528606.661434:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735555584:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788528606.661493:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528606.661530:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6fa2840 going to sleep for 11 seconds 00000100:00100000:2.0:1788528606.662059:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735555584 00000100:00100000:2.0:1788528606.662074:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735555584 00000100:00100000:2.0:1788528606.662128:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788528606.662137:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+26:17134:x1875407735555584:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788528606.662155:0:17130:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788528606.662173:0:17130:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788528606.662176:0:17130:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1788528606.662262:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+26:17134:x1875407735555584:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 127us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528606.662270:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788528606.662526:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735555584:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788528606.662604:0:17134:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788528606.662613:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0030c00/0x892c60dda91c8f4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8f54 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528606.662623:0:17134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c0030c00/0x892c60dda91c8f4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8f54 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528606.662635:0:17134:0:(mgc_request.c:714:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788528606.662638:0:17134:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff8a8fc477d800 from 10 10000000:01000000:0.0:1788528606.662640:0:17134:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788528606.662664:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8f5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528606.662672:0:17134:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8f5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528606.662680:0:17134:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8f5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528606.662695:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735555712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788528606.662726:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528606.662754:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6fa2840 going to sleep for 11 seconds 00000100:00100000:2.0:1788528606.662908:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735555712 00000100:00100000:2.0:1788528606.662914:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735555712 00000100:00100000:2.0:1788528606.662951:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788528606.662959:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+26:17134:x1875407735555712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528606.662968:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528606.662989:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c13fce00/0x892c60dda91c8f62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c8f5b expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528606.663010:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c13fce00/0x892c60dda91c8f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c8f5b expref: 27 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528606.663018:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c13fce00/0x892c60dda91c8f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8f5b expref: 27 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528606.663026:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c13fce00, rc 0) 00000100:00100000:2.0:1788528606.663055:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:17134:x1875407735555712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528606.663061:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788528606.663265:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735555712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788528606.663286:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8f5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8f62 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528606.663295:0:17134:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8f5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8f62 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528606.663338:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735555840:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788528606.663383:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528606.663413:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6fa2840 going to sleep for 11 seconds 00000100:00100000:2.0:1788528606.664036:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735555840 00000100:00100000:2.0:1788528606.664043:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735555840 00000100:00100000:2.0:1788528606.664092:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788528606.664099:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:17134:x1875407735555840:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788528606.664191:0:17132:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788528606.664210:0:17132:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788528606.664214:0:17132:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1788528606.664305:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:17134:x1875407735555840:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 206us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528606.664312:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788528606.664358:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735555840:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788528606.664412:0:17134:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788528606.664420:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8f5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8f62 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528606.664428:0:17134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8f5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8f62 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528607.167716:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528608.192445:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528609.219845:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528609.471638:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788528609.471661:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735555968:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788528609.471726:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528609.471776:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735555968 00000100:00100000:0.0:1788528609.471783:0:18647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735555968 00000100:00100000:0.0:1788528609.471846:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788528609.471856:0:18647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735555968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788528609.471885:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528609.471925:0:18647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735555968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528609.471931:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788528609.471990:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735555968:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788528609.472175:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788528609.472307:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788528609.472318:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735556096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788528609.472351:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528609.472604:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735556096 00000100:00100000:3.0:1788528609.472609:0:18647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735556096 00000100:00100000:3.0:1788528609.472650:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788528609.472657:0:18647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735556096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788528609.472670:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788528609.472705:0:18647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735556096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528609.472711:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788528609.472771:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788528609.472812:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735556096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788528609.982928:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788528609.982950:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735556224:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788528609.983030:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528609.985633:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735556224 00000100:00100000:0.0:1788528609.985646:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735556224 00000100:00100000:0.0:1788528609.985703:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788528609.985713:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735556224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788528609.985748:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788528609.985833:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735556224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (2803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528609.985840:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788528609.986000:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735556224:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788528610.238690:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528610.496911:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735556352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788528610.496988:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528610.497093:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735556352 00000100:00100000:0.0:1788528610.497101:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735556352 00000100:00100000:0.0:1788528610.497150:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788528610.497160:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735556352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788528610.497191:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788528610.497244:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735556352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528610.497251:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788528610.497341:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735556352:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1788528610.505301:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788528610.505308:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788528610.505311:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a90de3f4000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788528610.505325:0:469:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a90de3f4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1788528610.505348:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90ffa67100 x1875407735556736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788528610.505378:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788528610.505381:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788528610.505384:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a90f58dd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788528610.505387:0:469:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a90f58dd000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1788528610.505396:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90ffa64380 x1875407735557120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788528610.505448:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:463b8984-c30b-4b73-b2f1-81113bd4e10a:3640:1875407735556480:0@lo:400:kworker.0 00000100:00100000:0.0:1788528610.505519:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528610.505572:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735557248:0@lo:400:kworker.0 00000100:00100000:0.0:1788528610.505613:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528610.505639:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735557760:0@lo:400:kworker.0 00000100:00100000:0.0:1788528610.505665:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528610.505687:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788528610.505692:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735556992:0@lo:400:kworker.0 00000100:00100000:0.0:1788528610.505715:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528610.505733:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1875407735557632:0@lo:400:kworker.0 00000100:00100000:0.0:1788528610.505754:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528610.505779:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735556608:0@lo:400:kworker.0 00000100:00100000:0.0:1788528610.505800:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528610.505816:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735557376:0@lo:400:kworker.0 00000100:00100000:0.0:1788528610.505834:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528610.505850:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788528610.505855:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735556864:0@lo:400:kworker.0 00000100:00100000:0.0:1788528610.505873:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528610.505882:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735557504:0@lo:400:kworker.0 00000100:00100000:0.0:1788528610.505898:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528610.505927:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735556736:0@lo:8:kworker.0 00000100:00100000:0.0:1788528610.505949:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528610.505978:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735557120:0@lo:8:kworker.0 00000100:00100000:0.0:1788528610.506000:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528610.506029:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735556480 00000100:00100000:0.0:1788528610.506044:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735556480 00000100:00100000:0.0:1788528610.506086:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788528610.506095:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ec9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:3640:x1875407735556480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528610.506142:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ec9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:3640:x1875407735556480:12345-0@lo:400:kworker.0 Request processed in 48us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528610.506149:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788528610.506179:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735557248 00000100:00100000:0.0:1788528610.506183:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735557248 00000100:00100000:0.0:1788528610.506201:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735557760 00000100:00100000:0.0:1788528610.506203:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735557760 00000100:00100000:0.0:1788528610.506225:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735557632 00000100:00100000:0.0:1788528610.506228:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735557632 00000100:00100000:0.0:1788528610.506242:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735557376 00000100:00100000:0.0:1788528610.506244:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735557376 00000100:00100000:0.0:1788528610.506254:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735556864 00000100:00100000:0.0:1788528610.506256:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735556864 00000100:00100000:0.0:1788528610.506265:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735557504 00000100:00100000:0.0:1788528610.506267:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735557504 00000100:00100000:0.0:1788528610.506279:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788528610.506285:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735557248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528610.506315:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735557248:12345-0@lo:400:kworker.0 Request processed in 31us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528610.506322:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788528610.506333:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788528610.506338:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735557760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528610.506381:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735557760:12345-0@lo:400:kworker.0 Request processed in 43us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528610.506388:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788528610.506398:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788528610.506409:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875407735557632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528610.506435:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875407735557632:12345-0@lo:400:kworker.0 Request processed in 27us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528610.506441:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788528610.506451:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788528610.506457:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735557376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528610.506483:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735557376:12345-0@lo:400:kworker.0 Request processed in 27us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528610.506488:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788528610.506499:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788528610.506504:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735556864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528610.506527:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735556864:12345-0@lo:400:kworker.0 Request processed in 24us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528610.506532:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788528610.506542:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788528610.506548:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735557504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528610.506597:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735557504:12345-0@lo:400:kworker.0 Request processed in 49us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528610.506603:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788528610.506620:0:19172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735556992 00000100:00100000:0.0:1788528610.506623:0:19172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735556992 00000100:00100000:0.0:1788528610.506640:0:19172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735556608 00000100:00100000:0.0:1788528610.506643:0:19172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735556608 00000100:00100000:0.0:1788528610.506652:0:19172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735556736 00000100:00100000:0.0:1788528610.506655:0:19172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735556736 00000100:00100000:0.0:1788528610.506661:0:19172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735557120 00000100:00100000:0.0:1788528610.506663:0:19172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735557120 00000100:00100000:0.0:1788528610.506682:0:19172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788528610.506687:0:19172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735556992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528610.506717:0:19172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735556992:12345-0@lo:400:kworker.0 Request processed in 30us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528610.506723:0:19172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788528610.506732:0:19172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788528610.506738:0:19172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735556608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528610.506761:0:19172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735556608:12345-0@lo:400:kworker.0 Request processed in 24us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528610.506767:0:19172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788528610.506776:0:19172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788528610.506780:0:19172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1875407735556736:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788528610.506806:0:19172:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:0.0:1788528610.506834:0:19172:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x892c60dda91c8f69 00002000:00100000:0.0:1788528610.506846:0:19172:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8a8fc3d19800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788528610.506850:0:19172:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788528610.506853:0:19172:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788528610.507036:0:19172:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788528610.507058:0:19172:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d1f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788528610.507097:0:19172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3636:x1875407735556736:12345-0@lo:8:kworker.0 Request processed in 315us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528610.507105:0:19172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788528610.507117:0:19172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788528610.507121:0:19172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1875407735557120:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788528610.507137:0:19172:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:0.0:1788528610.507159:0:19172:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x892c60dda91c8f70 00002000:00100000:0.0:1788528610.507164:0:19172:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8a8fc3d1c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788528610.507167:0:19172:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1788528610.507169:0:19172:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788528610.507191:0:19172:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1788528610.507203:0:19172:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d1d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788528610.507230:0:19172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3636:x1875407735557120:12345-0@lo:8:kworker.0 Request processed in 107us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528610.507235:0:19172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788528610.507267:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788528610.507270:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788528610.507345:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa67100 x1875407735556736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788528635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788528610.507360:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788528610.507368:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788528610.507374:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788528610.507376:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90de3f4000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788528610.507387:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788528610.507391:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735556736:0@lo:8:kworker.0 00010000:00080000:0.0:1788528610.507403:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa64380 x1875407735557120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788528635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788528610.507410:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788528610.507415:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788528610.507417:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788528610.507419:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90f58dd000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788528610.507437:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788528610.507448:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735557120:0@lo:8:kworker.0 00010000:00080000:0.0:1788528610.507487:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa65500 x1875407735556864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528610.507496:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735556864:0@lo:400:kworker.0 00010000:00080000:0.0:1788528610.507507:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa65180 x1875407735557504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528610.507572:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735557504:0@lo:400:kworker.0 00000100:00100000:0.0:1788528610.507585:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735556608:0@lo:400:kworker.0 00010000:00080000:0.0:1788528610.507594:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa66a00 x1875407735557376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528610.507601:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735557376:0@lo:400:kworker.0 00000100:00100000:0.0:1788528610.507662:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735556992:0@lo:400:kworker.0 00010000:00080000:0.0:1788528610.507673:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa66d80 x1875407735557632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528610.507679:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1875407735557632:0@lo:400:kworker.0 00000100:00100000:0.0:1788528610.507687:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:463b8984-c30b-4b73-b2f1-81113bd4e10a:3640:1875407735556480:0@lo:400:kworker.0 00010000:00080000:0.0:1788528610.507697:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa67b80 x1875407735557248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528610.507704:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735557248:0@lo:400:kworker.0 00010000:00080000:0.0:1788528610.507713:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa64000 x1875407735557760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528610.507732:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735557760:0@lo:400:kworker.0 00000004:00080000:1.0:1788528610.509847:0:17881:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788528610.509944:0:17881:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 479727389139ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788528610.509961:0:17881:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1788528610.512136:0:17164:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1788528610.512163:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17164:1875407735558016:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788528610.512233:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528610.512262:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d82ce600 going to sleep for 11 seconds 00000004:00080000:3.0:1788528610.512282:0:17163:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788528610.512363:0:17163:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 479729808022ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788528610.512369:0:17163:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788528610.512404:0:17882:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788528610.512418:0:17882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17882:1875407735558272:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788528610.512444:0:17882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528610.512462:0:17882:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d82ce3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528610.515356:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735557888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788528610.515428:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528610.515467:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788528610.515474:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735558144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788528610.515495:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528610.515541:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735557888 00000100:00100000:0.0:1788528610.515549:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735557888 00000100:00100000:0.0:1788528610.515623:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735558144 00000100:00100000:0.0:1788528610.515627:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735558144 00000100:00100000:0.0:1788528610.515643:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788528610.515651:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1875407735557888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788528610.515681:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788528610.515723:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1875407735557888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528610.515730:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788528610.515745:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788528610.515750:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3637:x1875407735558144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788528610.515759:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788528610.515782:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3637:x1875407735558144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528610.515787:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788528610.515804:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788528610.515832:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f58c3480 x1875407735558144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528626 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528610.515866:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735558144:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788528610.515880:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f58c1880 x1875407735557888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528626 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528610.515891:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735557888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788528610.515920:0:19172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735558016 00000100:00100000:0.0:1788528610.515923:0:19172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735558016 00000100:00100000:0.0:1788528610.515944:0:19172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735558272 00000100:00100000:0.0:1788528610.515947:0:19172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735558272 00000100:00100000:0.0:1788528610.515978:0:19172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788528610.515985:0:19172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17164:x1875407735558016:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788528610.516192:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788528610.516201:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17882:x1875407735558272:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1788528610.522584:0:17117:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788528610.523186:0:17870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:0.0:1788528610.525308:0:19172:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788528610.525318:0:19172:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788528610.525323:0:19172:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00080000:3.0:1788528610.531294:0:18643:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788528610.531302:0:18643:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788528610.531384:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17882:x1875407735558272:12345-0@lo:7:osp-pre-1-1.0 Request processed in 15181us (18935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528610.531400:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788528610.531458:0:17882:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f58c1c00 x1875407735558272/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788528626 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528610.531473:0:17882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17882:1875407735558272:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1788528610.531486:0:17882:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788528610.531524:0:17882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17882:1875407735558400:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788528610.531575:0:17882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528610.531596:0:17882:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d82ce3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528610.531623:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735558400 00000100:00100000:3.0:1788528610.531629:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735558400 00000100:00100000:3.0:1788528610.531773:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788528610.531783:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17882:x1875407735558400:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788528610.531814:0:18646:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1788528610.531843:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17882:x1875407735558400:12345-0@lo:5:osp-pre-1-1.0 Request processed in 62us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528610.531849:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788528610.531875:0:17882:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f58c1c00 x1875407735558400/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788528626 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528610.531885:0:17882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17882:1875407735558400:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788528610.531893:0:17882:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788528610.531915:0:17882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17882:1875407735558528:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788528610.531935:0:17882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528610.531949:0:17882:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d82ce3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528610.531970:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735558528 00000100:00100000:3.0:1788528610.531987:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735558528 00000100:00100000:3.0:1788528610.532009:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788528610.532015:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17882:x1875407735558528:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788528610.532037:0:18643:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:3.0:1788528610.541536:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528610.541548:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c3c1261/0x892c60dda91c8f77 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.541587:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1788528610.541591:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528610.541599:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c3c1261/0x892c60dda91c8f77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.541626:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c3c1261/0x892c60dda91c8f77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.541637:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c3c1261/0x892c60dda91c8f77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.541645:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c3c1261/0x892c60dda91c8f77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.541884:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788528610.542252:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528610.542259:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087836ad3/0x892c60dda91c8f7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.542283:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1788528610.542287:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528610.542292:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087836ad3/0x892c60dda91c8f7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.542302:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087836ad3/0x892c60dda91c8f7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.542311:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087836ad3/0x892c60dda91c8f7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.542319:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087836ad3/0x892c60dda91c8f7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.545258:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788528610.545272:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c3c1261/0x892c60dda91c8f77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.545285:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784e600 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528610.545290:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c3c1261/0x892c60dda91c8f77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.545302:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c3c1261/0x892c60dda91c8f77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.545340:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c3c1261/0x892c60dda91c8f77 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.545350:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c3c1261/0x892c60dda91c8f77 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.545380:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528610.545384:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087836ad3/0x892c60dda91c8f7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.545391:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784e200 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528610.545395:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087836ad3/0x892c60dda91c8f7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.545402:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087836ad3/0x892c60dda91c8f7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.545412:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087836ad3/0x892c60dda91c8f7e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.545420:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528610.545422:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528610.545424:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528610.556700:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788528610.556711:0:19172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087836ad3/0x892c60dda91c8f7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.556746:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788528610.559292:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528610.559305:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e63d4d/0x892c60dda91c8f85 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.559322:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1788528610.559327:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528610.559333:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029e63d4d/0x892c60dda91c8f85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.559359:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029e63d4d/0x892c60dda91c8f85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.559369:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e63d4d/0x892c60dda91c8f85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.559377:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029e63d4d/0x892c60dda91c8f85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.559394:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788528610.559405:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528610.559410:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029e63d4d/0x892c60dda91c8f85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.559418:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784fe00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528610.559422:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e63d4d/0x892c60dda91c8f85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.559432:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e63d4d/0x892c60dda91c8f85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.559447:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029e63d4d/0x892c60dda91c8f85 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.559456:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029e63d4d/0x892c60dda91c8f85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.559479:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528610.559481:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528610.559483:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788528610.563610:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528610.563625:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031dd0b67/0x892c60dda91c8f8c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.563643:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1788528610.563647:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528610.563655:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031dd0b67/0x892c60dda91c8f8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.563671:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031dd0b67/0x892c60dda91c8f8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.563681:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031dd0b67/0x892c60dda91c8f8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.563690:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031dd0b67/0x892c60dda91c8f8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.563713:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788528610.563722:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528610.563728:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031dd0b67/0x892c60dda91c8f8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.563745:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784fa00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528610.563750:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031dd0b67/0x892c60dda91c8f8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.563758:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031dd0b67/0x892c60dda91c8f8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.564035:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031dd0b67/0x892c60dda91c8f8c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.564044:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031dd0b67/0x892c60dda91c8f8c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.564066:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528610.564068:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528610.564070:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788528610.564220:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528610.564226:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005285a924/0x892c60dda91c8f93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.564246:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1788528610.564249:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528610.564254:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005285a924/0x892c60dda91c8f93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.564264:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005285a924/0x892c60dda91c8f93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.564273:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005285a924/0x892c60dda91c8f93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.564281:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005285a924/0x892c60dda91c8f93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.564299:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788528610.564575:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528610.564582:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc94ab8/0x892c60dda91c8f9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.564590:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1788528610.564594:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788528610.564603:0:19476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528610.564607:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc94ab8/0x892c60dda91c8f9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.564609:0:19476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005285a924/0x892c60dda91c8f93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.564617:0:19476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784f400 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528610.564618:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acc94ab8/0x892c60dda91c8f9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.564621:0:19476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005285a924/0x892c60dda91c8f93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.564629:0:19476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005285a924/0x892c60dda91c8f93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.564638:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc94ab8/0x892c60dda91c8f9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.564644:0:19476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005285a924/0x892c60dda91c8f93 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.564645:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acc94ab8/0x892c60dda91c8f9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.564660:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788528610.564661:0:19476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005285a924/0x892c60dda91c8f93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.564667:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528610.564671:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acc94ab8/0x892c60dda91c8f9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.564676:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528610.564678:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784fc00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528610.564678:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528610.564680:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528610.564682:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc94ab8/0x892c60dda91c8f9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.564690:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc94ab8/0x892c60dda91c8f9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.564700:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acc94ab8/0x892c60dda91c8f9a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.564707:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acc94ab8/0x892c60dda91c8f9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.564721:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528610.564727:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528610.564729:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788528610.568969:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528610.568981:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6f388fb/0x892c60dda91c8fa1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.568997:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1788528610.569001:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528610.569007:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6f388fb/0x892c60dda91c8fa1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.569020:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6f388fb/0x892c60dda91c8fa1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.569030:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6f388fb/0x892c60dda91c8fa1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.569038:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6f388fb/0x892c60dda91c8fa1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.569052:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788528610.569422:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528610.569428:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf7c5883/0x892c60dda91c8fa8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.569437:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1788528610.569440:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528610.569444:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf7c5883/0x892c60dda91c8fa8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.569458:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf7c5883/0x892c60dda91c8fa8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.569466:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf7c5883/0x892c60dda91c8fa8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.569472:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf7c5883/0x892c60dda91c8fa8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.569482:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788528610.570145:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788528610.570154:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6f388fb/0x892c60dda91c8fa1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.570163:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784f800 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528610.570167:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6f388fb/0x892c60dda91c8fa1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.570177:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6f388fb/0x892c60dda91c8fa1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.570199:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6f388fb/0x892c60dda91c8fa1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.570207:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6f388fb/0x892c60dda91c8fa1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.570223:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528610.570226:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf7c5883/0x892c60dda91c8fa8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.570232:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784e800 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528610.570235:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf7c5883/0x892c60dda91c8fa8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.570241:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf7c5883/0x892c60dda91c8fa8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.570249:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf7c5883/0x892c60dda91c8fa8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.570255:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf7c5883/0x892c60dda91c8fa8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.570265:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528610.570266:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528610.570271:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788528610.572413:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528610.572426:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087836ad3/0x892c60dda91c8faf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.572442:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1788528610.572447:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528610.572454:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087836ad3/0x892c60dda91c8faf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.572467:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087836ad3/0x892c60dda91c8faf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.572476:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087836ad3/0x892c60dda91c8faf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.572496:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087836ad3/0x892c60dda91c8faf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.572514:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788528610.572525:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528610.572531:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087836ad3/0x892c60dda91c8faf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.572539:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784e200 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528610.572543:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087836ad3/0x892c60dda91c8faf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.572572:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087836ad3/0x892c60dda91c8faf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.572588:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087836ad3/0x892c60dda91c8faf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.572596:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087836ad3/0x892c60dda91c8faf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.572681:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528610.572683:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528610.572685:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528610.573112:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788528610.573227:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528610.573241:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076b26676/0x892c60dda91c8fb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.573251:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1788528610.573254:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528610.573258:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076b26676/0x892c60dda91c8fb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.573268:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076b26676/0x892c60dda91c8fb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.573276:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076b26676/0x892c60dda91c8fb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.573284:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076b26676/0x892c60dda91c8fb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.573338:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788528610.574104:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528610.574112:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de53e17f/0x892c60dda91c8fbd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.574122:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1788528610.574126:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528610.574130:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de53e17f/0x892c60dda91c8fbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.574140:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de53e17f/0x892c60dda91c8fbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.574155:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de53e17f/0x892c60dda91c8fbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.574162:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de53e17f/0x892c60dda91c8fbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.578147:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788528610.578160:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076b26676/0x892c60dda91c8fb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.578173:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784f000 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528610.578177:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076b26676/0x892c60dda91c8fb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.578187:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076b26676/0x892c60dda91c8fb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.578208:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076b26676/0x892c60dda91c8fb6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.578215:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076b26676/0x892c60dda91c8fb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.578242:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528610.578246:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de53e17f/0x892c60dda91c8fbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.578260:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784ee00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528610.578263:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de53e17f/0x892c60dda91c8fbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.578271:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de53e17f/0x892c60dda91c8fbd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.578280:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de53e17f/0x892c60dda91c8fbd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.578288:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528610.578290:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528610.578292:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528610.578387:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788528610.578395:0:19172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de53e17f/0x892c60dda91c8fbd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.578417:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788528610.578796:0:19458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1788528610.578812:0:19458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788528610.578816:0:19458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788528610.578979:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17882:x1875407735558528:12345-0@lo:5:osp-pre-1-1.0 Request processed in 46960us (47038us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788528610.578989:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788528610.579036:0:17882:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788528610.579043:0:17882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17882:1875407735558528:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788528610.579059:0:17882:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788528610.579109:0:17882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa6a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17882:1875407735558656:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788528610.579144:0:17882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528610.579175:0:17882:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c83b20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528610.579196:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735558656 00000100:00100000:1.0:1788528610.579205:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735558656 00000100:00100000:1.0:1788528610.579250:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788528610.579259:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17882:x1875407735558656:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788528610.579305:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17882:x1875407735558656:12345-0@lo:900:osp-pre-1-1.0 Request processed in 48us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528610.579312:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788528610.579343:0:17882:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa6a300 x1875407735558656/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788528626 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528610.579353:0:17882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa6a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17882:1875407735558656:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1788528610.579818:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528610.579827:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc94ab8/0x892c60dda91c8fc4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.579841:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1788528610.579846:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528610.579853:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc94ab8/0x892c60dda91c8fc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.579864:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acc94ab8/0x892c60dda91c8fc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.579873:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc94ab8/0x892c60dda91c8fc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.579892:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acc94ab8/0x892c60dda91c8fc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.579948:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788528610.580267:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528610.580272:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e63d4d/0x892c60dda91c8fcb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.580283:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1788528610.580286:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528610.580291:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029e63d4d/0x892c60dda91c8fcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.580300:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029e63d4d/0x892c60dda91c8fcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.580308:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e63d4d/0x892c60dda91c8fcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.580316:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029e63d4d/0x892c60dda91c8fcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.584520:0:19476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788528610.584533:0:19476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acc94ab8/0x892c60dda91c8fc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.584546:0:19476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784fc00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528610.584564:0:19476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc94ab8/0x892c60dda91c8fc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.584576:0:19476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc94ab8/0x892c60dda91c8fc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.584596:0:19476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acc94ab8/0x892c60dda91c8fc4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.585091:0:19476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acc94ab8/0x892c60dda91c8fc4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.585139:0:19476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528610.585144:0:19476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029e63d4d/0x892c60dda91c8fcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.585150:0:19476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784fe00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528610.585153:0:19476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e63d4d/0x892c60dda91c8fcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.585161:0:19476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e63d4d/0x892c60dda91c8fcb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.585172:0:19476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029e63d4d/0x892c60dda91c8fcb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.585190:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528610.585192:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528610.585194:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528610.585335:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788528610.585343:0:19172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029e63d4d/0x892c60dda91c8fcb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.585876:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788528610.586012:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528610.586019:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000122a572b/0x892c60dda91c8fd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.586032:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1788528610.586036:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528610.586042:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000122a572b/0x892c60dda91c8fd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.586055:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000122a572b/0x892c60dda91c8fd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.586064:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000122a572b/0x892c60dda91c8fd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.586080:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000122a572b/0x892c60dda91c8fd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.586103:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788528610.586245:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528610.586251:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000122a572b/0x892c60dda91c8fd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.586259:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784e400 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528610.586262:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000122a572b/0x892c60dda91c8fd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.586271:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000122a572b/0x892c60dda91c8fd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.586283:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000122a572b/0x892c60dda91c8fd2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.586291:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000122a572b/0x892c60dda91c8fd2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.586307:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528610.586309:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528610.586310:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788528610.586405:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528610.586411:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005285a924/0x892c60dda91c8fd9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.586420:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1788528610.586423:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528610.586434:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005285a924/0x892c60dda91c8fd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.586443:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005285a924/0x892c60dda91c8fd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.586450:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005285a924/0x892c60dda91c8fd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.586457:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005285a924/0x892c60dda91c8fd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.586477:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788528610.586799:0:19476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528610.586804:0:19476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005285a924/0x892c60dda91c8fd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.586812:0:19476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784f400 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528610.586815:0:19476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005285a924/0x892c60dda91c8fd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.586846:0:19476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005285a924/0x892c60dda91c8fd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.586858:0:19476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005285a924/0x892c60dda91c8fd9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.586865:0:19476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005285a924/0x892c60dda91c8fd9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.586972:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528610.586975:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528610.586977:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788528610.587160:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528610.587167:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c3c1261/0x892c60dda91c8fe0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.587176:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1788528610.587191:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528610.587197:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c3c1261/0x892c60dda91c8fe0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.587206:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c3c1261/0x892c60dda91c8fe0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.587214:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c3c1261/0x892c60dda91c8fe0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.587233:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c3c1261/0x892c60dda91c8fe0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.587254:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788528610.587589:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528610.587595:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c3c1261/0x892c60dda91c8fe0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.587615:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784e600 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528610.587619:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c3c1261/0x892c60dda91c8fe0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.587628:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c3c1261/0x892c60dda91c8fe0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.587641:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c3c1261/0x892c60dda91c8fe0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.587648:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c3c1261/0x892c60dda91c8fe0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.587677:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528610.587679:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528610.587681:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788528610.587880:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528610.587886:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf7c5883/0x892c60dda91c8fe7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.587895:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1788528610.587898:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528610.587903:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf7c5883/0x892c60dda91c8fe7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.587912:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf7c5883/0x892c60dda91c8fe7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.587920:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf7c5883/0x892c60dda91c8fe7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.587926:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf7c5883/0x892c60dda91c8fe7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.587941:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788528610.588467:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528610.588474:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6f388fb/0x892c60dda91c8fee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.588489:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1788528610.588492:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528610.588497:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6f388fb/0x892c60dda91c8fee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.588506:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6f388fb/0x892c60dda91c8fee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.588514:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6f388fb/0x892c60dda91c8fee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.588521:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6f388fb/0x892c60dda91c8fee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.588546:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788528610.588878:0:19476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788528610.588884:0:19476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf7c5883/0x892c60dda91c8fe7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.588892:0:19476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784e800 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528610.588895:0:19476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf7c5883/0x892c60dda91c8fe7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.588903:0:19476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf7c5883/0x892c60dda91c8fe7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.588916:0:19476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf7c5883/0x892c60dda91c8fe7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.588923:0:19476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf7c5883/0x892c60dda91c8fe7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.588939:0:19476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528610.588941:0:19476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6f388fb/0x892c60dda91c8fee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.588947:0:19476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784f800 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528610.588966:0:19476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6f388fb/0x892c60dda91c8fee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.588973:0:19476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6f388fb/0x892c60dda91c8fee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.588982:0:19476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6f388fb/0x892c60dda91c8fee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.588989:0:19476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6f388fb/0x892c60dda91c8fee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.589001:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528610.589003:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528610.589005:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788528610.589218:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528610.589224:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031dd0b67/0x892c60dda91c8ff5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.589232:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1788528610.589235:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528610.589239:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031dd0b67/0x892c60dda91c8ff5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.589248:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031dd0b67/0x892c60dda91c8ff5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.589266:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031dd0b67/0x892c60dda91c8ff5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.589272:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031dd0b67/0x892c60dda91c8ff5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.589287:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788528610.589580:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528610.589585:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076b26676/0x892c60dda91c8ffc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.589594:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1788528610.589597:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528610.589612:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076b26676/0x892c60dda91c8ffc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.589622:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076b26676/0x892c60dda91c8ffc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.589631:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076b26676/0x892c60dda91c8ffc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.589638:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076b26676/0x892c60dda91c8ffc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.589659:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788528610.589982:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528610.589987:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ddab49b/0x892c60dda91c9003 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.589994:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1788528610.589997:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528610.590000:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ddab49b/0x892c60dda91c9003 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.590008:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ddab49b/0x892c60dda91c9003 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.590016:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ddab49b/0x892c60dda91c9003 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.590023:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ddab49b/0x892c60dda91c9003 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.590032:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788528610.590313:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528610.590319:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069e4eb91/0x892c60dda91c900a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.590326:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1788528610.590337:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528610.590341:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069e4eb91/0x892c60dda91c900a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.590349:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069e4eb91/0x892c60dda91c900a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.590358:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069e4eb91/0x892c60dda91c900a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.590365:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069e4eb91/0x892c60dda91c900a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.590375:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788528610.590669:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528610.590675:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd488e82/0x892c60dda91c9011 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.590683:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1788528610.590686:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528610.590691:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd488e82/0x892c60dda91c9011 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.590700:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd488e82/0x892c60dda91c9011 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.590709:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd488e82/0x892c60dda91c9011 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.590725:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd488e82/0x892c60dda91c9011 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528610.590734:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1788528610.591041:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788528610.591048:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031dd0b67/0x892c60dda91c8ff5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591057:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784fa00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528610.591062:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031dd0b67/0x892c60dda91c8ff5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591082:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031dd0b67/0x892c60dda91c8ff5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591097:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031dd0b67/0x892c60dda91c8ff5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591110:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031dd0b67/0x892c60dda91c8ff5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591131:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788528610.591134:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076b26676/0x892c60dda91c8ffc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591142:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784f000 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528610.591145:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076b26676/0x892c60dda91c8ffc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591153:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076b26676/0x892c60dda91c8ffc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591164:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076b26676/0x892c60dda91c8ffc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591171:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076b26676/0x892c60dda91c8ffc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591183:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788528610.591186:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ddab49b/0x892c60dda91c9003 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591192:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428600 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528610.591200:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ddab49b/0x892c60dda91c9003 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591208:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ddab49b/0x892c60dda91c9003 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591218:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ddab49b/0x892c60dda91c9003 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591226:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ddab49b/0x892c60dda91c9003 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591238:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788528610.591241:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069e4eb91/0x892c60dda91c900a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591248:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428e00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528610.591252:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069e4eb91/0x892c60dda91c900a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591259:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069e4eb91/0x892c60dda91c900a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591268:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069e4eb91/0x892c60dda91c900a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591275:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069e4eb91/0x892c60dda91c900a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591293:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528610.591296:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd488e82/0x892c60dda91c9011 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591303:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428200 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528610.591307:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd488e82/0x892c60dda91c9011 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591315:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd488e82/0x892c60dda91c9011 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591325:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd488e82/0x892c60dda91c9011 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591333:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd488e82/0x892c60dda91c9011 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591345:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528610.591346:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528610.591348:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528610.591355:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788528610.591620:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788528610.591626:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080b189d9/0x892c60dda91c9018 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591636:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788528610.591645:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788528610.591650:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080b189d9/0x892c60dda91c9018 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591660:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080b189d9/0x892c60dda91c9018 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591669:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080b189d9/0x892c60dda91c9018 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591676:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080b189d9/0x892c60dda91c9018 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.591692:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788528610.591979:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528610.591984:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528610.591985:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080b189d9/0x892c60dda91c9018 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.592005:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c14aba00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528610.592009:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080b189d9/0x892c60dda91c9018 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.592017:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080b189d9/0x892c60dda91c9018 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.592028:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080b189d9/0x892c60dda91c9018 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.592035:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080b189d9/0x892c60dda91c9018 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.592050:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528610.592052:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528610.592054:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788528610.592068:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788528610.592082:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003c263a9/0x892c60dda91c901f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.592090:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788528610.592093:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788528610.592097:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003c263a9/0x892c60dda91c901f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.592106:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003c263a9/0x892c60dda91c901f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.592113:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003c263a9/0x892c60dda91c901f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.592125:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003c263a9/0x892c60dda91c901f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.592145:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788528610.592419:0:19476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528610.592425:0:19476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003c263a9/0x892c60dda91c901f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788528610.592426:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788528610.592431:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081538938/0x892c60dda91c9026 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.592433:0:19476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c14aa000 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528610.592437:0:19476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003c263a9/0x892c60dda91c901f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.592440:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788528610.592443:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788528610.592445:0:19476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003c263a9/0x892c60dda91c901f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.592447:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081538938/0x892c60dda91c9026 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.592456:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081538938/0x892c60dda91c9026 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.592461:0:19476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003c263a9/0x892c60dda91c901f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.592463:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081538938/0x892c60dda91c9026 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.592469:0:19476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003c263a9/0x892c60dda91c901f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.592472:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081538938/0x892c60dda91c9026 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.592483:0:19476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528610.592486:0:19476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081538938/0x892c60dda91c9026 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.592491:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788528610.592492:0:19476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c14ab000 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528610.592495:0:19476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081538938/0x892c60dda91c9026 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.592502:0:19476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081538938/0x892c60dda91c9026 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.592511:0:19476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081538938/0x892c60dda91c9026 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.592518:0:19476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081538938/0x892c60dda91c9026 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.592530:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528610.592531:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528610.592537:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528610.592823:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788528610.592887:0:19172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788528610.592892:0:19172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cadbf8d/0x892c60dda91c902d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.592905:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788528610.592908:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788528610.592912:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cadbf8d/0x892c60dda91c902d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.592920:0:19172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cadbf8d/0x892c60dda91c902d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.592929:0:19172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cadbf8d/0x892c60dda91c902d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.592936:0:19172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cadbf8d/0x892c60dda91c902d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528610.592966:0:19172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788528610.592980:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528610.592984:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cadbf8d/0x892c60dda91c902d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.592992:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c14abe00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528610.592995:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cadbf8d/0x892c60dda91c902d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788528610.592998:0:19172:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00010000:00010000:0.0:1788528610.593002:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cadbf8d/0x892c60dda91c902d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.593012:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cadbf8d/0x892c60dda91c902d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.593018:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cadbf8d/0x892c60dda91c902d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528610.593030:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528610.593031:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528610.593033:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528610.593168:0:19172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17164:x1875407735558016:12345-0@lo:5:osp-pre-1-0.0 Request processed in 77178us (80930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528610.593178:0:19172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788528610.593416:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17164:1875407735558016:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788528610.593431:0:17164:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1788528610.593475:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17164:1875407735558784:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788528610.593509:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528610.593541:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c82bdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788528610.593595:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735558784 00000100:00100000:0.0:1788528610.593602:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735558784 00000100:00100000:0.0:1788528610.593646:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788528610.593654:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17164:x1875407735558784:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788528610.593687:0:18644:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:1.0:1788528610.604186:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17164:x1875407735558784:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10524us (10668us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788528610.604200:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788528610.604434:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17164:1875407735558784:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788528610.604460:0:17164:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:3.0:1788528611.264589:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788528611.719135:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1788528611.769439:0:19816:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788528612.287788:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788528612.837723:0:19868:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788528612.838123:0:19868:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788528613.312315:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788528614.084961:0:19918:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788528614.085938:0:19918:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788528614.339888:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528614.445300:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528614.445455:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719746176 00000100:00100000:0.0:1788528614.445465:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719746176 00000100:00100000:2.0:1788528614.445616:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 121 00000100:00100000:2.0:1788528614.445625:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2402:x1875407719746176:12345-192.168.203.38@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788528614.445658:0:17130:0:(ldlm_lib.c:1458:target_handle_connect()) MGS: connection from 1823b577-e6d1-43c4-8232-3cf51fabc1da@192.168.203.38@tcp t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:2.0:1788528614.445695:0:17130:0:(genops.c:1385:class_connect()) connect: client 1823b577-e6d1-43c4-8232-3cf51fabc1da, cookie 0x892c60dda91c9034 00000100:00080000:2.0:1788528614.445838:0:17130:0:(import.c:65:import_set_state_nolock()) ffff8a8fc25ae800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788528614.445973:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+5:2402:x1875407719746176:12345-192.168.203.38@tcp:250:mount.lustre.0 Request processed in 346us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528614.445994:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 121 00000100:00100000:2.0:1788528614.481763:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528614.481870:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719746304 00000100:00100000:3.0:1788528614.481882:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719746304 00000100:00100000:3.0:1788528614.481963:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 122 00000100:00100000:3.0:1788528614.481973:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+5:14899:x1875407719746304:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788528614.481990:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528614.482008:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc3428200/0x892c60dda91c903b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c006c expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528614.482040:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc3428200/0x892c60dda91c903b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c006c expref: 6 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528614.482083:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc3428200/0x892c60dda91c903b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c006c expref: 6 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528614.482092:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3428200, rc 0) 00000100:00100000:3.0:1788528614.482163:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+6:14899:x1875407719746304:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 191us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528614.482170:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 122 00000100:00100000:2.0:1788528614.487751:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528614.487862:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719746432 00000100:00100000:0.0:1788528614.487872:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719746432 00000100:00100000:0.0:1788528614.487937:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 123 00000100:00100000:0.0:1788528614.487948:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1823b577-e6d1-43c4-8232-3cf51fabc1da+6:14899:x1875407719746432:12345-192.168.203.38@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788528614.488083:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1823b577-e6d1-43c4-8232-3cf51fabc1da+6:14899:x1875407719746432:12345-192.168.203.38@tcp:501:mount.lustre.0 Request processed in 136us (339us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788528614.488092:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 123 00000100:00100000:0.0:1788528614.492121:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528614.492306:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719746560 00000100:00100000:2.0:1788528614.492318:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719746560 00000100:00100000:2.0:1788528614.492375:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 124 00000100:00100000:2.0:1788528614.492384:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+6:14899:x1875407719746560:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788528614.492401:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528614.492420:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c13fc400/0x892c60dda91c9042 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0073 expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528614.492448:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c13fc400/0x892c60dda91c9042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0073 expref: 7 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528614.492459:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c13fc400/0x892c60dda91c9042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0073 expref: 7 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528614.492469:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c13fc400, rc 0) 00000100:00100000:2.0:1788528614.492539:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+7:14899:x1875407719746560:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 156us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528614.492546:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 124 00000100:00100000:2.0:1788528614.499730:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528614.499827:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719746688 00000100:00100000:3.0:1788528614.499836:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719746688 00000100:00100000:3.0:1788528614.499893:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 125 00000100:00100000:3.0:1788528614.499904:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+7:14899:x1875407719746688:12345-192.168.203.38@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788528614.500305:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+8:14899:x1875407719746688:12345-192.168.203.38@tcp:501:mount.lustre.0 Request processed in 400us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528614.500313:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 125 00000100:00100000:3.0:1788528614.521679:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528614.521990:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719746816 00000100:00100000:0.0:1788528614.522001:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719746816 00000100:00100000:0.0:1788528614.522062:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 126 00000100:00100000:0.0:1788528614.522073:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1823b577-e6d1-43c4-8232-3cf51fabc1da+8:14899:x1875407719746816:12345-192.168.203.38@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788528614.522238:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1823b577-e6d1-43c4-8232-3cf51fabc1da+8:14899:x1875407719746816:12345-192.168.203.38@tcp:503:mount.lustre.0 Request processed in 166us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528614.522246:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 126 00000100:00100000:3.0:1788528614.526348:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528614.526497:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719746944 00000100:00100000:2.0:1788528614.526516:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719746944 00000100:00100000:2.0:1788528614.526607:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 127 00000100:00100000:2.0:1788528614.526617:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+8:14918:x1875407719746944:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788528614.526777:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+8:14918:x1875407719746944:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 161us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528614.527376:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 127 00000100:00100000:1.0:1788528614.570676:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528614.573967:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719747072 00000100:00100000:2.0:1788528614.573983:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719747072 00000100:00100000:2.0:1788528614.574066:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 128 00000100:00100000:2.0:1788528614.574077:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+8:14918:x1875407719747072:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788528614.574421:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+8:14918:x1875407719747072:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 345us (3752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528614.574429:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 128 00000100:00100000:3.0:1788528614.579735:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528614.580066:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719747200 00000100:00100000:2.0:1788528614.580077:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719747200 00000100:00100000:2.0:1788528614.580145:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 129 00000100:00100000:2.0:1788528614.580155:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+8:14918:x1875407719747200:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788528614.580312:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+8:14918:x1875407719747200:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 158us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528614.580319:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 129 00000100:00100000:3.0:1788528614.584473:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528614.584692:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719747328 00000100:00100000:2.0:1788528614.584702:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719747328 00000100:00100000:2.0:1788528614.584763:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 130 00000100:00100000:2.0:1788528614.584774:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+8:14899:x1875407719747328:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788528614.584804:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528614.584822:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c13fde00/0x892c60dda91c9049 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c00a4 expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528614.584872:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c13fde00/0x892c60dda91c9049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c00a4 expref: 9 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528614.584884:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c13fde00/0x892c60dda91c9049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c00a4 expref: 9 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528614.584893:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c13fde00, rc 0) 00000100:00100000:2.0:1788528614.585018:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+9:14899:x1875407719747328:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 246us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528614.585026:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 130 00000100:00100000:1.0:1788528614.590085:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528614.590933:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719747456 00000100:00100000:0.0:1788528614.590945:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719747456 00000100:00100000:0.0:1788528614.591010:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 131 00000100:00100000:0.0:1788528614.591020:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1823b577-e6d1-43c4-8232-3cf51fabc1da+9:14899:x1875407719747456:12345-192.168.203.38@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788528614.591044:0:17131:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788528614.591082:0:17131:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788528614.591086:0:17131:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788528614.591090:0:17131:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788528614.591092:0:17131:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788528614.591095:0:17131:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1788528614.596310:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735558912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788528614.596373:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528614.596581:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788528614.596590:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735559040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788528614.596617:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528614.596755:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735558912 00000100:00100000:2.0:1788528614.596763:0:18647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735558912 00000100:00100000:2.0:1788528614.596822:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735559040 00000100:00100000:2.0:1788528614.596826:0:18647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735559040 00000100:00100000:2.0:1788528614.596845:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788528614.596854:0:18647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735558912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788528614.596882:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528614.596942:0:18647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735558912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528614.596950:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788528614.596967:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788528614.596974:0:18647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735559040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788528614.596984:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528614.597007:0:18647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735559040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528614.597013:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788528614.597076:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735559040:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788528614.597090:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735558912:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788528614.597344:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788528614.600026:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1823b577-e6d1-43c4-8232-3cf51fabc1da+9:14899:x1875407719747456:12345-192.168.203.38@tcp:256:mount.lustre.0 Request processed in 8997us (9940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528614.600041:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 131 00000100:00100000:1.0:1788528614.604460:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528614.604671:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719747584 00000100:00100000:3.0:1788528614.604681:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719747584 00000100:00100000:3.0:1788528614.604750:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 132 00000100:00100000:3.0:1788528614.604761:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+9:14899:x1875407719747584:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788528614.604788:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528614.604811:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc3428e00/0x892c60dda91c9050 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c00ab expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528614.604858:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc3428e00/0x892c60dda91c9050 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c00ab expref: 10 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528614.604870:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc3428e00/0x892c60dda91c9050 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c00ab expref: 10 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528614.604879:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3428e00, rc 0) 00000100:00100000:3.0:1788528614.604950:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+10:14899:x1875407719747584:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 191us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528614.604958:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 132 00000100:00100000:1.0:1788528614.607023:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528614.607212:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719747712 00000100:00100000:2.0:1788528614.607221:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719747712 00000100:00100000:2.0:1788528614.607275:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 133 00000100:00100000:2.0:1788528614.607285:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1823b577-e6d1-43c4-8232-3cf51fabc1da+10:14899:x1875407719747712:12345-192.168.203.38@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788528614.607436:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1823b577-e6d1-43c4-8232-3cf51fabc1da+10:14899:x1875407719747712:12345-192.168.203.38@tcp:501:mount.lustre.0 Request processed in 151us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528614.607444:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 133 00000100:00100000:0.0:1788528614.613902:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528614.614235:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719747840 00000100:00100000:2.0:1788528614.614247:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719747840 00000100:00100000:2.0:1788528614.614306:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 134 00000100:00100000:2.0:1788528614.614316:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+10:14899:x1875407719747840:12345-192.168.203.38@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788528614.614714:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+10:14899:x1875407719747840:12345-192.168.203.38@tcp:503:mount.lustre.0 Request processed in 398us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528614.614723:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 134 00000100:00100000:1.0:1788528614.636442:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528614.636606:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719747968 00000100:00100000:3.0:1788528614.636618:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719747968 00000100:00100000:3.0:1788528614.636676:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 135 00000100:00100000:3.0:1788528614.636688:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+10:14923:x1875407719747968:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788528614.636847:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+10:14923:x1875407719747968:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 161us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528614.636855:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 135 00000100:00100000:1.0:1788528614.651987:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528614.652093:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719748096 00000100:00100000:2.0:1788528614.652103:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719748096 00000100:00100000:2.0:1788528614.652171:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 136 00000100:00100000:2.0:1788528614.652182:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+10:14923:x1875407719748096:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788528614.652335:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+10:14923:x1875407719748096:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 154us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528614.652351:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 136 00000100:00100000:1.0:1788528614.676094:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528614.677373:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528614.680667:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719748224 00000100:00100000:0.0:1788528614.680684:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719748224 00000100:00100000:0.0:1788528614.680752:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719748480 00000100:00100000:0.0:1788528614.680757:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719748480 00000100:00100000:0.0:1788528614.680802:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:0.0:1788528614.680810:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2402:x1875407719748224:12345-192.168.203.38@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788528614.680839:0:19473:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from bd1383c0-cb68-4d87-bd29-af707cf13abe@192.168.203.38@tcp t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:0.0:1788528614.680891:0:19473:0:(genops.c:1385:class_connect()) connect: client bd1383c0-cb68-4d87-bd29-af707cf13abe, cookie 0x892c60dda91c9057 00000004:00100000:0.0:1788528614.680915:0:19473:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788528614.681675:0:19473:0:(import.c:65:import_set_state_nolock()) ffff8a90f5a91000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788528614.681743:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+6:2402:x1875407719748224:12345-192.168.203.38@tcp:38:mount.lustre.0 Request processed in 930us (5657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528614.681752:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:0.0:1788528614.681776:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:0.0:1788528614.682298:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4675f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2402:x1875407719748480:12345-192.168.203.38@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788528614.682325:0:19473:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from bd1383c0-cb68-4d87-bd29-af707cf13abe@192.168.203.38@tcp t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:0.0:1788528614.682365:0:19473:0:(genops.c:1385:class_connect()) connect: client bd1383c0-cb68-4d87-bd29-af707cf13abe, cookie 0x892c60dda91c905e 00000004:00100000:0.0:1788528614.682384:0:19473:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788528614.683681:0:19473:0:(import.c:65:import_set_state_nolock()) ffff8a90f5a92800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788528614.683764:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4675f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+6:2402:x1875407719748480:12345-192.168.203.38@tcp:38:mount.lustre.0 Request processed in 1977us (6392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528614.684413:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:1.0:1788528614.685524:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528614.685579:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528614.685713:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719748352 00000100:00100000:0.0:1788528614.685721:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719748352 00000100:00100000:0.0:1788528614.685782:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719748736 00000100:00100000:0.0:1788528614.685785:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719748736 00000100:00100000:0.0:1788528614.685837:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:0.0:1788528614.685847:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+7:0:x1875407719748352:12345-192.168.203.38@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788528614.685883:0:17139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788528614.685969:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+7:0:x1875407719748352:12345-192.168.203.38@tcp:41:mount.lustre.0 Request processed in 122us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528614.685976:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:0.0:1788528614.685993:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:0.0:1788528614.685999:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4675880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+6:14899:x1875407719748736:12345-192.168.203.38@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788528614.686009:0:17139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788528614.686030:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4675880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+6:14899:x1875407719748736:12345-192.168.203.38@tcp:41:mount.lustre.0 Request processed in 31us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528614.686037:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00080000:1.0:1788528614.686900:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788528614.687853:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528614.687888:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528614.687973:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719748608 00000100:00100000:0.0:1788528614.687983:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719748608 00000100:00100000:0.0:1788528614.688035:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719748864 00000100:00100000:0.0:1788528614.688038:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719748864 00000100:00100000:0.0:1788528614.688068:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:0.0:1788528614.688077:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+6:0:x1875407719748608:12345-192.168.203.38@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788528614.688211:0:17139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788528614.688280:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+6:0:x1875407719748608:12345-192.168.203.38@tcp:41:mount.lustre.0 Request processed in 204us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528614.688300:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:0.0:1788528614.688316:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:0.0:1788528614.688322:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+6:14899:x1875407719748864:12345-192.168.203.38@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788528614.688349:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+6:14899:x1875407719748864:12345-192.168.203.38@tcp:40:mount.lustre.0 Request processed in 28us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528614.688355:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00080000:1.0:1788528614.688410:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788528614.689832:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528614.689866:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528614.689899:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528614.690077:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719748992 00000100:00100000:2.0:1788528614.690085:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719748992 00000100:00100000:2.0:1788528614.690127:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719749120 00000100:00100000:2.0:1788528614.690131:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719749120 00000100:00100000:2.0:1788528614.690146:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:2.0:1788528614.690153:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2402:x1875407719748992:12345-192.168.203.38@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788528614.690180:0:18643:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from bd1383c0-cb68-4d87-bd29-af707cf13abe@192.168.203.38@tcp t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:2.0:1788528614.690209:0:18643:0:(genops.c:1385:class_connect()) connect: client bd1383c0-cb68-4d87-bd29-af707cf13abe, cookie 0x892c60dda91c9065 00002000:00100000:2.0:1788528614.690220:0:18643:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bd1383c0-cb68-4d87-bd29-af707cf13abe/ffff8a8fc25ab800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788528614.690230:0:18643:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788528614.690401:0:18643:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788528614.690427:0:18643:0:(import.c:65:import_set_state_nolock()) ffff8a8fc25a9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788528614.690500:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+6:2402:x1875407719748992:12345-192.168.203.38@tcp:8:mount.lustre.0 Request processed in 345us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528614.690520:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:2.0:1788528614.690539:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:2.0:1788528614.690543:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2402:x1875407719749120:12345-192.168.203.38@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788528614.690590:0:18643:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from bd1383c0-cb68-4d87-bd29-af707cf13abe@192.168.203.38@tcp t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:2.0:1788528614.690607:0:18643:0:(genops.c:1385:class_connect()) connect: client bd1383c0-cb68-4d87-bd29-af707cf13abe, cookie 0x892c60dda91c906c 00002000:00100000:2.0:1788528614.690613:0:18643:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bd1383c0-cb68-4d87-bd29-af707cf13abe/ffff8a8fc25a9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788528614.690625:0:18643:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788528614.690747:0:18643:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788528614.690768:0:18643:0:(import.c:65:import_set_state_nolock()) ffff8a8fc25af000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788528614.690795:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+6:2402:x1875407719749120:12345-192.168.203.38@tcp:8:mount.lustre.0 Request processed in 250us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528614.690802:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:1.0:1788528614.691263:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719749248 00000100:00100000:1.0:1788528614.691270:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719749248 00000100:00100000:1.0:1788528614.691319:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:1.0:1788528614.691327:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bd1383c0-cb68-4d87-bd29-af707cf13abe+6:14899:x1875407719749248:12345-192.168.203.38@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788528614.691369:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bd1383c0-cb68-4d87-bd29-af707cf13abe+6:14899:x1875407719749248:12345-192.168.203.38@tcp:900:mount.lustre.0 Request processed in 43us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528614.691376:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:1.0:1788528614.692775:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528614.692892:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719749376 00000100:00100000:0.0:1788528614.692901:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719749376 00000100:00100000:0.0:1788528614.692954:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:0.0:1788528614.692964:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+6:14899:x1875407719749376:12345-192.168.203.38@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788528614.695214:0:17140:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2170us 00000004:00200000:0.0:1788528614.718174:0:17140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788528614.718293:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+6:14899:x1875407719749376:12345-192.168.203.38@tcp:33:mount.lustre.0 Request processed in 25324us (25517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528614.718304:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:1.0:1788528614.984789:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528614.984948:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719749504 00000100:00100000:0.0:1788528614.984958:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719749504 00000100:00100000:0.0:1788528614.985024:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:0.0:1788528614.985034:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+6:14946:x1875407719749504:12345-192.168.203.38@tcp:101:mkdir.0 00010000:00010000:0.0:1788528614.985054:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528614.985081:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c9073 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c00dc expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528614.985149:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c907a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528614.985180:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c907a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528614.985195:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c907a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788528614.985246:0:17139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788528614.985249:0:17139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788528614.985298:0:17139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c907a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528614.985326:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031200/0x892c60dda91c9073 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c00dc expref: 8 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528614.985343:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c907a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c00dc expref: 7 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528614.985351:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c87bee00) 00010000:00010000:0.0:1788528614.985355:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788528614.985358:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031a00, rc 0) 00000100:00100000:0.0:1788528614.985418:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+7:14946:x1875407719749504:12345-192.168.203.38@tcp:101:mkdir.0 Request processed in 386us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528614.985427:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:2.0:1788528615.102913:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788528615.102948:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735559168:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528615.103022:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528615.103506:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735559168 00000100:00100000:3.0:1788528615.103517:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735559168 00000100:00100000:3.0:1788528615.103593:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788528615.103604:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735559168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788528615.103654:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788528615.103713:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735559168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528615.103720:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788528615.103809:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735559168:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788528615.358869:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528615.614960:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788528615.614992:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735559296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788528615.615059:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528615.615310:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735559296 00000100:00100000:2.0:1788528615.615319:0:18647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735559296 00000100:00100000:2.0:1788528615.615388:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788528615.615399:0:18647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1875407735559296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788528615.615420:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788528615.615462:0:18647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1875407735559296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528615.615469:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788528615.615610:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:463b8984-c30b-4b73-b2f1-81113bd4e10a:3639:1875407735559424:0@lo:400:kworker.0 00000100:00100000:2.0:1788528615.615657:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528615.615681:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735559936:0@lo:400:kworker.0 00000100:00100000:2.0:1788528615.615704:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528615.615720:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735560448:0@lo:400:kworker.0 00000100:00100000:2.0:1788528615.615743:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528615.615759:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788528615.615763:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4473480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735559552:0@lo:400:kworker.0 00000100:00100000:2.0:1788528615.615781:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528615.615808:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735560064:0@lo:400:kworker.0 00000100:00100000:2.0:1788528615.615830:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528615.615843:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1875407735560576:0@lo:400:kworker.0 00000100:00100000:2.0:1788528615.615859:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528615.615878:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735559936 00000100:00100000:2.0:1788528615.615881:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735559936 00000100:00100000:2.0:1788528615.615909:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735560064 00000100:00100000:2.0:1788528615.615912:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735560064 00000100:00100000:2.0:1788528615.616042:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788528615.616049:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4472680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735559936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528615.616089:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4472680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735559936:12345-0@lo:400:kworker.0 Request processed in 42us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528615.616095:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788528615.616108:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788528615.616114:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735560064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528615.616408:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735560064:12345-0@lo:400:kworker.0 Request processed in 294us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528615.616415:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788528615.616434:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735560448 00000100:00100000:2.0:1788528615.616438:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735560448 00000100:00100000:2.0:1788528615.616466:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735560576 00000100:00100000:2.0:1788528615.616469:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735560576 00000100:00100000:2.0:1788528615.616486:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788528615.616493:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735560448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528615.616523:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735560448:12345-0@lo:400:kworker.0 Request processed in 31us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528615.616529:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788528615.616572:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788528615.616580:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4470700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875407735560576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528615.616610:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4470700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875407735560576:12345-0@lo:400:kworker.0 Request processed in 31us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528615.616616:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1788528615.616639:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788528615.616642:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788528615.616645:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788528615.616671:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735559808:0@lo:400:kworker.0 00000100:00100000:2.0:1788528615.616697:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528615.616715:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735560320:0@lo:400:kworker.0 00000100:00100000:2.0:1788528615.616737:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528615.616754:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788528615.616759:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4471180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735559680:0@lo:400:kworker.0 00000100:00100000:2.0:1788528615.616786:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528615.616803:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875407735560192:0@lo:400:kworker.0 00000100:00100000:2.0:1788528615.616822:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528615.616833:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1875407735560704:0@lo:400:kworker.0 00000100:00100000:2.0:1788528615.616854:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528615.616872:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735559808 00000100:00100000:2.0:1788528615.617327:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735559808 00000100:00100000:2.0:1788528615.617357:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735560320 00000100:00100000:2.0:1788528615.617359:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735560320 00000100:00100000:2.0:1788528615.617712:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735560192 00000100:00100000:2.0:1788528615.617717:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735560192 00000100:00100000:2.0:1788528615.617729:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735560704 00000100:00100000:2.0:1788528615.617731:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735560704 00000100:00100000:2.0:1788528615.617749:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788528615.617767:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735559808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528615.617825:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735559808:12345-0@lo:400:kworker.0 Request processed in 59us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528615.617831:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788528615.617845:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788528615.617851:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735560320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528615.617878:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735560320:12345-0@lo:400:kworker.0 Request processed in 28us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528615.617884:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788528615.617894:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788528615.617900:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875407735560192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528615.617935:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875407735560192:12345-0@lo:400:kworker.0 Request processed in 36us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528615.617941:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788528615.617951:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788528615.617957:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875407735560704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528615.618084:0:19172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735559680 00000100:00100000:0.0:1788528615.618089:0:19172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735559680 00000100:00100000:0.0:1788528615.618134:0:19172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788528615.618140:0:19172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735559680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528615.618173:0:19172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735559680:12345-0@lo:400:kworker.0 Request processed in 34us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528615.618178:0:19172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788528615.618245:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735559296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788528615.618270:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735559424 00000100:00100000:0.0:1788528615.618273:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735559424 00000100:00100000:0.0:1788528615.618297:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788528615.618302:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:3639:x1875407735559424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528615.618328:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:3639:x1875407735559424:12345-0@lo:400:kworker.0 Request processed in 26us (2671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528615.618334:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788528615.618409:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735560064:0@lo:400:kworker.0 00000100:00100000:0.0:1788528615.618421:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1875407735560576:0@lo:400:kworker.0 00000100:00100000:0.0:1788528615.618428:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:463b8984-c30b-4b73-b2f1-81113bd4e10a:3639:1875407735559424:0@lo:400:kworker.0 00000100:00100000:0.0:1788528615.618440:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735559936:0@lo:400:kworker.0 00010000:00080000:0.0:1788528615.618452:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc4471c00 x1875407735560448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528615.618462:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735560448:0@lo:400:kworker.0 00000100:00080000:0.0:1788528615.618500:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788528615.618503:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788528615.618517:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4471180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735559680:0@lo:400:kworker.0 00000100:00100000:0.0:1788528615.618537:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875407735560192:0@lo:400:kworker.0 00000100:00100000:0.0:1788528615.618548:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735559808:0@lo:400:kworker.0 00000100:00100000:0.0:1788528615.618579:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735560320:0@lo:400:kworker.0 00000100:00100000:2.0:1788528615.619322:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875407735560704:12345-0@lo:400:kworker.0 Request processed in 1362us (2464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528615.619330:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788528615.619512:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788528615.619525:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735560832:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788528615.619582:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528615.619702:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735560832 00000100:00100000:1.0:1788528615.619708:0:18647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735560832 00000100:00100000:1.0:1788528615.619737:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788528615.619744:0:18647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735560832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788528615.619762:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788528615.619806:0:18647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735560832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528615.619813:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788528615.619889:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735560832:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788528615.620036:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc4470e00 x1875407735560704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528615.620050:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1875407735560704:0@lo:400:kworker.0 00000100:00100000:0.0:1788528615.620189:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735559552 00000100:00100000:0.0:1788528615.620194:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735559552 00000100:00100000:0.0:1788528615.620228:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788528615.620235:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735559552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528615.620279:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735559552:12345-0@lo:400:kworker.0 Request processed in 44us (4496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528615.620284:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788528615.620312:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4473480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735559552:0@lo:400:kworker.0 00000100:00100000:1.0:1788528615.620573:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788528615.620584:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735560960:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788528615.620617:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528615.620687:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735560960 00000100:00100000:2.0:1788528615.620691:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735560960 00000100:00100000:2.0:1788528615.620734:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788528615.620740:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735560960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788528615.620764:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788528615.620799:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735560960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528615.620805:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788528615.620876:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735560960:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1788528616.319269:0:17889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788528616.382853:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788528616.645285:0:19458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bd1383c0-cb68-4d87-bd29-af707cf13abe 00000001:00080000:2.0:1788528616.646215:0:19458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:1.0:1788528617.169492:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528617.169875:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719749632 00000100:00100000:0.0:1788528617.169892:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719749632 00000100:00100000:0.0:1788528617.170009:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:0.0:1788528617.170021:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+7:14998:x1875407719749632:12345-192.168.203.38@tcp:41:lfs.0 00000100:00080000:2.0:1788528617.170126:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1788528617.170195:0:17138:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788528617.170322:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+7:14998:x1875407719749632:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 302us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528617.170330:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:1.0:1788528617.176245:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528617.176345:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719749760 00000100:00100000:2.0:1788528617.176355:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719749760 00000100:00100000:2.0:1788528617.176430:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:2.0:1788528617.176442:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+6:14998:x1875407719749760:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:2.0:1788528617.176478:0:19473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788528617.176587:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+6:14998:x1875407719749760:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 148us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528617.176595:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00080000:0.0:1788528617.176974:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788528617.181592:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528617.181838:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719749888 00000100:00100000:1.0:1788528617.181849:0:18647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719749888 00000100:00100000:1.0:1788528617.181934:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:1.0:1788528617.181944:0:18647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd1383c0-cb68-4d87-bd29-af707cf13abe+6:14998:x1875407719749888:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:1.0:1788528617.181977:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1788528617.182119:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788528617.182421:0:18647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd1383c0-cb68-4d87-bd29-af707cf13abe+6:14998:x1875407719749888:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 476us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528617.182430:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:1.0:1788528617.186438:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528617.186713:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719750016 00000100:00100000:3.0:1788528617.186723:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719750016 00000100:00100000:3.0:1788528617.186827:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:3.0:1788528617.186839:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:14998:x1875407719750016:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:3.0:1788528617.186872:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788528617.186975:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:14998:x1875407719750016:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 139us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528617.186984:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00080000:0.0:1788528617.188247:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788528617.406793:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528617.466479:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528617.466595:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719750144 00000100:00100000:3.0:1788528617.466606:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719750144 00000100:00100000:3.0:1788528617.466664:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 138 00000100:00100000:3.0:1788528617.466674:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+10:15027:x1875407719750144:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788528617.466689:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528617.466706:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc3428600/0x892c60dda91c9081 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c00e3 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528617.466732:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc3428600/0x892c60dda91c9081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c00e3 expref: 11 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528617.466744:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc3428600/0x892c60dda91c9081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c00e3 expref: 11 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528617.466768:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc3428600, rc 0) 00000100:00100000:3.0:1788528617.466837:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+11:15027:x1875407719750144:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 164us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528617.466844:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 138 00000100:00100000:2.0:1788528617.471536:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528617.471736:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719750272 00000100:00100000:0.0:1788528617.471747:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719750272 00000100:00100000:0.0:1788528617.471834:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 139 00000100:00100000:0.0:1788528617.471845:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+11:15027:x1875407719750272:12345-192.168.203.38@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788528617.471966:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+11:15027:x1875407719750272:12345-192.168.203.38@tcp:501:mount.lustre.0 Request processed in 122us (438us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788528617.471974:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 139 00000100:00100000:2.0:1788528617.479409:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528617.479721:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719750400 00000100:00100000:0.0:1788528617.479731:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719750400 00000100:00100000:0.0:1788528617.479788:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 140 00000100:00100000:0.0:1788528617.479798:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1823b577-e6d1-43c4-8232-3cf51fabc1da+11:15027:x1875407719750400:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788528617.479814:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528617.479831:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c0031200/0x892c60dda91c9088 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c00ea expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528617.479859:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c0031200/0x892c60dda91c9088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c00ea expref: 12 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528617.479871:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c0031200/0x892c60dda91c9088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c00ea expref: 12 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528617.479879:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031200, rc 0) 00000100:00100000:0.0:1788528617.479947:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1823b577-e6d1-43c4-8232-3cf51fabc1da+12:15027:x1875407719750400:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 150us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528617.479954:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 140 00000100:00100000:2.0:1788528617.485443:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528617.485599:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719750528 00000100:00100000:0.0:1788528617.485608:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719750528 00000100:00100000:0.0:1788528617.485665:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 141 00000100:00100000:0.0:1788528617.485674:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+12:15027:x1875407719750528:12345-192.168.203.38@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788528617.485917:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+12:15027:x1875407719750528:12345-192.168.203.38@tcp:501:mount.lustre.0 Request processed in 235us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528617.485924:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 141 00000100:00100000:2.0:1788528617.507854:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528617.511697:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719750656 00000100:00100000:3.0:1788528617.511714:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719750656 00000100:00100000:3.0:1788528617.511796:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 142 00000100:00100000:3.0:1788528617.511807:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+12:15027:x1875407719750656:12345-192.168.203.38@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788528617.511999:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+12:15027:x1875407719750656:12345-192.168.203.38@tcp:503:mount.lustre.0 Request processed in 193us (4154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528617.512007:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 142 00000100:00100000:3.0:1788528617.520111:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528617.520636:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719750784 00000100:00100000:0.0:1788528617.520648:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719750784 00000100:00100000:0.0:1788528617.520712:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 143 00000100:00100000:0.0:1788528617.520723:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+12:15037:x1875407719750784:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788528617.520888:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+12:15037:x1875407719750784:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 165us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528617.520898:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 143 00000100:00100000:1.0:1788528617.547964:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528617.548056:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719750912 00000100:00100000:2.0:1788528617.548067:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719750912 00000100:00100000:2.0:1788528617.548133:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 144 00000100:00100000:2.0:1788528617.548159:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1823b577-e6d1-43c4-8232-3cf51fabc1da+12:15037:x1875407719750912:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788528617.548293:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1823b577-e6d1-43c4-8232-3cf51fabc1da+12:15037:x1875407719750912:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 137us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528617.548302:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 144 00000100:00100000:2.0:1788528617.560046:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528617.560120:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719751040 00000100:00100000:3.0:1788528617.560132:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719751040 00000100:00100000:3.0:1788528617.560195:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 145 00000100:00100000:3.0:1788528617.560206:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+12:15037:x1875407719751040:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788528617.560491:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+12:15037:x1875407719751040:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 286us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528617.560500:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 145 00000100:00100000:3.0:1788528617.564500:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528617.565766:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719751168 00000100:00100000:0.0:1788528617.565779:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719751168 00000100:00100000:0.0:1788528617.565849:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 146 00000100:00100000:0.0:1788528617.565859:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+12:15027:x1875407719751168:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788528617.565875:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528617.565893:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c0031e00/0x892c60dda91c908f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c011b expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528617.565931:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c0031e00/0x892c60dda91c908f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c011b expref: 13 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528617.565944:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c0031e00/0x892c60dda91c908f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c011b expref: 13 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528617.565971:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031e00, rc 0) 00000100:00100000:0.0:1788528617.566041:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+13:15027:x1875407719751168:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 183us (1549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528617.566049:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 146 00000100:00100000:1.0:1788528617.569845:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528617.570014:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719751296 00000100:00100000:0.0:1788528617.570087:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719751296 00000100:00100000:0.0:1788528617.570274:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 147 00000100:00100000:0.0:1788528617.570286:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1823b577-e6d1-43c4-8232-3cf51fabc1da+13:15027:x1875407719751296:12345-192.168.203.38@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788528617.570311:0:17131:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788528617.570331:0:17131:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788528617.570336:0:17131:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788528617.570339:0:17131:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788528617.570342:0:17131:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788528617.570345:0:17131:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788528617.573647:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1823b577-e6d1-43c4-8232-3cf51fabc1da+13:15027:x1875407719751296:12345-192.168.203.38@tcp:256:mount.lustre.0 Request processed in 3351us (3799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528617.573663:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 147 00000100:00100000:3.0:1788528617.592868:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528617.597942:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719751424 00000100:00100000:2.0:1788528617.597958:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719751424 00000100:00100000:2.0:1788528617.598036:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 148 00000100:00100000:2.0:1788528617.598046:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+13:15027:x1875407719751424:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788528617.598062:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528617.598079:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c9096 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0122 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528617.598119:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c9096 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0122 expref: 14 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528617.598131:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c9096 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0122 expref: 14 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528617.598141:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c13fda00, rc 0) 00000100:00100000:2.0:1788528617.598213:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+14:15027:x1875407719751424:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 168us (5444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528617.598219:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 148 00000100:00100000:1.0:1788528617.612981:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528617.613158:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719751552 00000100:00100000:0.0:1788528617.613167:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719751552 00000100:00100000:0.0:1788528617.613220:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 149 00000100:00100000:0.0:1788528617.613229:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1823b577-e6d1-43c4-8232-3cf51fabc1da+14:15027:x1875407719751552:12345-192.168.203.38@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788528617.613371:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1823b577-e6d1-43c4-8232-3cf51fabc1da+14:15027:x1875407719751552:12345-192.168.203.38@tcp:501:mount.lustre.0 Request processed in 142us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528617.613380:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 149 00000100:00100000:3.0:1788528617.615291:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528617.615432:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719751680 00000100:00100000:0.0:1788528617.615453:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719751680 00000100:00100000:0.0:1788528617.615522:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 150 00000100:00100000:0.0:1788528617.615531:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+14:15027:x1875407719751680:12345-192.168.203.38@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788528617.615707:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+14:15027:x1875407719751680:12345-192.168.203.38@tcp:503:mount.lustre.0 Request processed in 176us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528617.615715:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 150 00000100:00100000:3.0:1788528617.618068:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528617.618333:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719751808 00000100:00100000:2.0:1788528617.618344:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719751808 00000100:00100000:2.0:1788528617.618398:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 151 00000100:00100000:2.0:1788528617.618407:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+14:15043:x1875407719751808:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788528617.618770:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+14:15043:x1875407719751808:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 362us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528617.618779:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 151 00000100:00100000:1.0:1788528617.625621:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528617.626245:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719751936 00000100:00100000:2.0:1788528617.626257:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719751936 00000100:00100000:2.0:1788528617.626321:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 152 00000100:00100000:2.0:1788528617.626332:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1823b577-e6d1-43c4-8232-3cf51fabc1da+14:15043:x1875407719751936:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788528617.626501:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1823b577-e6d1-43c4-8232-3cf51fabc1da+14:15043:x1875407719751936:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 169us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528617.626516:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 152 00000100:00100000:3.0:1788528617.642970:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528617.643042:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528617.644879:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719752064 00000100:00100000:1.0:1788528617.644899:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719752064 00000100:00100000:1.0:1788528617.645135:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719752320 00000100:00100000:1.0:1788528617.645139:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719752320 00000100:00100000:1.0:1788528617.645177:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:1.0:1788528617.645187:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2402:x1875407719752064:12345-192.168.203.38@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788528617.645229:0:17139:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from dc02331c-9cea-4afd-8708-cba407bdbca8@192.168.203.38@tcp t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:1.0:1788528617.645286:0:17139:0:(genops.c:1385:class_connect()) connect: client dc02331c-9cea-4afd-8708-cba407bdbca8, cookie 0x892c60dda91c909d 00000004:00100000:1.0:1788528617.645319:0:17139:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788528617.647050:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:3.0:1788528617.647065:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2402:x1875407719752320:12345-192.168.203.38@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788528617.647147:0:17137:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from dc02331c-9cea-4afd-8708-cba407bdbca8@192.168.203.38@tcp t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:3.0:1788528617.647199:0:17137:0:(genops.c:1385:class_connect()) connect: client dc02331c-9cea-4afd-8708-cba407bdbca8, cookie 0x892c60dda91c90a4 00000004:00100000:3.0:1788528617.647232:0:17137:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788528617.647613:0:17137:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3147800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788528617.647715:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dc02331c-9cea-4afd-8708-cba407bdbca8+6:2402:x1875407719752320:12345-192.168.203.38@tcp:38:mount.lustre.0 Request processed in 649us (4671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528617.647725:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00080000:1.0:1788528617.647988:0:17139:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d2c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788528617.648020:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dc02331c-9cea-4afd-8708-cba407bdbca8+6:2402:x1875407719752064:12345-192.168.203.38@tcp:38:mount.lustre.0 Request processed in 2833us (5068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528617.648039:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:3.0:1788528617.653244:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528617.653313:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528617.653619:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719752448 00000100:00100000:0.0:1788528617.653632:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719752448 00000100:00100000:0.0:1788528617.653732:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719752192 00000100:00100000:0.0:1788528617.653736:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719752192 00000100:00100000:0.0:1788528617.653762:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:0.0:1788528617.653788:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dc02331c-9cea-4afd-8708-cba407bdbca8+6:0:x1875407719752448:12345-192.168.203.38@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788528617.653831:0:17137:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788528617.653926:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dc02331c-9cea-4afd-8708-cba407bdbca8+6:0:x1875407719752448:12345-192.168.203.38@tcp:41:mount.lustre.0 Request processed in 141us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528617.653934:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:0.0:1788528617.653954:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:0.0:1788528617.653961:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dc02331c-9cea-4afd-8708-cba407bdbca8+6:0:x1875407719752192:12345-192.168.203.38@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788528617.653974:0:17137:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788528617.654004:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dc02331c-9cea-4afd-8708-cba407bdbca8+6:0:x1875407719752192:12345-192.168.203.38@tcp:41:mount.lustre.0 Request processed in 43us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528617.654010:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00080000:3.0:1788528617.655379:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788528617.655393:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788528617.655531:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528617.656131:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719752576 00000100:00100000:0.0:1788528617.656145:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719752576 00000100:00100000:0.0:1788528617.656221:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:0.0:1788528617.656233:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dc02331c-9cea-4afd-8708-cba407bdbca8+6:15027:x1875407719752576:12345-192.168.203.38@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788528617.656300:0:17137:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788528617.656386:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dc02331c-9cea-4afd-8708-cba407bdbca8+6:15027:x1875407719752576:12345-192.168.203.38@tcp:41:mount.lustre.0 Request processed in 156us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528617.656396:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:0.0:1788528617.662473:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528617.663408:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719752704 00000100:00100000:1.0:1788528617.663424:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719752704 00000100:00100000:1.0:1788528617.663517:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:1.0:1788528617.663531:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dc02331c-9cea-4afd-8708-cba407bdbca8+6:15027:x1875407719752704:12345-192.168.203.38@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788528617.663691:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dc02331c-9cea-4afd-8708-cba407bdbca8+6:15027:x1875407719752704:12345-192.168.203.38@tcp:40:mount.lustre.0 Request processed in 163us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528617.663699:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:3.0:1788528617.674861:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528617.674979:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528617.675019:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528617.675210:0:19172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719752832 00000100:00100000:0.0:1788528617.675224:0:19172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719752832 00000100:00100000:0.0:1788528617.675286:0:19172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719752960 00000100:00100000:0.0:1788528617.675290:0:19172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719752960 00000100:00100000:0.0:1788528617.675326:0:19172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:0.0:1788528617.675337:0:19172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2402:x1875407719752832:12345-192.168.203.38@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788528617.675386:0:19172:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from dc02331c-9cea-4afd-8708-cba407bdbca8@192.168.203.38@tcp t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:0.0:1788528617.675430:0:19172:0:(genops.c:1385:class_connect()) connect: client dc02331c-9cea-4afd-8708-cba407bdbca8, cookie 0x892c60dda91c90ab 00002000:00100000:0.0:1788528617.675445:0:19172:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dc02331c-9cea-4afd-8708-cba407bdbca8/ffff8a90ff70a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788528617.675459:0:19172:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788528617.675613:0:19172:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788528617.675654:0:19172:0:(import.c:65:import_set_state_nolock()) ffff8a90ff70f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788528617.675738:0:19172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dc02331c-9cea-4afd-8708-cba407bdbca8+6:2402:x1875407719752832:12345-192.168.203.38@tcp:8:mount.lustre.0 Request processed in 401us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528617.675747:0:19172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:0.0:1788528617.675780:0:19172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:0.0:1788528617.675786:0:19172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2402:x1875407719752960:12345-192.168.203.38@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788528617.675803:0:19172:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from dc02331c-9cea-4afd-8708-cba407bdbca8@192.168.203.38@tcp t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:0.0:1788528617.675821:0:19172:0:(genops.c:1385:class_connect()) connect: client dc02331c-9cea-4afd-8708-cba407bdbca8, cookie 0x892c60dda91c90b2 00002000:00100000:0.0:1788528617.675840:0:19172:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dc02331c-9cea-4afd-8708-cba407bdbca8/ffff8a90ff708000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788528617.675847:0:19172:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788528617.675901:0:19172:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788528617.675929:0:19172:0:(import.c:65:import_set_state_nolock()) ffff8a90ff70b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788528617.675955:0:19172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dc02331c-9cea-4afd-8708-cba407bdbca8+6:2402:x1875407719752960:12345-192.168.203.38@tcp:8:mount.lustre.0 Request processed in 167us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528617.675962:0:19172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:1.0:1788528617.683822:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719753088 00000100:00100000:1.0:1788528617.683845:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719753088 00000100:00100000:1.0:1788528617.683955:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:1.0:1788528617.683968:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:dc02331c-9cea-4afd-8708-cba407bdbca8+6:15027:x1875407719753088:12345-192.168.203.38@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788528617.684140:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:dc02331c-9cea-4afd-8708-cba407bdbca8+6:15027:x1875407719753088:12345-192.168.203.38@tcp:900:mount.lustre.0 Request processed in 175us (9293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528617.684149:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:3.0:1788528617.688186:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528617.688367:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719753216 00000100:00100000:1.0:1788528617.688382:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719753216 00000100:00100000:1.0:1788528617.688451:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:1.0:1788528617.688463:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dc02331c-9cea-4afd-8708-cba407bdbca8+6:15027:x1875407719753216:12345-192.168.203.38@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788528617.688614:0:17141:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788528617.688851:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dc02331c-9cea-4afd-8708-cba407bdbca8+6:15027:x1875407719753216:12345-192.168.203.38@tcp:33:mount.lustre.0 Request processed in 389us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528617.688860:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:3.0:1788528617.882619:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528617.882759:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719753344 00000100:00100000:1.0:1788528617.882785:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719753344 00000100:00100000:1.0:1788528617.882875:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:1.0:1788528617.882892:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dc02331c-9cea-4afd-8708-cba407bdbca8+6:15066:x1875407719753344:12345-192.168.203.38@tcp:101:mkdir.0 00010000:00010000:1.0:1788528617.882934:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528617.882972:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14abc00/0x892c60dda91c90b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0153 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528617.883070:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c90c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528617.883087:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c90c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528617.883104:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c90c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528617.883326:0:17138:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788528617.883331:0:17138:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788528617.883379:0:17138:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c90c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528617.883414:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14abc00/0x892c60dda91c90b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0153 expref: 8 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528617.883438:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c90c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0153 expref: 7 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528617.883450:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c87bee00) 00010000:00010000:1.0:1788528617.883454:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788528617.883458:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c14aae00, rc 0) 00000100:00100000:1.0:1788528617.883543:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dc02331c-9cea-4afd-8708-cba407bdbca8+7:15066:x1875407719753344:12345-192.168.203.38@tcp:101:mkdir.0 Request processed in 655us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528617.883550:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 22 00010000:00010000:3.0:1788528618.430976:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528619.464245:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528619.710817:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735561088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788528619.710900:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528619.711586:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735561216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788528619.711624:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528619.711783:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735561088 00000100:00100000:2.0:1788528619.711791:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735561088 00000100:00100000:2.0:1788528619.711846:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735561216 00000100:00100000:2.0:1788528619.711849:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735561216 00000100:00100000:2.0:1788528619.711868:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788528619.711878:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735561088:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788528619.711953:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788528619.712022:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528619.712078:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735561088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 202us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528619.712086:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788528619.712103:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788528619.712109:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735561216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788528619.712134:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528619.712172:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735561216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528619.712178:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788528619.712261:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735561216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788528619.712400:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735561088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788528620.226473:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788528620.226495:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735561344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788528620.226582:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528620.226715:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735561344 00000100:00100000:2.0:1788528620.226723:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735561344 00000100:00100000:2.0:1788528620.226773:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788528620.226782:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735561344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788528620.226810:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788528620.226857:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735561344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528620.226864:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788528620.226952:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735561344:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788528620.481878:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788528620.738461:0:17117:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dc02331c-9cea-4afd-8708-cba407bdbca8 00000001:00100000:3.0:1788528620.738479:0:17117:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bd1383c0-cb68-4d87-bd29-af707cf13abe 00000100:00100000:0.0:1788528620.742414:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735561600:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788528620.742533:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528620.742636:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788528620.742645:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735561472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788528620.742675:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528620.742720:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735561600 00000100:00100000:0.0:1788528620.742731:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735561600 00000100:00100000:0.0:1788528620.742794:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788528620.742805:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735561600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788528620.742853:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788528620.742917:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735561600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528620.742926:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788528620.742955:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735561472 00000100:00100000:0.0:1788528620.742959:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735561472 00000100:00100000:0.0:1788528620.743007:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788528620.743015:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735561472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788528620.743039:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788528620.743071:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735561472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528620.743079:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788528620.743280:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788528620.743319:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788528620.743351:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735561472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788528620.743366:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735561600:0@lo:41:osp-pre-1-0.0 00000001:00100000:0.0:1788528620.752441:0:18640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dc02331c-9cea-4afd-8708-cba407bdbca8 00000001:00100000:0.0:1788528620.752457:0:18640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bd1383c0-cb68-4d87-bd29-af707cf13abe 00000001:00100000:1.0:1788528620.753753:0:17870:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of dc02331c-9cea-4afd-8708-cba407bdbca8 00000001:00100000:1.0:1788528620.753764:0:17870:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bd1383c0-cb68-4d87-bd29-af707cf13abe 00000100:00100000:1.0:1788528620.754030:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735561984:0@lo:400:kworker.0 00000100:00100000:1.0:1788528620.754124:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528620.758442:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:463b8984-c30b-4b73-b2f1-81113bd4e10a:3638:1875407735561856:0@lo:400:kworker.0 00000100:00100000:0.0:1788528620.758544:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528620.758622:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788528620.758630:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735561728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788528620.758661:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528620.758702:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735561856 00000100:00100000:0.0:1788528620.758711:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735561856 00000100:00100000:0.0:1788528620.758772:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788528620.758783:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:3638:x1875407735561856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528620.759128:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:3638:x1875407735561856:12345-0@lo:400:kworker.0 Request processed in 179us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528620.759139:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788528620.759195:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735561728 00000100:00100000:0.0:1788528620.759211:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735561728 00000100:00100000:0.0:1788528620.759254:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788528620.759260:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735561728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788528620.759277:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788528620.759312:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735561728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528620.759318:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788528620.759338:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788528620.759383:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735561728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788528620.759394:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:463b8984-c30b-4b73-b2f1-81113bd4e10a:3638:1875407735561856:0@lo:400:kworker.0 00000100:00100000:0.0:1788528620.760567:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735562112:0@lo:400:kworker.0 00000100:00100000:0.0:1788528620.760640:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528620.760679:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1875407735562624:0@lo:400:kworker.0 00000100:00100000:0.0:1788528620.760703:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528620.760729:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788528620.760736:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1875407735562496:0@lo:400:kworker.0 00000100:00100000:0.0:1788528620.760762:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528620.760816:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735562112 00000100:00100000:0.0:1788528620.760824:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735562112 00000100:00100000:0.0:1788528620.763146:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735562624 00000100:00100000:0.0:1788528620.763165:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735562624 00000100:00100000:2.0:1788528620.764430:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735562240:0@lo:400:kworker.0 00000100:00100000:2.0:1788528620.764519:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528620.764783:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1875407735562752:0@lo:400:kworker.0 00000100:00100000:2.0:1788528620.764813:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528620.765813:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788528620.765827:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735562368:0@lo:400:kworker.0 00000100:00100000:2.0:1788528620.765896:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528620.768313:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735562496 00000100:00100000:3.0:1788528620.768331:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735562496 00000100:00100000:3.0:1788528620.768416:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735562752 00000100:00100000:3.0:1788528620.768419:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735562752 00000100:00100000:3.0:1788528620.768448:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788528620.768460:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735562112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528620.768671:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735562112:12345-0@lo:400:kworker.0 Request processed in 212us (8030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528620.768680:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788528620.768699:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788528620.768707:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875407735562624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528620.768737:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875407735562624:12345-0@lo:400:kworker.0 Request processed in 32us (8033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528620.768744:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788528620.768753:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788528620.768759:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875407735562496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528620.768781:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875407735562496:12345-0@lo:400:kworker.0 Request processed in 22us (8018us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528620.768786:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788528620.768797:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788528620.768803:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875407735562752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528620.768826:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875407735562752:12345-0@lo:400:kworker.0 Request processed in 24us (4012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528620.768832:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788528620.769222:0:19172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735561984 00000100:00100000:0.0:1788528620.769235:0:19172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735561984 00000100:00100000:0.0:1788528620.769284:0:19172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735562240 00000100:00100000:0.0:1788528620.769289:0:19172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735562240 00000100:00100000:0.0:1788528620.769314:0:19172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788528620.769332:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788528620.769335:0:19172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735561984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528620.769346:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735562240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528620.769399:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735562240:12345-0@lo:400:kworker.0 Request processed in 59us (4881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528620.769406:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788528620.769412:0:19172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735561984:12345-0@lo:400:kworker.0 Request processed in 89us (15286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528620.769420:0:19172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788528620.769458:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735561984:0@lo:400:kworker.0 00000100:00100000:2.0:1788528620.769587:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1875407735562880:0@lo:400:kworker.0 00000100:00100000:2.0:1788528620.769646:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528620.769676:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735562240:0@lo:400:kworker.0 00000100:00100000:2.0:1788528620.769689:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1875407735562752:0@lo:400:kworker.0 00000100:00100000:2.0:1788528620.769744:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735562368 00000100:00100000:2.0:1788528620.769757:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735562368 00000100:00100000:2.0:1788528620.769787:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735562880 00000100:00100000:2.0:1788528620.769790:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735562880 00000100:00100000:2.0:1788528620.769815:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788528620.769821:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735562368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528620.770518:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1875407735562496:0@lo:400:kworker.0 00000100:00100000:0.0:1788528620.770940:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735562112:0@lo:400:kworker.0 00010000:00080000:0.0:1788528620.771169:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc467f800 x1875407735562624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528620.771183:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1875407735562624:0@lo:400:kworker.0 00000100:00080000:0.0:1788528620.771316:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788528620.771324:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788528620.771698:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788528620.771717:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875407735562880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528620.771821:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875407735562880:12345-0@lo:400:kworker.0 Request processed in 113us (2174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528620.771829:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788528620.771903:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735562368:0@lo:400:kworker.0 00010000:00080000:0.0:1788528620.771919:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc467ce00 x1875407735562880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528620.771929:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1875407735562880:0@lo:400:kworker.0 00000100:00100000:2.0:1788528620.773375:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735562368:12345-0@lo:400:kworker.0 Request processed in 3544us (7469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528620.773390:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000001:02000400:3.0:1788528621.331066:0:20016:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788528621.503219:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788528621.954976:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788528622.530500:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528622.807123:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528622.807174:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528622.807198:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528622.807234:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528622.807259:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528622.807277:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528622.807306:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528622.807327:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528622.807354:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528622.807387:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719753472 00000100:00100000:0.0:1788528622.807400:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719753472 00000100:00100000:0.0:1788528622.807473:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 154 00000100:00100000:0.0:1788528622.807485:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+14:2405:x1875407719753472:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528622.807600:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+14:2405:x1875407719753472:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 117us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528622.807608:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 154 00000100:00100000:0.0:1788528622.807647:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719753600 00000100:00100000:0.0:1788528622.807651:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719753600 00000100:00100000:0.0:1788528622.807688:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719753728 00000100:00100000:0.0:1788528622.807690:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719753728 00000100:00100000:0.0:1788528622.807703:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719754112 00000100:00100000:0.0:1788528622.807705:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719754112 00000100:00100000:0.0:1788528622.807715:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719754240 00000100:00100000:0.0:1788528622.807717:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719754240 00000100:00100000:0.0:1788528622.807734:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 42 00000100:00100000:0.0:1788528622.807741:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+6:2406:x1875407719753600:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528622.807776:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+6:2406:x1875407719753600:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 35us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528622.807783:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 42 00000100:00100000:0.0:1788528622.807797:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:0.0:1788528622.807803:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2406:x1875407719753728:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528622.807838:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2406:x1875407719753728:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 35us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528622.807844:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:0.0:1788528622.807857:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:0.0:1788528622.807863:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dc02331c-9cea-4afd-8708-cba407bdbca8+6:2406:x1875407719754112:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528622.807895:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dc02331c-9cea-4afd-8708-cba407bdbca8+6:2406:x1875407719754112:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 32us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528622.807900:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:0.0:1788528622.807911:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:0.0:1788528622.807915:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dc02331c-9cea-4afd-8708-cba407bdbca8+5:2406:x1875407719754240:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528622.807935:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dc02331c-9cea-4afd-8708-cba407bdbca8+5:2406:x1875407719754240:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 19us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528622.807941:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:0.0:1788528622.807962:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719753856 00000100:00100000:0.0:1788528622.807965:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719753856 00000100:00100000:0.0:1788528622.807990:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719753984 00000100:00100000:0.0:1788528622.807993:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719753984 00000100:00100000:0.0:1788528622.808009:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719754368 00000100:00100000:0.0:1788528622.808011:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719754368 00000100:00100000:0.0:1788528622.808022:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719754496 00000100:00100000:0.0:1788528622.808024:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719754496 00000100:00100000:0.0:1788528622.808036:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:0.0:1788528622.808041:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2406:x1875407719753856:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528622.808067:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2406:x1875407719753856:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 26us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528622.808084:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:0.0:1788528622.808098:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:0.0:1788528622.808104:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2406:x1875407719753984:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528622.808128:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2406:x1875407719753984:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 25us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528622.808134:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:0.0:1788528622.808144:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:0.0:1788528622.808151:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dc02331c-9cea-4afd-8708-cba407bdbca8+5:2406:x1875407719754368:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528622.808172:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dc02331c-9cea-4afd-8708-cba407bdbca8+5:2406:x1875407719754368:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 22us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528622.808178:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:0.0:1788528622.808188:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:0.0:1788528622.808195:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dc02331c-9cea-4afd-8708-cba407bdbca8+6:2406:x1875407719754496:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528622.808215:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dc02331c-9cea-4afd-8708-cba407bdbca8+6:2406:x1875407719754496:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 21us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528622.808221:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00080000:0.0:1788528622.808248:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788528622.808253:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788528622.808256:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788528622.808258:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788528623.552618:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788528623.810366:0:19458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dc02331c-9cea-4afd-8708-cba407bdbca8 00010000:00010000:2.0:1788528624.577506:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528624.831200:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735563008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788528624.831270:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528624.831328:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788528624.831335:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735563136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788528624.831360:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528624.834006:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735563008 00000100:00100000:1.0:1788528624.834020:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735563008 00000100:00100000:1.0:1788528624.834081:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735563136 00000100:00100000:1.0:1788528624.834084:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735563136 00000100:00100000:1.0:1788528624.834108:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788528624.834117:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735563008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788528624.834165:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528624.834245:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735563008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (2974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528624.834252:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788528624.834269:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788528624.834289:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735563136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788528624.834300:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528624.834328:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735563136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (2967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528624.834334:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788528624.834386:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735563136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788528624.834402:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735563008:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788528624.850795:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1788528625.141699:0:20164:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff73321230 20000000:00000080:2.0:1788528625.141716:0:20164:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a90c6ce5800 uarg=0000000000000000 20000000:01000000:2.0:1788528625.141759:0:20164:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788528625.141764:0:20164:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788528625.141769:0:20164:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788528625.142623:0:20165:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1788528625.142764:0:20164:0:(mgs_llog.c:1456:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788528625.155003:0:20164:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788528625.156285:0:20164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a8fc26e2a00/0x892c60dda91c90c7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528625.156307:0:20164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9101851800/0x892c60dda91c8d39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8d32 expref: 26 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528625.156316:0:20164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c1551c00/0x892c60dda91c8d47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8d40 expref: 26 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528625.156323:0:20164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9101850a00/0x892c60dda91c8d94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8d8d expref: 26 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528625.156330:0:20164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c784ea00/0x892c60dda91c8f07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c8f00 expref: 26 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528625.156352:0:20164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a8fc3428e00/0x892c60dda91c9050 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c00ab expref: 13 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528625.156358:0:20164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c9096 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0122 expref: 13 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528625.156365:0:20164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a8fc26e2a00/0x892c60dda91c90c7 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528625.156405:0:20164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c9096 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0122 expref: 13 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528625.156419:0:20164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c9096 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0122 expref: 13 pid: 17132 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528625.156432:0:20164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20164:1875407735563264:192.168.203.38@tcp:104: 00010000:00010000:2.0:1788528625.156539:0:20164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a8fc3428e00/0x892c60dda91c9050 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c00ab expref: 13 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528625.156547:0:20164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a8fc3428e00/0x892c60dda91c9050 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c00ab expref: 13 pid: 17132 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528625.156575:0:20164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20164:1875407735563392:192.168.203.38@tcp:104: 00010000:00010000:2.0:1788528625.156611:0:20164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c784ea00/0x892c60dda91c8f07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c8f00 expref: 26 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528625.156619:0:20164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a90c784ea00/0x892c60dda91c8f07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c8f00 expref: 26 pid: 17132 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528625.156638:0:20164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20164:1875407735563520:0@lo:104: 00000100:00100000:2.0:1788528625.156677:0:20164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788528625.156718:0:20164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9101850a00/0x892c60dda91c8d94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c8d8d expref: 26 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528625.156727:0:20164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a9101850a00/0x892c60dda91c8d94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c8d8d expref: 26 pid: 17130 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528625.156735:0:20164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20164:1875407735563648:0@lo:104: 00000100:00100000:2.0:1788528625.156757:0:20164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788528625.156789:0:20164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c1551c00/0x892c60dda91c8d47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c8d40 expref: 26 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528625.156796:0:20164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a90c1551c00/0x892c60dda91c8d47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c8d40 expref: 26 pid: 17132 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528625.156804:0:20164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20164:1875407735563776:0@lo:104: 00000100:00100000:2.0:1788528625.156824:0:20164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788528625.156839:0:20164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9101851800/0x892c60dda91c8d39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c8d32 expref: 26 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528625.156848:0:20164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a9101851800/0x892c60dda91c8d39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c8d32 expref: 26 pid: 17130 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528625.156868:0:20164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20164:1875407735563904:0@lo:104: 00000100:00100000:2.0:1788528625.156891:0:20164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528625.156901:0:20164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de6c5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528625.157011:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735563520 00000100:00100000:0.0:1788528625.157019:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735563520 00000100:00100000:0.0:1788528625.157052:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735563648 00000100:00100000:0.0:1788528625.157056:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735563648 00000100:00100000:0.0:1788528625.157078:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735563776 00000100:00100000:0.0:1788528625.157081:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735563776 00000100:00100000:0.0:1788528625.157091:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735563904 00000100:00100000:0.0:1788528625.157094:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735563904 00000100:00100000:0.0:1788528625.157106:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788528625.157114:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:463b8984-c30b-4b73-b2f1-81113bd4e10a+6:20164:x1875407735563520:12345-0@lo:104: 00010000:00010000:0.0:1788528625.157126:0:17120:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c784f600/0x892c60dda91c8f00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c8f07 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.157191:0:17120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788528625.157197:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:463b8984-c30b-4b73-b2f1-81113bd4e10a+6:20164:x1875407735563520:12345-0@lo:104: Request processed in 84us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528625.157202:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788528625.157217:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788528625.157223:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:463b8984-c30b-4b73-b2f1-81113bd4e10a+5:20164:x1875407735563648:12345-0@lo:104: 00010000:00010000:0.0:1788528625.157230:0:17120:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429200/0x892c60dda91c8d8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c8d94 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.157261:0:17120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788528625.157265:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:463b8984-c30b-4b73-b2f1-81113bd4e10a+5:20164:x1875407735563648:12345-0@lo:104: Request processed in 43us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528625.157271:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788528625.157281:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788528625.157286:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:463b8984-c30b-4b73-b2f1-81113bd4e10a+4:20164:x1875407735563776:12345-0@lo:104: 00010000:00010000:0.0:1788528625.157292:0:17120:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c8d40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c8d47 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.157319:0:17120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788528625.157330:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:463b8984-c30b-4b73-b2f1-81113bd4e10a+4:20164:x1875407735563776:12345-0@lo:104: Request processed in 44us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528625.157335:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788528625.157348:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788528625.157353:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6feed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:463b8984-c30b-4b73-b2f1-81113bd4e10a+3:20164:x1875407735563904:12345-0@lo:104: 00010000:00010000:0.0:1788528625.157360:0:17120:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8d32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c8d39 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.157386:0:17120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788528625.157390:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6feed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:463b8984-c30b-4b73-b2f1-81113bd4e10a+3:20164:x1875407735563904:12345-0@lo:104: Request processed in 38us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528625.157395:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788528625.157411:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788528625.157416:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c784f600/0x892c60dda91c8f00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c8f07 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.157422:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784f600 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:0.0:1788528625.157426:0:17125:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c784f600/0x892c60dda91c8f00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c8f07 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.157433:0:17125:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c784f600/0x892c60dda91c8f00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c8f07 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528625.157441:0:17125:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c784f600/0x892c60dda91c8f00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c8f07 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528625.157447:0:17125:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788528625.157473:0:17125:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c784f600/0x892c60dda91c8f00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8f07 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.157489:0:17125:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788528625.157508:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c784f600/0x892c60dda91c8f00 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8f07 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.157515:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c784f600/0x892c60dda91c8f00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8f07 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.157527:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788528625.157530:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429200/0x892c60dda91c8d8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c8d94 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.157537:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3429200 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:0.0:1788528625.157540:0:17125:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429200/0x892c60dda91c8d8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c8d94 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.157548:0:17125:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429200/0x892c60dda91c8d8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c8d94 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528625.157577:0:17125:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429200/0x892c60dda91c8d8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c8d94 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528625.157583:0:17125:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788528625.157597:0:17125:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429200/0x892c60dda91c8d8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8d94 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.157603:0:17125:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788528625.157609:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429200/0x892c60dda91c8d8d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8d94 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.157615:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429200/0x892c60dda91c8d8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8d94 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.157631:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788528625.157634:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c8d40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c8d47 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.157640:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030a00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:0.0:1788528625.157643:0:17125:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c8d40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c8d47 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.157650:0:17125:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c8d40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c8d47 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528625.157657:0:17125:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c8d40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c8d47 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528625.157662:0:17125:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788528625.157674:0:17125:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c8d40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8d47 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.157680:0:17125:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788528625.157696:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c8d40 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8d47 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.157703:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c0030a00/0x892c60dda91c8d40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8d47 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.157712:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528625.157838:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8d32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c8d39 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.157867:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031c00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:0.0:1788528625.157874:0:17125:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8d32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c8d39 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.157881:0:17125:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8d32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c8d39 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528625.157887:0:17125:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8d32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c8d39 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528625.157891:0:17125:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788528625.157906:0:17125:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8d32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8d39 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.157912:0:17125:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788528625.157919:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8d32 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8d39 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.157924:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c0031c00/0x892c60dda91c8d32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c8d39 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528625.157927:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:463b8984-c30b-4b73-b2f1-81113bd4e10a:3637:1875407735564032:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788528625.157937:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528625.157939:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528625.157940:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528625.157949:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:463b8984-c30b-4b73-b2f1-81113bd4e10a:3638:1875407735564160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528625.157960:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528625.157986:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:463b8984-c30b-4b73-b2f1-81113bd4e10a:3639:1875407735564288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788528625.167705:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528625.167866:0:20164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20164:1875407735563520:0@lo:104: 00000100:00100000:2.0:1788528625.168024:0:20164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20164:1875407735563648:0@lo:104: 00000100:00100000:2.0:1788528625.168034:0:20164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20164:1875407735563776:0@lo:104: 00000100:00100000:2.0:1788528625.168043:0:20164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20164:1875407735563904:0@lo:104: 00000100:00100000:0.0:1788528625.169751:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788528625.169784:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:463b8984-c30b-4b73-b2f1-81113bd4e10a:3639:1875407735564416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788528625.169834:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528625.169892:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735564032 00000100:00100000:0.0:1788528625.169900:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735564032 00010000:00010000:0.0:1788528625.169940:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c784ea00/0x892c60dda91c8f07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c8f00 expref: 27 pid: 17132 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528625.169963:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735564288 00000100:00100000:0.0:1788528625.169966:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735564288 00010000:00010000:0.0:1788528625.170115:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c1551c00/0x892c60dda91c8d47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c8d40 expref: 28 pid: 17132 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528625.170129:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735564416 00000100:00100000:0.0:1788528625.170132:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735564416 00010000:00010000:0.0:1788528625.170145:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9101851800/0x892c60dda91c8d39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c8d32 expref: 29 pid: 17130 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528625.170170:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788528625.170178:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:463b8984-c30b-4b73-b2f1-81113bd4e10a+29:3637:x1875407735564032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788528625.170191:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528625.170196:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c784ea00/0x892c60dda91c8f07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c8f00 expref: 29 pid: 17132 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.170206:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c784ea00/0x892c60dda91c8f07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c8f00 expref: 29 pid: 17132 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.170222:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c784ea00/0x892c60dda91c8f07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c8f00 expref: 29 pid: 17132 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.170238:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528625.170269:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:463b8984-c30b-4b73-b2f1-81113bd4e10a+28:3637:x1875407735564032:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (12308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528625.170281:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788528625.170297:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788528625.170302:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:3639:x1875407735564288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788528625.170309:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528625.170313:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c1551c00/0x892c60dda91c8d47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c8d40 expref: 27 pid: 17132 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.170321:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c1551c00/0x892c60dda91c8d47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c8d40 expref: 27 pid: 17132 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.170329:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c1551c00/0x892c60dda91c8d47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c8d40 expref: 27 pid: 17132 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.170337:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528625.170364:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:463b8984-c30b-4b73-b2f1-81113bd4e10a+26:3639:x1875407735564288:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (2669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528625.170370:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788528625.170380:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788528625.170385:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:463b8984-c30b-4b73-b2f1-81113bd4e10a+25:3639:x1875407735564416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788528625.170391:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528625.170395:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9101851800/0x892c60dda91c8d39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c8d32 expref: 25 pid: 17130 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.170403:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9101851800/0x892c60dda91c8d39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c8d32 expref: 25 pid: 17130 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.170412:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101851800/0x892c60dda91c8d39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c8d32 expref: 25 pid: 17130 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.170430:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528625.170450:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:463b8984-c30b-4b73-b2f1-81113bd4e10a+24:3639:x1875407735564416:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528625.170456:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788528625.170473:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528625.170525:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:463b8984-c30b-4b73-b2f1-81113bd4e10a:3639:1875407735564416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788528625.170534:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:463b8984-c30b-4b73-b2f1-81113bd4e10a:3639:1875407735564288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788528625.170578:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735564160 00000100:00100000:0.0:1788528625.170581:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735564160 00010000:00010000:0.0:1788528625.170594:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9101850a00/0x892c60dda91c8d94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c8d8d expref: 24 pid: 17130 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528625.170606:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788528625.170610:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:463b8984-c30b-4b73-b2f1-81113bd4e10a+24:3638:x1875407735564160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788528625.170617:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528625.170621:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9101850a00/0x892c60dda91c8d94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c8d8d expref: 24 pid: 17130 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.170628:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9101850a00/0x892c60dda91c8d94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c8d8d expref: 24 pid: 17130 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.170637:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101850a00/0x892c60dda91c8d94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c8d8d expref: 24 pid: 17130 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528625.170644:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528625.170670:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:3638:x1875407735564160:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528625.170685:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788528625.170708:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:463b8984-c30b-4b73-b2f1-81113bd4e10a:3638:1875407735564160:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788528625.172825:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528625.172835:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528625.177981:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:463b8984-c30b-4b73-b2f1-81113bd4e10a:3637:1875407735564032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788528625.183412:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528625.183586:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719754624 00000100:00100000:1.0:1788528625.183601:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719754624 00010000:00010000:1.0:1788528625.183643:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c9096 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0122 expref: 14 pid: 17132 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528625.183679:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:1.0:1788528625.183689:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6dd0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1823b577-e6d1-43c4-8232-3cf51fabc1da+14:2403:x1875407719754624:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788528625.183703:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788528625.183704:0:20164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20164:1875407735563264:192.168.203.38@tcp:104: 00010000:00010000:1.0:1788528625.183712:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c9096 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0122 expref: 14 pid: 17132 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528625.183725:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c9096 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0122 expref: 14 pid: 17132 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528625.183729:0:20164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20164:1875407735563392:192.168.203.38@tcp:104: 00010000:00010000:1.0:1788528625.183750:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c13fda00/0x892c60dda91c9096 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0122 expref: 14 pid: 17132 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528625.183771:0:20164:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a8fc26e2a00/0x892c60dda91c90c7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528625.183784:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528625.183847:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6dd0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1823b577-e6d1-43c4-8232-3cf51fabc1da+13:2403:x1875407719754624:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 159us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528625.183865:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:0.0:1788528625.184037:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528625.184193:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719754752 00000100:00100000:1.0:1788528625.184206:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719754752 00010000:00010000:1.0:1788528625.184223:0:17123:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a8fc3428e00/0x892c60dda91c9050 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c00ab expref: 13 pid: 17132 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528625.184253:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:1.0:1788528625.184260:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1823b577-e6d1-43c4-8232-3cf51fabc1da+13:2403:x1875407719754752:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788528625.184268:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528625.184272:0:17123:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a8fc3428e00/0x892c60dda91c9050 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c00ab expref: 13 pid: 17132 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528625.184281:0:17123:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a8fc3428e00/0x892c60dda91c9050 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c00ab expref: 13 pid: 17132 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528625.184292:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc3428e00/0x892c60dda91c9050 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c00ab expref: 13 pid: 17132 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528625.184303:0:17123:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a8fc26e2a00/0x892c60dda91c90c7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528625.184310:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc26e2a00/0x892c60dda91c90c7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528625.184323:0:17123:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a8fc26e2a00/0x892c60dda91c90c7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528625.184336:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a8fc26e2a00/0x892c60dda91c90c7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528625.184342:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a8fc26e2a00/0x892c60dda91c90c7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528625.184348:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a8fc26e2a00/0x892c60dda91c90c7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528625.184353:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e2a00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528625.184357:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a8fc26e2a00/0x892c60dda91c90c7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528625.184365:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a8fc26e2a00/0x892c60dda91c90c7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528625.184377:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a8fc26e2a00/0x892c60dda91c90c7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528625.184385:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528625.184406:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1823b577-e6d1-43c4-8232-3cf51fabc1da+12:2403:x1875407719754752:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 147us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528625.184414:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 14 00010000:00010000:3.0:1788528625.192502:0:20164:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a8fc26e2a00/0x892c60dda91c90c7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528625.192523:0:20164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a8fc26e2a00/0x892c60dda91c90c7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528625.192544:0:20164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc26e2a00/0x892c60dda91c90c7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528625.348775:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788528625.348797:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735564544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788528625.348875:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528625.348922:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735564544 00000100:00100000:3.0:1788528625.348929:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735564544 00000100:00100000:3.0:1788528625.348988:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788528625.348997:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735564544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788528625.349030:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788528625.349074:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735564544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528625.349081:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788528625.349130:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735564544:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788528625.599374:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528625.854866:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788528625.854889:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735564672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788528625.854955:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528625.855142:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735565184:0@lo:400:kworker.0 00000100:00100000:3.0:1788528625.855178:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528625.855197:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735565696:0@lo:400:kworker.0 00000100:00100000:1.0:1788528625.855206:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735565056:0@lo:400:kworker.0 00000100:00100000:3.0:1788528625.855220:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528625.855237:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735566208:0@lo:400:kworker.0 00000100:00100000:1.0:1788528625.855246:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528625.855270:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528625.855286:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735565568:0@lo:400:kworker.0 00000100:00100000:1.0:1788528625.855315:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528625.855343:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735566080:0@lo:400:kworker.0 00000100:00100000:1.0:1788528625.855364:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528625.855446:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735564672 00000100:00100000:0.0:1788528625.855455:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735564672 00000100:00100000:0.0:1788528625.855507:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788528625.855517:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735564672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788528625.855547:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788528625.855612:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735564672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528625.855618:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788528625.855641:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735564800:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788528625.855667:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528625.855684:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735565312:0@lo:400:kworker.0 00000100:00100000:0.0:1788528625.855703:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528625.855719:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735565824:0@lo:400:kworker.0 00000100:00100000:0.0:1788528625.855737:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528625.855750:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735566336:0@lo:400:kworker.0 00000100:00100000:0.0:1788528625.855766:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528625.855779:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788528625.855786:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:463b8984-c30b-4b73-b2f1-81113bd4e10a:3639:1875407735564928:0@lo:400:kworker.0 00000100:00100000:3.0:1788528625.855796:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735565184 00000100:00100000:3.0:1788528625.855802:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735565184 00000100:00100000:0.0:1788528625.855823:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528625.855837:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735565696 00000100:00100000:3.0:1788528625.855840:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735565696 00000100:00100000:0.0:1788528625.855864:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735565440:0@lo:400:kworker.0 00000100:00100000:3.0:1788528625.855883:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735565056 00000100:00100000:3.0:1788528625.855888:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735565056 00000100:00100000:0.0:1788528625.855893:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528625.855901:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735565568 00000100:00100000:3.0:1788528625.855905:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735565568 00000100:00100000:0.0:1788528625.855912:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1875407735565952:0@lo:400:kworker.0 00000100:00100000:3.0:1788528625.855921:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788528625.855936:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528625.855943:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735565184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528625.855969:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788528625.855979:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735565696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528625.856016:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735565696:12345-0@lo:400:kworker.0 Request processed in 39us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528625.856022:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788528625.856037:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788528625.856043:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735565056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528625.856070:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735565056:12345-0@lo:400:kworker.0 Request processed in 27us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528625.856076:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788528625.856086:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788528625.856092:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735565568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528625.856129:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735565568:12345-0@lo:400:kworker.0 Request processed in 37us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528625.856135:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788528625.856156:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735566208 00000100:00100000:0.0:1788528625.856159:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735566208 00000100:00100000:0.0:1788528625.856178:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735566080 00000100:00100000:0.0:1788528625.856181:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735566080 00000100:00100000:0.0:1788528625.856191:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735565312 00000100:00100000:0.0:1788528625.856193:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735565312 00000100:00100000:0.0:1788528625.856214:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735565824 00000100:00100000:0.0:1788528625.856217:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735565824 00000100:00100000:0.0:1788528625.856229:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735566336 00000100:00100000:0.0:1788528625.856231:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735566336 00000100:00100000:0.0:1788528625.856242:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735565952 00000100:00100000:0.0:1788528625.856244:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735565952 00000100:00100000:0.0:1788528625.856257:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788528625.856262:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735566208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528625.856293:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875407735566208:12345-0@lo:400:kworker.0 Request processed in 30us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528625.856299:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788528625.856310:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788528625.856315:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735566080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528625.856340:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735566080:12345-0@lo:400:kworker.0 Request processed in 25us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528625.856345:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788528625.856356:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788528625.856361:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735565312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528625.856391:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735565312:12345-0@lo:400:kworker.0 Request processed in 29us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528625.856396:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788528625.856407:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788528625.856412:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735565824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528625.856437:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735565824:12345-0@lo:400:kworker.0 Request processed in 25us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528625.856442:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788528625.856453:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788528625.856465:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735566336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528625.856491:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735566336:12345-0@lo:400:kworker.0 Request processed in 27us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528625.856497:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788528625.856509:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788528625.856514:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875407735565952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528625.856539:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875407735565952:12345-0@lo:400:kworker.0 Request processed in 25us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528625.856544:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1788528625.856586:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788528625.856590:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788528625.856592:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788528625.856600:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735565440 00000100:00100000:0.0:1788528625.856603:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735565440 00000100:00100000:0.0:1788528625.856621:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788528625.856626:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735565440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528625.856653:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735565440:12345-0@lo:400:kworker.0 Request processed in 27us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528625.856659:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788528625.856701:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735565440:0@lo:400:kworker.0 00000100:00100000:0.0:1788528625.856711:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1875407735565952:0@lo:400:kworker.0 00000100:00100000:0.0:1788528625.856720:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735565312:0@lo:400:kworker.0 00000100:00100000:0.0:1788528625.856728:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735565824:0@lo:400:kworker.0 00010000:00080000:0.0:1788528625.856740:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3c7e680 x1875407735566336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528625.856761:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735566336:0@lo:400:kworker.0 00000100:00100000:0.0:1788528625.856796:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735565056:0@lo:400:kworker.0 00000100:00100000:0.0:1788528625.856806:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735565568:0@lo:400:kworker.0 00010000:00080000:0.0:1788528625.856815:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc3c7ce00 x1875407735566080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528625.856823:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735566080:0@lo:400:kworker.0 00000100:00100000:0.0:1788528625.856836:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735564672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788528625.856889:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735565184:0@lo:400:kworker.0 00000100:00100000:0.0:1788528625.856900:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735565696:0@lo:400:kworker.0 00000100:00100000:0.0:1788528625.856910:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1875407735566208:0@lo:400:kworker.0 00000100:00100000:1.0:1788528625.857051:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735564800 00000100:00100000:1.0:1788528625.857056:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735564800 00000100:00100000:1.0:1788528625.857084:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788528625.857090:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735564800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788528625.857109:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788528625.857146:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735564800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528625.857151:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788528625.857181:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735564800:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788528625.857574:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735564928 00000100:00100000:2.0:1788528625.857579:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735564928 00000100:00100000:2.0:1788528625.857608:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788528625.857615:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:3639:x1875407735564928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528625.857651:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:3639:x1875407735564928:12345-0@lo:400:kworker.0 Request processed in 36us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528625.857657:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788528625.857862:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:463b8984-c30b-4b73-b2f1-81113bd4e10a:3639:1875407735564928:0@lo:400:kworker.0 00000100:00100000:1.0:1788528625.857875:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788528625.857883:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735566464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788528625.857913:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528625.858217:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735566464 00000100:00100000:2.0:1788528625.858222:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735566464 00000100:00100000:2.0:1788528625.858255:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788528625.858262:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1875407735566464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788528625.858274:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788528625.858315:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1875407735566464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528625.858322:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788528625.858387:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735566464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788528625.861274:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735565184:12345-0@lo:400:kworker.0 Request processed in 61us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528625.861301:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000040:00080000:2.0:1788528626.562365:0:17889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788528626.624535:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528626.698912:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528626.698977:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719754880 00000100:00100000:3.0:1788528626.698988:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719754880 00000100:00100000:3.0:1788528626.699044:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 156 00000100:00100000:3.0:1788528626.699054:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+12:14913:x1875407719754880:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788528626.699070:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528626.699091:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c6c82200/0x892c60dda91c90ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c015a expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528626.699119:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c6c82200/0x892c60dda91c90ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c015a expref: 13 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528626.699130:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c6c82200/0x892c60dda91c90ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c015a expref: 13 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528626.699139:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c6c82200, rc 0) 00000100:00100000:3.0:1788528626.699936:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+13:14913:x1875407719754880:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 875us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528626.699946:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 156 00000100:00100000:2.0:1788528626.707030:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528626.707099:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719755008 00000100:00100000:3.0:1788528626.707115:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719755008 00000100:00100000:3.0:1788528626.707173:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 157 00000100:00100000:3.0:1788528626.707185:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+13:14913:x1875407719755008:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528626.707337:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+13:14913:x1875407719755008:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 154us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528626.707344:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 157 00000100:00100000:0.0:1788528626.722345:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528626.722516:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719755136 00000100:00100000:1.0:1788528626.722526:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719755136 00000100:00100000:1.0:1788528626.722605:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 158 00000100:00100000:1.0:1788528626.722616:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+13:14913:x1875407719755136:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788528626.722927:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+13:14913:x1875407719755136:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 Request processed in 312us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528626.722935:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 158 00000100:00100000:1.0:1788528626.733481:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528626.741020:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719755264 00000100:00100000:0.0:1788528626.741035:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719755264 00000100:00100000:0.0:1788528626.741094:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 159 00000100:00100000:0.0:1788528626.741104:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+13:14913:x1875407719755264:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788528626.741121:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528626.741139:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9101851400/0x892c60dda91c90d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0161 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528626.741182:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101851400/0x892c60dda91c90d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0161 expref: 14 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528626.741194:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9101851400/0x892c60dda91c90d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0161 expref: 14 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528626.741205:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101851400, rc 0) 00000100:00100000:0.0:1788528626.741273:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+14:14913:x1875407719755264:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 169us (7800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528626.741281:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 159 00000100:00100000:2.0:1788528626.743594:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528626.743667:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719755392 00000100:00100000:3.0:1788528626.743675:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719755392 00000100:00100000:3.0:1788528626.743728:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 160 00000100:00100000:3.0:1788528626.743737:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+14:14913:x1875407719755392:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528626.743883:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+14:14913:x1875407719755392:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 146us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528626.743892:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 160 00000100:00100000:2.0:1788528626.746908:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528626.746941:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719755520 00000100:00100000:2.0:1788528626.746951:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719755520 00000100:00100000:2.0:1788528626.747001:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 161 00000100:00100000:2.0:1788528626.747011:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1823b577-e6d1-43c4-8232-3cf51fabc1da+14:14913:x1875407719755520:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788528626.747127:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1823b577-e6d1-43c4-8232-3cf51fabc1da+14:14913:x1875407719755520:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 Request processed in 117us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528626.747135:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 161 10000000:01000000:3.0:1788528627.072443:0:17134:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:3.0:1788528627.072452:0:17134:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a90c81b5800 from 13 10000000:01000000:3.0:1788528627.072457:0:17134:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788528627.072499:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c6c82600/0x892c60dda91c90dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528627.072510:0:17134:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c6c82600/0x892c60dda91c90dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528627.072522:0:17134:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c6c82600/0x892c60dda91c90dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528627.072545:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735566592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788528627.072644:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528627.072677:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d93000 going to sleep for 11 seconds 00000100:00100000:0.0:1788528627.072822:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735566592 00000100:00100000:0.0:1788528627.072829:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735566592 00000100:00100000:0.0:1788528627.072881:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788528627.072889:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:17134:x1875407735566592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788528627.072901:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528627.072915:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9101851200/0x892c60dda91c90e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c90dc expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528627.072936:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101851200/0x892c60dda91c90e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c90dc expref: 24 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528627.072947:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9101851200/0x892c60dda91c90e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c90dc expref: 24 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528627.072956:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101851200, rc 0) 00000100:00100000:0.0:1788528627.073006:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+24:17134:x1875407735566592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528627.073022:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788528627.073066:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735566592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788528627.073080:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c6c82600/0x892c60dda91c90dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c90e3 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528627.073089:0:17134:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c6c82600/0x892c60dda91c90dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c90e3 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788528627.073247:0:17134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 13 count 13 00000040:00080000:0.0:1788528627.073538:0:17134:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788528627.073862:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].1, 224 off8416 00000040:00080000:0.0:1788528627.073885:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].2, 112 off8528 00000040:00080000:0.0:1788528627.073896:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].3, 224 off8752 00000040:00080000:0.0:1788528627.073906:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].4, 224 off8976 00000040:00080000:0.0:1788528627.073917:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].5, 112 off9088 00000040:00080000:0.0:1788528627.073927:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].6, 224 off9312 00000040:00080000:0.0:1788528627.073950:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].7, 224 off9536 00000040:00080000:0.0:1788528627.074022:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].8, 128 off9664 00000040:00080000:0.0:1788528627.074039:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].9, 224 off9888 00000040:00080000:0.0:1788528627.074053:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].10, 224 off10112 00000040:00080000:0.0:1788528627.074069:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].11, 128 off10240 00000040:00080000:0.0:1788528627.074087:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].12, 224 off10464 00000040:00080000:0.0:1788528627.074092:0:17134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 12 count 13 00000100:00100000:0.0:1788528627.074154:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735566720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788528627.074195:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528627.074231:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c6c8f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788528627.074252:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735566720 00000100:00100000:0.0:1788528627.074257:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735566720 00000100:00100000:0.0:1788528627.074287:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788528627.074302:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+24:17134:x1875407735566720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788528627.074390:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+24:17134:x1875407735566720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528627.074398:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788528627.074435:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735566720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788528627.074461:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735566848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788528627.074499:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528627.074513:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c6c8f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788528627.074524:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735566848 00000100:00100000:0.0:1788528627.074527:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735566848 00000100:00100000:0.0:1788528627.074546:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788528627.074578:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+24:17134:x1875407735566848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788528627.074652:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+24:17134:x1875407735566848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528627.074659:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788528627.074700:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735566848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788528627.080353:0:17134:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788528627.080456:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735566976:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788528627.080545:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528627.081254:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c6c8f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788528627.086087:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735566976 00000100:00100000:1.0:1788528627.086102:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735566976 00000100:00100000:1.0:1788528627.086207:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788528627.086217:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+24:17134:x1875407735566976:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788528627.086401:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+24:17134:x1875407735566976:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 185us (5856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528627.086409:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788528627.086489:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735566976:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788528627.086741:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].1, 224 off8416 00000040:00080000:2.0:1788528627.086776:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].2, 112 off8528 00000040:00080000:2.0:1788528627.086790:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].3, 224 off8752 00000040:00080000:2.0:1788528627.086802:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].4, 224 off8976 00000040:00080000:2.0:1788528627.086815:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].5, 112 off9088 00000040:00080000:2.0:1788528627.086829:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].6, 224 off9312 00000040:00080000:2.0:1788528627.086854:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].7, 224 off9536 00000040:00080000:2.0:1788528627.086871:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].8, 128 off9664 00000040:00080000:2.0:1788528627.086884:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].9, 224 off9888 00000040:00080000:2.0:1788528627.086896:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].10, 224 off10112 00000040:00080000:2.0:1788528627.086907:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].11, 128 off10240 00000100:00100000:2.0:1788528627.086942:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735567104:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788528627.088973:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528627.093486:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de6c5840 going to sleep for 11 seconds 00000100:00100000:0.0:1788528627.097346:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735567104 00000100:00100000:0.0:1788528627.097359:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735567104 00000100:00100000:3.0:1788528627.097500:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788528627.097510:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+24:17134:x1875407735567104:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788528627.097717:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+24:17134:x1875407735567104:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 207us (8756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528627.097725:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788528627.097921:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735567104:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788528627.098106:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].12, 224 off10464 00000040:00080000:0.0:1788528627.098129:0:17134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000040:00080000:0.0:1788528627.101805:0:20233:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 64768 count 13 00000020:01000000:3.0:1788528627.102429:0:17134:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788528627.102446:0:17134:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788528627.102459:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c6c82600/0x892c60dda91c90dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c90e3 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528627.102471:0:17134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c6c82600/0x892c60dda91c90dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c90e3 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528627.102486:0:17134:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:3.0:1788528627.102489:0:17134:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a90fe6bc000 from 13 10000000:01000000:3.0:1788528627.102491:0:17134:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788528627.102530:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83e00/0x892c60dda91c90ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528627.102537:0:17134:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83e00/0x892c60dda91c90ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528627.102548:0:17134:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83e00/0x892c60dda91c90ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528627.102608:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735567232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788528627.102670:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528627.102805:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d93540 going to sleep for 11 seconds 00000100:00100000:1.0:1788528627.103203:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735567232 00000100:00100000:1.0:1788528627.103211:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735567232 00000100:00100000:1.0:1788528627.103262:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788528627.103272:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+24:17134:x1875407735567232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788528627.103285:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528627.103298:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c14abe00/0x892c60dda91c90f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c90ea expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528627.103321:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c14abe00/0x892c60dda91c90f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c90ea expref: 25 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528627.103333:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c14abe00/0x892c60dda91c90f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c90ea expref: 25 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528627.103342:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c14abe00, rc 0) 00000100:00100000:1.0:1788528627.103381:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+25:17134:x1875407735567232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528627.103388:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788528627.103688:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735567232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788528627.103781:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83e00/0x892c60dda91c90ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c90f1 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528627.103791:0:17134:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83e00/0x892c60dda91c90ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c90f1 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788528627.103957:0:17134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 13 count 13 00000040:00080000:3.0:1788528627.104295:0:17134:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788528627.104470:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].1, 224 off8416 00000040:00080000:3.0:1788528627.104497:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].2, 112 off8528 00000040:00080000:3.0:1788528627.104513:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].3, 224 off8752 00000040:00080000:3.0:1788528627.104527:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].4, 224 off8976 00000040:00080000:3.0:1788528627.104542:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].5, 112 off9088 00000040:00080000:3.0:1788528627.104810:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].6, 224 off9312 00000040:00080000:3.0:1788528627.104830:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].7, 224 off9536 00000040:00080000:3.0:1788528627.104859:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].8, 128 off9664 00000040:00080000:3.0:1788528627.104875:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].9, 224 off9888 00000040:00080000:3.0:1788528627.104887:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].10, 224 off10112 00000040:00080000:3.0:1788528627.104899:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].11, 128 off10240 00000040:00080000:3.0:1788528627.104917:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].12, 224 off10464 00000040:00080000:3.0:1788528627.104922:0:17134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 12 count 13 00000100:00100000:3.0:1788528627.105062:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735567360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528627.105113:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528627.105152:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d93540 going to sleep for 11 seconds 00000100:00100000:3.0:1788528627.105175:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735567360 00000100:00100000:3.0:1788528627.105180:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735567360 00000100:00100000:3.0:1788528627.105222:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788528627.105230:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+25:17134:x1875407735567360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528627.105338:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+25:17134:x1875407735567360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528627.105346:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788528627.105384:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735567360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528627.105410:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735567488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788528627.105448:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528627.105461:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d93540 going to sleep for 11 seconds 00000100:00100000:3.0:1788528627.105473:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735567488 00000100:00100000:3.0:1788528627.105476:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735567488 00000100:00100000:3.0:1788528627.105493:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788528627.105499:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+25:17134:x1875407735567488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788528627.105598:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+25:17134:x1875407735567488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528627.105605:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788528627.105644:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735567488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788528627.106213:0:17134:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788528627.106268:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735567616:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788528627.106308:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528627.106369:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d93540 going to sleep for 11 seconds 00000100:00100000:2.0:1788528627.109902:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735567616 00000100:00100000:2.0:1788528627.109916:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735567616 00000100:00100000:3.0:1788528627.128142:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788528627.128156:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc1d03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+25:17134:x1875407735567616:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788528627.128330:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc1d03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+25:17134:x1875407735567616:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 177us (22020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528627.128338:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788528627.128409:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735567616:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788528627.128641:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].1, 224 off8416 00000040:00080000:3.0:1788528627.128670:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].2, 112 off8528 00000040:00080000:3.0:1788528627.128683:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].3, 224 off8752 00000040:00080000:3.0:1788528627.128696:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].4, 224 off8976 00000040:00080000:3.0:1788528627.130886:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].5, 112 off9088 00000040:00080000:3.0:1788528627.130922:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].6, 224 off9312 00000040:00080000:3.0:1788528627.130936:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].7, 224 off9536 00000040:00080000:3.0:1788528627.130983:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].8, 128 off9664 00000040:00080000:3.0:1788528627.130999:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].9, 224 off9888 00000040:00080000:3.0:1788528627.131011:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].10, 224 off10112 00000040:00080000:3.0:1788528627.131025:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].11, 128 off10240 00000100:00100000:3.0:1788528627.131070:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735567744:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788528627.131141:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528627.131185:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d93540 going to sleep for 11 seconds 00000100:00100000:1.0:1788528627.133934:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735567744 00000100:00100000:1.0:1788528627.133948:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735567744 00000100:00100000:1.0:1788528627.134015:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788528627.134025:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+25:17134:x1875407735567744:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788528627.134199:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+25:17134:x1875407735567744:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 175us (3056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528627.134207:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788528627.134613:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735567744:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788528627.134719:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].12, 224 off10464 00000040:00080000:2.0:1788528627.134734:0:17134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000040:00080000:0.0:1788528627.136304:0:20235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 64768 count 13 00000020:01000000:2.0:1788528627.137384:0:17134:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788528627.137399:0:17134:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788528627.137410:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83e00/0x892c60dda91c90ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c90f1 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528627.137421:0:17134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83e00/0x892c60dda91c90ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c90f1 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528627.137436:0:17134:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:2.0:1788528627.137439:0:17134:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a90f6c03000 from 13 10000000:01000000:2.0:1788528627.137442:0:17134:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788528627.137479:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c90f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528627.137487:0:17134:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c90f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528627.137496:0:17134:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c90f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528627.137518:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6feea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735567872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788528627.143103:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528627.143157:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de6c5900 going to sleep for 11 seconds 00000100:00100000:2.0:1788528627.143215:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735567872 00000100:00100000:2.0:1788528627.143224:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735567872 00000100:00100000:2.0:1788528627.143279:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788528627.143289:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+25:17134:x1875407735567872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528627.143305:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528627.143322:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc26e3a00/0x892c60dda91c90ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c90f8 expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528627.143349:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc26e3a00/0x892c60dda91c90ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c90f8 expref: 26 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528627.143369:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc26e3a00/0x892c60dda91c90ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c90f8 expref: 26 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528627.143379:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e3a00, rc 0) 00000100:00100000:2.0:1788528627.143426:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+26:17134:x1875407735567872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528627.143433:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788528627.143514:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6feea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735567872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788528627.143531:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c90f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c90ff expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528627.143540:0:17134:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c90f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c90ff expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788528627.143694:0:17134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 13 count 13 00000040:00080000:3.0:1788528627.144246:0:17134:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788528627.144414:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].1, 224 off8416 00000040:00080000:3.0:1788528627.144439:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].2, 112 off8528 00000040:00080000:3.0:1788528627.144465:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].3, 224 off8752 00000040:00080000:3.0:1788528627.144481:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].4, 224 off8976 00000040:00080000:3.0:1788528627.144501:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].5, 112 off9088 00000040:00080000:3.0:1788528627.144513:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].6, 224 off9312 00000040:00080000:3.0:1788528627.144523:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].7, 224 off9536 00000040:00080000:3.0:1788528627.144536:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].8, 128 off9664 00000040:00080000:3.0:1788528627.144547:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].9, 224 off9888 00000040:00080000:3.0:1788528627.147694:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].10, 224 off10112 00000040:00080000:3.0:1788528627.147862:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].11, 128 off10240 00000040:00080000:3.0:1788528627.147894:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].12, 224 off10464 00000040:00080000:3.0:1788528627.147900:0:17134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 12 count 13 00000100:00100000:3.0:1788528627.148077:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735568000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528627.148144:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528627.148239:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d93540 going to sleep for 11 seconds 00000100:00100000:2.0:1788528627.154194:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735568000 00000100:00100000:2.0:1788528627.154209:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735568000 00000100:00100000:3.0:1788528627.157807:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788528627.157889:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+26:17134:x1875407735568000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528627.158271:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+26:17134:x1875407735568000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 451us (10125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528627.158279:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788528627.158970:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735568000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528627.159032:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735568128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788528627.159095:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528627.159136:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de6c5900 going to sleep for 11 seconds 00000100:00100000:1.0:1788528627.159192:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735568128 00000100:00100000:1.0:1788528627.159199:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735568128 00000100:00100000:1.0:1788528627.159244:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788528627.159252:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+26:17134:x1875407735568128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788528627.159334:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+26:17134:x1875407735568128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528627.159342:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788528627.167232:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735568128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788528627.167693:0:17134:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788528627.167806:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735568256:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788528627.167885:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528627.167928:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de6c5900 going to sleep for 11 seconds 00000100:00100000:3.0:1788528627.168249:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735568256 00000100:00100000:3.0:1788528627.168257:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735568256 00000100:00100000:3.0:1788528627.168310:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788528627.168321:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+26:17134:x1875407735568256:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788528627.168423:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+26:17134:x1875407735568256:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 103us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528627.168431:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788528627.168515:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735568256:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788528627.168752:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].1, 224 off8416 00000040:00080000:2.0:1788528627.168779:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].2, 112 off8528 00000040:00080000:2.0:1788528627.168794:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].3, 224 off8752 00000040:00080000:2.0:1788528627.168807:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].4, 224 off8976 00000040:00080000:2.0:1788528627.168820:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].5, 112 off9088 00000040:00080000:2.0:1788528627.168832:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].6, 224 off9312 00000040:00080000:2.0:1788528627.168870:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].7, 224 off9536 00000040:00080000:2.0:1788528627.168882:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].8, 128 off9664 00000040:00080000:2.0:1788528627.168894:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].9, 224 off9888 00000040:00080000:2.0:1788528627.168907:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].10, 224 off10112 00000040:00080000:2.0:1788528627.168920:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].11, 128 off10240 00000100:00100000:2.0:1788528627.168944:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735568384:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788528627.169107:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528627.169129:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de6c5900 going to sleep for 11 seconds 00000100:00100000:3.0:1788528627.169210:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735568384 00000100:00100000:3.0:1788528627.169216:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735568384 00000100:00100000:3.0:1788528627.169251:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788528627.169259:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+26:17134:x1875407735568384:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788528627.169341:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+26:17134:x1875407735568384:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 83us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528627.169347:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788528627.169435:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735568384:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788528627.169474:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].12, 224 off10464 00000040:00080000:2.0:1788528627.169482:0:17134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000040:00080000:2.0:1788528627.174534:0:20238:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 64768 count 13 00000020:01000000:3.0:1788528627.184051:0:17134:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788528627.184074:0:17134:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788528627.184086:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c90f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c90ff expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528627.184099:0:17134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c90f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c90ff expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528627.184111:0:17134:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:3.0:1788528627.184113:0:17134:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a8fc477d800 from 13 10000000:01000000:3.0:1788528627.184117:0:17134:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788528627.184154:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83a00/0x892c60dda91c9106 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528627.184163:0:17134:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83a00/0x892c60dda91c9106 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528627.184173:0:17134:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83a00/0x892c60dda91c9106 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528627.184198:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735568512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788528627.184265:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528627.184309:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c2d793c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528627.184372:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735568512 00000100:00100000:1.0:1788528627.184381:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735568512 00000100:00100000:1.0:1788528627.184430:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788528627.184440:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+26:17134:x1875407735568512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788528627.184453:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528627.184465:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c14aa400/0x892c60dda91c910d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c9106 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528627.184487:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c14aa400/0x892c60dda91c910d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c9106 expref: 27 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528627.184498:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c14aa400/0x892c60dda91c910d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c9106 expref: 27 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528627.184507:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c14aa400, rc 0) 00000100:00100000:1.0:1788528627.184615:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:17134:x1875407735568512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528627.184634:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788528627.184809:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735568512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788528627.184824:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83a00/0x892c60dda91c9106 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c910d expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528627.184833:0:17134:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83a00/0x892c60dda91c9106 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c910d expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528627.184882:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735568640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788528627.184911:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528627.184941:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c6c8f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528627.185105:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735568640 00000100:00100000:1.0:1788528627.185110:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735568640 00000100:00100000:1.0:1788528627.185143:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788528627.185151:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:17134:x1875407735568640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788528627.185256:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:17134:x1875407735568640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528627.185263:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788528627.185293:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735568640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788528627.185322:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735568768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788528627.185360:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528627.185376:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c2afd600 going to sleep for 11 seconds 00000100:00100000:1.0:1788528627.185387:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735568768 00000100:00100000:1.0:1788528627.185390:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735568768 00000100:00100000:1.0:1788528627.185409:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788528627.185414:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:17134:x1875407735568768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788528627.185486:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:17134:x1875407735568768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528627.185492:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788528627.185529:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:463b8984-c30b-4b73-b2f1-81113bd4e10a:17134:1875407735568768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788528627.201871:0:20239:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788528627.201939:0:17134:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788528627.201952:0:17134:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788528627.202028:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83a00/0x892c60dda91c9106 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c910d expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528627.202052:0:17134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83a00/0x892c60dda91c9106 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c910d expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528627.651962:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528627.909382:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528627.909432:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528627.909464:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528627.909495:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528627.909522:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528627.909542:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719755904 00000100:00100000:1.0:1788528627.909548:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528627.909587:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719755904 00000100:00100000:1.0:1788528627.909611:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528627.909649:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528627.909663:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719756416 00000100:00100000:0.0:1788528627.909668:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719756416 00000100:00100000:1.0:1788528627.909672:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719755776 00000100:00100000:1.0:1788528627.909677:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719755776 00000100:00100000:0.0:1788528627.909691:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719756288 00000100:00100000:0.0:1788528627.909696:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719756288 00000100:00100000:1.0:1788528627.909710:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:2.0:1788528627.909773:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719755648 00000100:00100000:2.0:1788528627.909778:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719755648 00000100:00100000:2.0:1788528627.909811:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 180 00000100:00100000:2.0:1788528627.909819:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+14:2403:x1875407719755648:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528627.909897:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+14:2403:x1875407719755648:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 79us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528627.909905:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 180 00000100:00100000:3.0:1788528627.910115:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719756160 00000100:00100000:3.0:1788528627.910121:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719756160 00000100:00100000:3.0:1788528627.910149:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719756672 00000100:00100000:3.0:1788528627.910166:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719756672 00000100:00100000:3.0:1788528627.910192:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719756032 00000100:00100000:3.0:1788528627.910195:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719756032 00000100:00100000:3.0:1788528627.910209:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:3.0:1788528627.910217:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2403:x1875407719756160:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528627.910265:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2403:x1875407719756160:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 49us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528627.910272:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:3.0:1788528627.910287:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:3.0:1788528627.910293:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dc02331c-9cea-4afd-8708-cba407bdbca8+5:2403:x1875407719756672:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528627.910317:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dc02331c-9cea-4afd-8708-cba407bdbca8+5:2403:x1875407719756672:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 24us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528627.910322:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:3.0:1788528627.910332:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:3.0:1788528627.910338:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c6f9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2403:x1875407719756032:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528627.910360:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c6f9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2403:x1875407719756032:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 22us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528627.910365:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:3.0:1788528627.910514:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528627.910633:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719756544 00000100:00100000:3.0:1788528627.910637:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719756544 00000100:00100000:3.0:1788528627.910658:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:3.0:1788528627.910664:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dc02331c-9cea-4afd-8708-cba407bdbca8+5:2403:x1875407719756544:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528627.910687:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2403:x1875407719755904:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528627.910700:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dc02331c-9cea-4afd-8708-cba407bdbca8+5:2403:x1875407719756544:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 34us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528627.910717:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:1.0:1788528627.910728:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2403:x1875407719755904:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 1007us (1293us total) trans 0 rc 0/0 00000100:00080000:3.0:1788528627.911785:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788528627.911792:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788528627.911795:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788528627.911797:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788528627.916765:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:0.0:1788528627.916789:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dc02331c-9cea-4afd-8708-cba407bdbca8+5:2403:x1875407719756416:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528627.916899:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dc02331c-9cea-4afd-8708-cba407bdbca8+5:2403:x1875407719756416:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 122us (7403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528627.916907:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:0.0:1788528627.916927:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:0.0:1788528627.916935:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+6:2403:x1875407719755776:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528627.916979:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+6:2403:x1875407719755776:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 46us (7432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528627.916986:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:0.0:1788528627.917001:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 55 00000100:00100000:0.0:1788528627.917008:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dc02331c-9cea-4afd-8708-cba407bdbca8+6:2403:x1875407719756288:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528627.917046:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dc02331c-9cea-4afd-8708-cba407bdbca8+6:2403:x1875407719756288:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 25us (7383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528627.917053:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 55 00000100:00100000:1.0:1788528627.926264:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 52 00010000:00010000:0.0:1788528628.670851:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528629.111609:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528629.112007:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719756800 00000100:00100000:0.0:1788528629.112018:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719756800 00000100:00100000:0.0:1788528629.112112:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:0.0:1788528629.112125:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+6:15582:x1875407719756800:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788528629.112145:0:19473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528629.112169:0:19473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c9114 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0168 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.112699:0:19473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c911b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.112715:0:19473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c911b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.112729:0:19473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c911b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.112744:0:19473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c9122 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.112765:0:19473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c9122 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.112773:0:19473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c9122 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.112864:0:19473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851800/0x892c60dda91c9129 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.112874:0:19473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851800/0x892c60dda91c9129 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.112880:0:19473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851800/0x892c60dda91c9129 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788528629.112910:0:19473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788528629.112914:0:19473:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788528629.112952:0:19473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851800/0x892c60dda91c9129 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.112963:0:19473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c911b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.112970:0:19473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c911b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.112977:0:19473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c911b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.112983:0:19473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528629.112987:0:19473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c911b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.113001:0:19473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c911b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.113013:0:19473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c87bee00) 00010000:00010000:0.0:1788528629.113016:0:19473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528629.113022:0:19473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c911b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.113028:0:19473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c911b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.113041:0:19473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c9122 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.113048:0:19473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c9122 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.113054:0:19473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c9122 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.113059:0:19473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850a00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528629.113061:0:19473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c9122 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.113067:0:19473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c9122 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.113073:0:19473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8a90c87be000) 00010000:00010000:0.0:1788528629.113075:0:19473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528629.113078:0:19473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c9122 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.113094:0:19473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c9122 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.113131:0:19473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c9114 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0168 expref: 8 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.113145:0:19473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851800/0x892c60dda91c9129 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0168 expref: 7 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.113152:0:19473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:0.0:1788528629.113154:0:19473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788528629.113157:0:19473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101851800, rc 0) 00000100:00080000:3.0:1788528629.113412:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788528629.114502:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+7:15582:x1875407719756800:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 2372us (2896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528629.114513:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:3.0:1788528629.124397:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528629.124469:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719756928 00000100:00100000:2.0:1788528629.124480:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719756928 00000100:00100000:2.0:1788528629.124549:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:2.0:1788528629.124589:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bd1383c0-cb68-4d87-bd29-af707cf13abe+7:15582:x1875407719756928:12345-192.168.203.38@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788528629.124682:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bd1383c0-cb68-4d87-bd29-af707cf13abe+7:15582:x1875407719756928:12345-192.168.203.38@tcp:900:lhsmtool_posix.0 Request processed in 96us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528629.124690:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:3.0:1788528629.129120:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528629.129228:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719757184 00000100:00100000:2.0:1788528629.129250:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719757184 00000100:00100000:2.0:1788528629.129320:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:2.0:1788528629.129331:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+7:15582:x1875407719757184:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788528629.129363:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528629.129387:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2c00/0x892c60dda91c9130 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c016f expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.129474:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c9137 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.129487:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c9137 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.129498:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c9137 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.129547:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2e00/0x892c60dda91c913e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.129584:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2e00/0x892c60dda91c913e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.129592:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2e00/0x892c60dda91c913e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.130977:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2400/0x892c60dda91c9145 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.130997:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2400/0x892c60dda91c9145 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.131006:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2400/0x892c60dda91c9145 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528629.131031:0:17139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788528629.131205:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c9137 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.131214:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c9137 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.131221:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c9137 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.131227:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e3000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528629.131232:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c9137 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.131240:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c9137 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.131252:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:2.0:1788528629.131255:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528629.131260:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c9137 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.131267:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c9137 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.131280:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2e00/0x892c60dda91c913e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.131286:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2e00/0x892c60dda91c913e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.131301:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2e00/0x892c60dda91c913e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.131306:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e2e00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528629.131309:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2e00/0x892c60dda91c913e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.131315:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2e00/0x892c60dda91c913e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.131322:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8a8fc27f0a00) 00010000:00010000:2.0:1788528629.131324:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528629.131327:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2e00/0x892c60dda91c913e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.131332:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2e00/0x892c60dda91c913e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528629.144652:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2c00/0x892c60dda91c9130 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c016f expref: 10 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528629.144682:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2400/0x892c60dda91c9145 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c016f expref: 9 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528629.144705:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a8fc27f0d00) 00010000:00010000:3.0:1788528629.144708:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528629.144711:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e2400, rc 0) 00000100:00100000:3.0:1788528629.144784:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+9:15582:x1875407719757184:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 15454us (15672us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788528629.144793:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:3.0:1788528629.155613:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528629.155722:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719757312 00000100:00100000:1.0:1788528629.155731:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719757312 00000100:00100000:1.0:1788528629.155778:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:1.0:1788528629.155786:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+9:15582:x1875407719757312:12345-192.168.203.38@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788528629.155898:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+9:15582:x1875407719757312:12345-192.168.203.38@tcp:59:lhsmtool_posix.0 Request processed in 112us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528629.155924:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:2.0:1788528629.160660:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528629.160760:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719757440 00000100:00100000:1.0:1788528629.160770:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719757440 00000100:00100000:1.0:1788528629.160855:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:1.0:1788528629.160865:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:15582:x1875407719757440:12345-192.168.203.38@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1788528629.162443:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1788528629.164602:0:17137:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3685us 00000100:00100000:0.0:1788528629.207843:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:15582:x1875407719757440:12345-192.168.203.38@tcp:59:lhsmtool_posix.0 Request processed in 46958us (47170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528629.207857:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:2.0:1788528629.218012:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528629.218104:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719757568 00000100:00100000:1.0:1788528629.218115:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719757568 00000100:00100000:1.0:1788528629.218179:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:1.0:1788528629.218190:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+9:15588:x1875407719757568:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1788528629.218210:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528629.218232:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aa000/0x892c60dda91c9153 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0176 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.218305:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c915a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.218323:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c915a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.218336:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c915a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.218350:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14ab400/0x892c60dda91c9161 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.218358:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14ab400/0x892c60dda91c9161 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.218363:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14ab400/0x892c60dda91c9161 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.218427:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c915a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.218434:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c915a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.218440:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c915a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.218446:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c14aba00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528629.218450:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c915a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.218457:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c915a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.218470:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c87bee00) 00010000:00010000:1.0:1788528629.218473:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528629.218479:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c915a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.218484:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c915a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.218498:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14ab400/0x892c60dda91c9161 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.218505:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14ab400/0x892c60dda91c9161 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.218510:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14ab400/0x892c60dda91c9161 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.218522:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c14ab400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528629.218526:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14ab400/0x892c60dda91c9161 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.218532:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14ab400/0x892c60dda91c9161 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.218543:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a90c82d0900) 00010000:00010000:1.0:1788528629.218546:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528629.218549:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14ab400/0x892c60dda91c9161 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.218589:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14ab400/0x892c60dda91c9161 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.218619:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aa000/0x892c60dda91c9153 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0176 expref: 10 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.218629:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c87bee00) 00010000:00010000:1.0:1788528629.218631:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528629.218635:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aa000/0x892c60dda91c9153 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0176 expref: 10 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.218644:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c14aa000, rc 0) 00000100:00100000:1.0:1788528629.218695:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+9:15588:x1875407719757568:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 508us (694us total) trans 0 rc 301/301 00000100:00100000:1.0:1788528629.218702:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:0.0:1788528629.227670:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528629.227804:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719757696 00000100:00100000:2.0:1788528629.227815:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719757696 00000100:00100000:2.0:1788528629.227877:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:2.0:1788528629.227888:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bd1383c0-cb68-4d87-bd29-af707cf13abe+9:15588:x1875407719757696:12345-192.168.203.38@tcp:700:lfs.0 00000100:00100000:2.0:1788528629.227974:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bd1383c0-cb68-4d87-bd29-af707cf13abe+9:15588:x1875407719757696:12345-192.168.203.38@tcp:700:lfs.0 Request processed in 88us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528629.227982:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:2.0:1788528629.240223:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528629.242074:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719757952 00000100:00100000:3.0:1788528629.242088:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719757952 00000100:00100000:3.0:1788528629.242152:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:3.0:1788528629.242163:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+9:15588:x1875407719757952:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:3.0:1788528629.242235:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528629.242264:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c907a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c00dc expref: 9 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528629.242284:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c87bee00) 00010000:00010000:3.0:1788528629.242290:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788528629.242351:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83c00/0x892c60dda91c9168 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528629.242364:0:17139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c90c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0153 expref: 5 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528629.242373:0:17139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83c00/0x892c60dda91c9168 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528629.242408:0:17139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c90c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0153 expref: 5 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528629.242422:0:17139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c90c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0153 expref: 5 pid: 17138 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528629.242436:0:17139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17139:1875407735568896:192.168.203.38@tcp:104: 00000100:00100000:3.0:1788528629.242587:0:17139:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c2d79f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788528629.255603:0:17139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17139:1875407735568896:192.168.203.38@tcp:104: 00010000:00010000:3.0:1788528629.255633:0:17139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83c00/0x892c60dda91c9168 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528629.261606:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528629.261812:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719758080 00000100:00100000:1.0:1788528629.261846:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719758080 00010000:00010000:1.0:1788528629.261900:0:17123:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c90c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0153 expref: 6 pid: 17138 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528629.261949:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:1.0:1788528629.261959:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc02331c-9cea-4afd-8708-cba407bdbca8+6:2404:x1875407719758080:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788528629.261974:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528629.261980:0:17123:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c90c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0153 expref: 6 pid: 17138 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.261993:0:17123:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c90c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0153 expref: 6 pid: 17138 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.262015:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c90c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0153 expref: 6 pid: 17138 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.262030:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c87bee00) 00010000:00010000:1.0:1788528629.262036:0:17123:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83c00/0x892c60dda91c9168 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.262045:0:17123:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83c00/0x892c60dda91c9168 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.262051:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83c00/0x892c60dda91c9168 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.262083:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528629.262133:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc02331c-9cea-4afd-8708-cba407bdbca8+5:2404:x1875407719758080:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 175us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528629.262149:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 15 00010000:00010000:2.0:1788528629.262284:0:17139:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83c00/0x892c60dda91c9168 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.262292:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83c00/0x892c60dda91c9168 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.262316:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3200/0x892c60dda91c916f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.262326:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3200/0x892c60dda91c916f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.262334:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3200/0x892c60dda91c916f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788528629.263860:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788528629.264779:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3600/0x892c60dda91c9176 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.264798:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3600/0x892c60dda91c9176 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.264808:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3600/0x892c60dda91c9176 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788528629.264834:0:17139:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e53a4afe reply state 00000000ca4e58ba transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3600/0x892c60dda91c9176 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.264846:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3600/0x892c60dda91c9176 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.264853:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a8fc27f0200) 00010000:00010000:2.0:1788528629.264856:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788528629.264865:0:17139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788528629.264871:0:17139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788528629.264879:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83c00/0x892c60dda91c9168 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.264886:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83c00/0x892c60dda91c9168 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.264893:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83c00/0x892c60dda91c9168 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.264899:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c6c83c00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528629.264903:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83c00/0x892c60dda91c9168 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.264911:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83c00/0x892c60dda91c9168 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.264920:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c87bee00) 00010000:00010000:2.0:1788528629.264922:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528629.264925:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83c00/0x892c60dda91c9168 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.264931:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83c00/0x892c60dda91c9168 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788528629.264952:0:17139:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e53a4afe reply state 00000000ca4e58ba transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3200/0x892c60dda91c916f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.264960:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3200/0x892c60dda91c916f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.264965:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a8fc27f0a00) 00010000:00010000:2.0:1788528629.264971:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788528629.264973:0:17139:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788528629.265062:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+10:15588:x1875407719757952:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 22898us (24845us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788528629.265070:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:2.0:1788528629.432026:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528629.432105:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719758208 00000100:00100000:1.0:1788528629.432117:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719758208 00000100:00100000:1.0:1788528629.432180:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 29 00000100:00100000:1.0:1788528629.432191:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+10:15596:x1875407719758208:12345-192.168.203.38@tcp:101:lctl.0 00010000:00010000:1.0:1788528629.432215:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528629.432236:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c917d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c017d expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.432301:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aa000/0x892c60dda91c9184 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.432315:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aa000/0x892c60dda91c9184 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.432326:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aa000/0x892c60dda91c9184 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528629.432381:0:17138:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788528629.432385:0:17138:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788528629.432526:0:17138:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aa000/0x892c60dda91c9184 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.432551:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c917d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c017d expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.432597:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aa000/0x892c60dda91c9184 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c017d expref: 11 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.432623:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c82d0900) 00010000:00010000:1.0:1788528629.432626:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788528629.432630:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c14aa000, rc 0) 00000100:00100000:1.0:1788528629.432723:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+11:15596:x1875407719758208:12345-192.168.203.38@tcp:101:lctl.0 Request processed in 534us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528629.432730:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 29 00000100:00100000:0.0:1788528629.504919:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528629.505067:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719758336 00000100:00100000:1.0:1788528629.505077:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719758336 00000100:00100000:1.0:1788528629.505143:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:1.0:1788528629.505152:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dc02331c-9cea-4afd-8708-cba407bdbca8+5:15597:x1875407719758336:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1788528629.505173:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528629.505194:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c918b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0184 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.505261:0:17137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14ab400/0x892c60dda91c9192 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.505275:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14ab400/0x892c60dda91c9192 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.505285:0:17137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14ab400/0x892c60dda91c9192 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528629.505328:0:17137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788528629.505332:0:17137:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788528629.505354:0:17137:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14ab400/0x892c60dda91c9192 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.505643:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c918b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0184 expref: 7 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.505663:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14ab400/0x892c60dda91c9192 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0184 expref: 6 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.505672:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c82d0900) 00010000:00010000:1.0:1788528629.505674:0:17137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788528629.505678:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c14ab400, rc 0) 00000100:00100000:1.0:1788528629.505744:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dc02331c-9cea-4afd-8708-cba407bdbca8+6:15597:x1875407719758336:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 592us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528629.505753:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:2.0:1788528629.510921:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528629.511260:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719758464 00000100:00100000:0.0:1788528629.511270:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719758464 00000100:00100000:0.0:1788528629.511318:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 31 00000100:00100000:0.0:1788528629.511326:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dc02331c-9cea-4afd-8708-cba407bdbca8+6:15597:x1875407719758464:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1788528629.511346:0:19473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528629.511385:0:19473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c9199 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c018b expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.511451:0:19473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c91a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.511465:0:19473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c91a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.511475:0:19473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c91a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.511485:0:19473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c91a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.511492:0:19473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c91a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.511498:0:19473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c91a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.511580:0:19473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c91ae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.511588:0:19473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c91ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.511594:0:19473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c91ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788528629.511629:0:19473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788528629.511632:0:19473:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788528629.511650:0:19473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c91ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.511668:0:19473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c91a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.511674:0:19473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c91a0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.511681:0:19473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c91a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.511843:0:19473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528629.511847:0:19473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c91a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.511856:0:19473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c91a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.511867:0:19473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c82d0900) 00010000:00010000:0.0:1788528629.511870:0:19473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528629.511874:0:19473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c91a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.511881:0:19473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c91a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.511893:0:19473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c91a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.511900:0:19473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c91a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.511906:0:19473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c91a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.511916:0:19473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850a00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528629.511919:0:19473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c91a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.511925:0:19473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c91a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.511931:0:19473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a8fc27f0a00) 00010000:00010000:0.0:1788528629.511934:0:19473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528629.511936:0:19473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c91a7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.511942:0:19473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c91a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.512022:0:19473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c9199 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c018b expref: 8 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.512034:0:19473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c91ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c018b expref: 7 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.512041:0:19473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a8fc27f0200) 00010000:00010000:0.0:1788528629.512043:0:19473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788528629.512046:0:19473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101850800, rc 0) 00000100:00100000:0.0:1788528629.512161:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dc02331c-9cea-4afd-8708-cba407bdbca8+7:15597:x1875407719758464:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 834us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528629.512168:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 31 00000100:00100000:2.0:1788528629.526140:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528629.530735:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719758592 00000100:00100000:1.0:1788528629.530750:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719758592 00000100:00100000:1.0:1788528629.530873:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:1.0:1788528629.530883:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6feca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:dc02331c-9cea-4afd-8708-cba407bdbca8+5:15597:x1875407719758592:12345-192.168.203.38@tcp:900:lfs.0 00000100:00100000:1.0:1788528629.531162:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6feca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:dc02331c-9cea-4afd-8708-cba407bdbca8+5:15597:x1875407719758592:12345-192.168.203.38@tcp:900:lfs.0 Request processed in 279us (5029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528629.531170:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00080000:3.0:1788528629.536937:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788528629.539212:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528629.542904:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719758848 00000100:00100000:2.0:1788528629.542918:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719758848 00000100:00100000:2.0:1788528629.543094:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 32 00000100:00100000:2.0:1788528629.543106:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dc02331c-9cea-4afd-8708-cba407bdbca8+7:15597:x1875407719758848:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1788528629.543126:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528629.543148:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c91b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0192 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528629.543239:0:17139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788528629.543325:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c91b5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0192 expref: 9 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.543339:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c82d0900) 00010000:00010000:2.0:1788528629.543342:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788528629.543348:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c91b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0192 expref: 9 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528629.543361:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e3800, rc 0) 00000100:00100000:2.0:1788528629.543433:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dc02331c-9cea-4afd-8708-cba407bdbca8+8:15597:x1875407719758848:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 329us (4229us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788528629.543457:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 32 00000100:00100000:2.0:1788528629.549877:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528629.553303:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719759104 00000100:00100000:0.0:1788528629.553319:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719759104 00000100:00100000:0.0:1788528629.553396:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:0.0:1788528629.553407:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dc02331c-9cea-4afd-8708-cba407bdbca8+8:15597:x1875407719759104:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:0.0:1788528629.553460:0:19473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528629.553485:0:19473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c91ae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c018b expref: 8 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.553504:0:19473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a8fc27f0200) 00010000:00010000:0.0:1788528629.553510:0:19473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788528629.553531:0:19473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c91c3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.553544:0:19473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c91c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.553577:0:19473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c91c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788528629.553786:0:19473:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de1bbaa8 reply state 00000000d0f61a8b transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c91c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.553799:0:19473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c91c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.553806:0:19473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a8fc27f0200) 00010000:00010000:0.0:1788528629.553808:0:19473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1788528629.553811:0:19473:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788528629.553818:0:19473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788528629.554024:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dc02331c-9cea-4afd-8708-cba407bdbca8+9:15597:x1875407719759104:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 618us (4154us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788528629.554050:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:3.0:1788528629.556611:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528629.556672:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719759360 00000100:00100000:1.0:1788528629.556680:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719759360 00000100:00100000:1.0:1788528629.556732:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:1.0:1788528629.556741:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dc02331c-9cea-4afd-8708-cba407bdbca8+9:15597:x1875407719759360:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:1.0:1788528629.557176:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dc02331c-9cea-4afd-8708-cba407bdbca8+10:15597:x1875407719759360:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 434us (571us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788528629.557199:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:0.0:1788528629.563136:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528629.563312:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719759616 00000100:00100000:1.0:1788528629.563322:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719759616 00000100:00100000:1.0:1788528629.563390:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 34 00000100:00100000:1.0:1788528629.563400:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dc02331c-9cea-4afd-8708-cba407bdbca8+10:15597:x1875407719759616:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1788528629.563423:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528629.563442:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c91ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0199 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.563511:0:17137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c91d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.563526:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c91d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.563538:0:17137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c91d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.563549:0:17137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14abc00/0x892c60dda91c91d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.563579:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14abc00/0x892c60dda91c91d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.563587:0:17137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14abc00/0x892c60dda91c91d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528629.563685:0:17137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788528629.563769:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c91d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.563793:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c91d1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.563800:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c91d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.563806:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c14aba00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528629.563810:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c91d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.563817:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c91d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.563841:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c82d0900) 00010000:00010000:1.0:1788528629.563844:0:17137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528629.563849:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c91d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.563854:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c91d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.563866:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14abc00/0x892c60dda91c91d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.563872:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14abc00/0x892c60dda91c91d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.563877:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14abc00/0x892c60dda91c91d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.563882:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c14abc00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528629.563891:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14abc00/0x892c60dda91c91d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.563897:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14abc00/0x892c60dda91c91d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.563905:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a8fc27f0a00) 00010000:00010000:1.0:1788528629.563908:0:17137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528629.563910:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14abc00/0x892c60dda91c91d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.563917:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14abc00/0x892c60dda91c91d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.564073:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c91ca lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0199 expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.564084:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c82d0900) 00010000:00010000:1.0:1788528629.564086:0:17137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788528629.564090:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c91ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0199 expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.564101:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c14aae00, rc 0) 00000100:00100000:1.0:1788528629.564167:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dc02331c-9cea-4afd-8708-cba407bdbca8+11:15597:x1875407719759616:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 769us (1040us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1788528629.564175:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 34 00000100:00100000:3.0:1788528629.568412:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528629.568494:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719759744 00000100:00100000:0.0:1788528629.568504:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719759744 00000100:00100000:0.0:1788528629.568580:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 35 00000100:00100000:0.0:1788528629.568590:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dc02331c-9cea-4afd-8708-cba407bdbca8+11:15597:x1875407719759744:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1788528629.568613:0:19473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528629.568634:0:19473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c91e6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c01a0 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.568729:0:19473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c91ed lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.568743:0:19473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c91ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.568753:0:19473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c91ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788528629.568774:0:19473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788528629.568777:0:19473:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788528629.568795:0:19473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c91ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.568817:0:19473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c91e6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01a0 expref: 13 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.568848:0:19473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c91ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01a0 expref: 12 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.568878:0:19473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a8fc27f0200) 00010000:00010000:0.0:1788528629.568881:0:19473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788528629.568885:0:19473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101850a00, rc 0) 00000100:00100000:0.0:1788528629.568944:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dc02331c-9cea-4afd-8708-cba407bdbca8+12:15597:x1875407719759744:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 355us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528629.568960:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 35 00000100:00100000:3.0:1788528629.578939:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528629.579068:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719759872 00000100:00100000:0.0:1788528629.579076:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719759872 00000100:00100000:0.0:1788528629.579141:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:0.0:1788528629.579152:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dc02331c-9cea-4afd-8708-cba407bdbca8+12:15597:x1875407719759872:12345-192.168.203.38@tcp:37:lfs.0 00000100:00100000:0.0:1788528629.588376:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dc02331c-9cea-4afd-8708-cba407bdbca8+12:15597:x1875407719759872:12345-192.168.203.38@tcp:37:lfs.0 Request processed in 9215us (9437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528629.588390:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:3.0:1788528629.595638:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528629.595709:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719760128 00000100:00100000:0.0:1788528629.595719:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719760128 00000100:00100000:0.0:1788528629.595783:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:0.0:1788528629.595793:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dc02331c-9cea-4afd-8708-cba407bdbca8+12:15597:x1875407719760128:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:0.0:1788528629.600020:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dc02331c-9cea-4afd-8708-cba407bdbca8+13:15597:x1875407719760128:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 4215us (4378us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788528629.600035:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4 00000040:00080000:2.0:1788528629.634038:0:17889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788528629.694832:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528629.705476:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528629.706519:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719760256 00000100:00100000:1.0:1788528629.706532:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719760256 00000100:00100000:1.0:1788528629.706642:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:1.0:1788528629.706653:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+11:15603:x1875407719760256:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:1.0:1788528629.706691:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528629.706715:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c91f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c01a7 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.706784:0:17137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14abc00/0x892c60dda91c91fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.706799:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14abc00/0x892c60dda91c91fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.706809:0:17137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14abc00/0x892c60dda91c91fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.706829:0:17137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c9202 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.706837:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c9202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.706844:0:17137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c9202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.707527:0:17137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14ab000/0x892c60dda91c9209 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.707540:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14ab000/0x892c60dda91c9209 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.707549:0:17137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14ab000/0x892c60dda91c9209 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528629.707608:0:17137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788528629.707620:0:17137:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788528629.707661:0:17137:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14ab000/0x892c60dda91c9209 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.707674:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14abc00/0x892c60dda91c91fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.707681:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14abc00/0x892c60dda91c91fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.707687:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14abc00/0x892c60dda91c91fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.707694:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c14abc00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528629.707698:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14abc00/0x892c60dda91c91fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.707705:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14abc00/0x892c60dda91c91fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.707718:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c82d0900) 00010000:00010000:1.0:1788528629.707721:0:17137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528629.707726:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14abc00/0x892c60dda91c91fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.707732:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14abc00/0x892c60dda91c91fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.707747:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c9202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.707753:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c9202 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.707769:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c9202 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.707773:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c14aae00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528629.707776:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c9202 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.707782:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c9202 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.707790:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a8fc27f0a00) 00010000:00010000:1.0:1788528629.707792:0:17137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528629.707795:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c9202 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.707801:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c9202 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.707839:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c91f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01a7 expref: 13 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.707854:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14ab000/0x892c60dda91c9209 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01a7 expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.707862:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a8fc27f0200) 00010000:00010000:1.0:1788528629.707864:0:17137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788528629.707866:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c14ab000, rc 0) 00000100:00100000:1.0:1788528629.708113:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+12:15603:x1875407719760256:12345-192.168.203.38@tcp:101:bash.0 Request processed in 1460us (2643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528629.708131:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:1.0:1788528629.719283:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528629.719383:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719760384 00000100:00100000:0.0:1788528629.719392:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719760384 00000100:00100000:0.0:1788528629.719446:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:0.0:1788528629.719456:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:15603:x1875407719760384:12345-192.168.203.38@tcp:900:bash.0 00000100:00100000:0.0:1788528629.719550:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:15603:x1875407719760384:12345-192.168.203.38@tcp:900:bash.0 Request processed in 94us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528629.719596:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:2.0:1788528629.730419:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528629.730491:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719760640 00000100:00100000:0.0:1788528629.730501:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719760640 00000100:00100000:0.0:1788528629.730602:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:0.0:1788528629.730613:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+12:15603:x1875407719760640:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:0.0:1788528629.730634:0:19473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528629.730657:0:19473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c9210 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c01ae expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.730768:0:19473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c9217 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.730784:0:19473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c91ed lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01a0 expref: 12 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.730794:0:19473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c9217 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.730838:0:19473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c91ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01a0 expref: 12 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.730850:0:19473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c91ed lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01a0 expref: 12 pid: 19473 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528629.730865:0:19473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa64e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19473:1875407735569024:192.168.203.38@tcp:104: 00000100:00100000:0.0:1788528629.731059:0:19473:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c6c8f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788528629.733140:0:19473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa64e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19473:1875407735569024:192.168.203.38@tcp:104: 00010000:00010000:0.0:1788528629.733167:0:19473:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c9217 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528629.734601:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528629.734688:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719760768 00000100:00100000:3.0:1788528629.734696:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719760768 00010000:00010000:3.0:1788528629.734741:0:17122:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c91ed lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01a0 expref: 13 pid: 19473 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528629.734829:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:3.0:1788528629.734841:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc02331c-9cea-4afd-8708-cba407bdbca8+13:2403:x1875407719760768:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788528629.734855:0:17122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528629.734862:0:17122:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c91ed lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01a0 expref: 13 pid: 19473 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528629.734883:0:17122:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c91ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01a0 expref: 13 pid: 19473 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528629.734905:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c91ed lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01a0 expref: 13 pid: 19473 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528629.734921:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a8fc27f0200) 00010000:00010000:3.0:1788528629.734927:0:17122:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c9217 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528629.734936:0:17122:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c9217 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528629.734956:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c9217 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528629.734987:0:17122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528629.735041:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc02331c-9cea-4afd-8708-cba407bdbca8+12:2403:x1875407719760768:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 202us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528629.735049:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 16 00010000:00010000:0.0:1788528629.735069:0:19473:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c9217 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.735078:0:19473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c9217 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.735102:0:19473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c921e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.735112:0:19473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c921e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.735119:0:19473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c921e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.735633:0:19473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c9225 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.735647:0:19473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c9225 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.735654:0:19473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c9225 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788528629.735669:0:19473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788528629.735717:0:19473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c9217 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.735738:0:19473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c9217 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.735749:0:19473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c9217 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.735757:0:19473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528629.735762:0:19473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c9217 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.735770:0:19473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c9217 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.735783:0:19473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a8fc27f0200) 00010000:00010000:0.0:1788528629.735788:0:19473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528629.735792:0:19473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c9217 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.735798:0:19473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c9217 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788528629.735815:0:19473:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009fd7195a reply state 00000000766f32a3 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c921e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.735834:0:19473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c921e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.735843:0:19473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8a90c87be000) 00010000:00010000:0.0:1788528629.735846:0:19473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788528629.735848:0:19473:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788528629.735883:0:19473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c9210 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01ae expref: 15 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.735905:0:19473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c9225 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01ae expref: 14 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.735918:0:19473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:0.0:1788528629.735921:0:19473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788528629.735923:0:19473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101850000, rc 0) 00000100:00100000:0.0:1788528629.735976:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+15:15603:x1875407719760640:12345-192.168.203.38@tcp:101:bash.0 Request processed in 5365us (5566us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788528629.735986:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:2.0:1788528629.757760:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528629.757860:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719760896 00000100:00100000:3.0:1788528629.757879:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719760896 00000100:00100000:3.0:1788528629.757943:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 38 00000100:00100000:3.0:1788528629.757961:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+15:15603:x1875407719760896:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:3.0:1788528629.757985:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528629.758006:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83400/0x892c60dda91c9233 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c01b5 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528629.758067:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83800/0x892c60dda91c923a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528629.758080:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83800/0x892c60dda91c923a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528629.758091:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83800/0x892c60dda91c923a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528629.758142:0:17139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788528629.758146:0:17139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788528629.758167:0:17139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83800/0x892c60dda91c923a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528629.758196:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83800/0x892c60dda91c923a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528629.758223:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83400/0x892c60dda91c9233 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01b5 expref: 17 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528629.758245:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83800/0x892c60dda91c923a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01b5 expref: 16 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528629.758254:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:3.0:1788528629.758257:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788528629.758261:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c6c83800, rc 0) 00000100:00100000:3.0:1788528629.758319:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+16:15603:x1875407719760896:12345-192.168.203.38@tcp:101:bash.0 Request processed in 360us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528629.758327:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 38 00000100:00100000:3.0:1788528629.761408:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528629.763739:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719761152 00000100:00100000:2.0:1788528629.763754:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719761152 00000100:00100000:3.0:1788528629.764496:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:3.0:1788528629.764508:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+16:15603:x1875407719761152:12345-192.168.203.38@tcp:35:bash.0 00000100:00100000:3.0:1788528629.764917:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+17:15603:x1875407719761152:12345-192.168.203.38@tcp:35:bash.0 Request processed in 410us (4047us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788528629.764925:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:2.0:1788528629.894869:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528629.894968:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719761408 00000100:00100000:1.0:1788528629.894978:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719761408 00000100:00100000:1.0:1788528629.895036:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:1.0:1788528629.895045:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+17:15613:x1875407719761408:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1788528629.895067:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528629.895086:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c9241 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c01bc expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528629.895177:0:17138:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788528629.895273:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c9241 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01bc expref: 19 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.895287:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c82d0900) 00010000:00010000:1.0:1788528629.895290:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788528629.895294:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c9241 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01bc expref: 19 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.895309:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c14aae00, rc 0) 00000100:00100000:1.0:1788528629.895368:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+18:15613:x1875407719761408:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 325us (507us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1788528629.895384:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:2.0:1788528629.901168:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528629.901264:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719761664 00000100:00100000:0.0:1788528629.901275:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719761664 00000100:00100000:0.0:1788528629.901332:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:0.0:1788528629.901342:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+18:15613:x1875407719761664:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:0.0:1788528629.901660:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+19:15613:x1875407719761664:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 318us (501us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788528629.901668:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:0.0:1788528629.951151:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735569152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788528629.951229:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528629.951339:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735569152 00000100:00100000:1.0:1788528629.951348:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735569152 00000100:00100000:1.0:1788528629.951410:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788528629.951420:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735569152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788528629.951461:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528629.951507:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735569152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528629.951514:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788528629.952396:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788528629.952451:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735569152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788528629.954888:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735569280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788528629.954961:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528629.955066:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735569280 00000100:00100000:2.0:1788528629.955075:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735569280 00000100:00100000:2.0:1788528629.955149:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788528629.955160:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735569280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788528629.955182:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528629.955229:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735569280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528629.955236:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788528629.955351:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735569280:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788528629.955585:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788528629.958399:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528629.958517:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719761920 00000100:00100000:1.0:1788528629.958528:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719761920 00000100:00100000:1.0:1788528629.958609:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:1.0:1788528629.958619:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+19:15616:x1875407719761920:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1788528629.958643:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528629.958664:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c924f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c01c3 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.958777:0:17137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14abc00/0x892c60dda91c9256 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.958791:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14abc00/0x892c60dda91c9256 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.958806:0:17137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14abc00/0x892c60dda91c9256 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528629.958829:0:17137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788528629.958936:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c924f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01c3 expref: 22 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.958956:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14abc00/0x892c60dda91c9256 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01c3 expref: 21 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.958977:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:1.0:1788528629.958979:0:17137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788528629.958983:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c14abc00, rc 0) 00000100:00100000:1.0:1788528629.959046:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+21:15616:x1875407719761920:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 429us (655us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788528629.959053:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:2.0:1788528629.962505:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528629.962590:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528629.962678:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719762048 00000100:00100000:0.0:1788528629.962687:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719762048 00000100:00100000:0.0:1788528629.962747:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:0.0:1788528629.962757:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+21:2404:x1875407719762048:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788528629.962773:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528629.962809:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14abc00/0x892c60dda91c9256 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01c3 expref: 21 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528629.962839:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:0.0:1788528629.962844:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528629.962903:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+20:2404:x1875407719762048:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 148us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528629.962910:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:1.0:1788528629.962983:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719762176 00000100:00100000:1.0:1788528629.962988:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719762176 00000100:00100000:1.0:1788528629.963025:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:1.0:1788528629.963032:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+20:15616:x1875407719762176:12345-192.168.203.38@tcp:54:lfs.0 00010000:00010000:1.0:1788528629.963087:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c9264 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.963101:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c9264 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.963110:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c9264 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.963143:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c9264 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.963150:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c9264 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.963157:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c9264 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.963163:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c14aba00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528629.963174:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c9264 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.963181:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c9264 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.963190:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:1.0:1788528629.963193:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788528629.963197:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c9264 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528629.963204:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c9264 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528629.963240:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+20:15616:x1875407719762176:12345-192.168.203.38@tcp:54:lfs.0 Request processed in 208us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528629.963246:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:2.0:1788528629.976982:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528629.977085:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719762432 00000100:00100000:0.0:1788528629.977094:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719762432 00000100:00100000:0.0:1788528629.977159:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:0.0:1788528629.977169:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+20:15616:x1875407719762432:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:0.0:1788528629.977387:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+21:15616:x1875407719762432:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 219us (414us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788528629.977395:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7 00000040:00080000:0.0:1788528630.143416:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788528630.368916:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528630.368990:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719762688 00000100:00100000:1.0:1788528630.369001:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719762688 00000100:00100000:1.0:1788528630.369062:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 42 00000100:00100000:1.0:1788528630.369072:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+21:15647:x1875407719762688:12345-192.168.203.38@tcp:101:cat.0 00010000:00010000:1.0:1788528630.369096:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528630.369117:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c926b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c01ca expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528630.369248:0:17137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c9272 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528630.369262:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c9272 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528630.369295:0:17137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c9272 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528630.369307:0:17137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788528630.369428:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c926b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01ca expref: 24 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528630.369447:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c9272 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01ca expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528630.369456:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:1.0:1788528630.369460:0:17137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788528630.369463:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c14aae00, rc 0) 00000100:00100000:1.0:1788528630.369524:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+23:15647:x1875407719762688:12345-192.168.203.38@tcp:101:cat.0 Request processed in 454us (619us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1788528630.369532:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 42 00000100:00100000:2.0:1788528630.375202:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528630.375246:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528630.375341:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719763072 00000100:00100000:0.0:1788528630.375350:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719763072 00000100:00100000:0.0:1788528630.375414:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:0.0:1788528630.375425:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+23:15647:x1875407719763072:12345-192.168.203.38@tcp:35:cat.0 00000100:00100000:0.0:1788528630.375735:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+24:15647:x1875407719763072:12345-192.168.203.38@tcp:35:cat.0 Request processed in 311us (487us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1788528630.375744:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:1.0:1788528630.376194:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719762816 00000100:00100000:1.0:1788528630.376200:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719762816 00000100:00100000:1.0:1788528630.376245:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:1.0:1788528630.376253:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+24:2403:x1875407719762816:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788528630.376264:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528630.376297:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c9272 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01ca expref: 24 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528630.376314:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:1.0:1788528630.376319:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528630.376369:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+23:2403:x1875407719762816:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 105us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528630.376377:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:1.0:1788528630.462916:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735569408:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788528630.462992:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528630.463498:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735569408 00000100:00100000:3.0:1788528630.463507:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735569408 00000100:00100000:3.0:1788528630.463590:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788528630.463601:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735569408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788528630.463636:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788528630.463701:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735569408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528630.463709:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788528630.463754:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735569408:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528630.468440:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528630.468684:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719763328 00000100:00100000:3.0:1788528630.468694:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719763328 00000100:00100000:3.0:1788528630.468757:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:3.0:1788528630.468769:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+23:15653:x1875407719763328:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:3.0:1788528630.468793:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528630.468824:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83400/0x892c60dda91c9280 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c01d1 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528630.468945:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c82400/0x892c60dda91c9287 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528630.468961:0:17138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c9225 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01ae expref: 24 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528630.468970:0:17138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83800/0x892c60dda91c923a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01b5 expref: 24 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528630.468978:0:17138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c82400/0x892c60dda91c9287 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528630.469035:0:17138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83800/0x892c60dda91c923a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01b5 expref: 24 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528630.469049:0:17138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83800/0x892c60dda91c923a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01b5 expref: 24 pid: 17139 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528630.469063:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17138:1875407735569536:192.168.203.38@tcp:104: 00010000:00010000:3.0:1788528630.469158:0:17138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c9225 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01ae expref: 24 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528630.469168:0:17138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c9225 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01ae expref: 24 pid: 19473 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528630.469178:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17138:1875407735569664:192.168.203.38@tcp:104: 00000100:00100000:3.0:1788528630.469201:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c2d79c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788528630.473125:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17138:1875407735569536:192.168.203.38@tcp:104: 00000100:00100000:3.0:1788528630.473139:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17138:1875407735569664:192.168.203.38@tcp:104: 00010000:00010000:3.0:1788528630.473164:0:17138:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c82400/0x892c60dda91c9287 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528630.473633:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528630.473752:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719763456 00000100:00100000:3.0:1788528630.473760:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719763456 00010000:00010000:3.0:1788528630.473791:0:17122:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83800/0x892c60dda91c923a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01b5 expref: 25 pid: 17139 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528630.473836:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:3.0:1788528630.473857:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+25:2404:x1875407719763456:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788528630.473870:0:17122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528630.473876:0:17122:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83800/0x892c60dda91c923a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01b5 expref: 25 pid: 17139 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528630.473888:0:17122:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83800/0x892c60dda91c923a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01b5 expref: 25 pid: 17139 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528630.473907:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83800/0x892c60dda91c923a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01b5 expref: 25 pid: 17139 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528630.473924:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:3.0:1788528630.473928:0:17122:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c82400/0x892c60dda91c9287 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528630.473936:0:17122:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c82400/0x892c60dda91c9287 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528630.473951:0:17122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528630.474012:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+24:2404:x1875407719763456:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 156us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528630.474018:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:2.0:1788528630.474099:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528630.474335:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719763584 00000100:00100000:3.0:1788528630.474348:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719763584 00010000:00010000:3.0:1788528630.474364:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c9225 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01ae expref: 24 pid: 19473 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528630.474392:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:3.0:1788528630.474404:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6dd2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+24:2405:x1875407719763584:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788528630.474413:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528630.474419:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c9225 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01ae expref: 24 pid: 19473 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528630.474438:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c9225 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01ae expref: 24 pid: 19473 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528630.474453:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c9225 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01ae expref: 24 pid: 19473 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528630.474464:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:3.0:1788528630.474468:0:17124:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c82400/0x892c60dda91c9287 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528630.474475:0:17124:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c82400/0x892c60dda91c9287 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528630.474483:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c82400/0x892c60dda91c9287 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528630.474505:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528630.474529:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6dd2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+23:2405:x1875407719763584:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 126us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528630.474536:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 18 00010000:00010000:3.0:1788528630.474609:0:17138:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c82400/0x892c60dda91c9287 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528630.474616:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c82400/0x892c60dda91c9287 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528630.474639:0:17138:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788528630.474777:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83400/0x892c60dda91c9280 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01d1 expref: 24 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528630.474791:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c82400/0x892c60dda91c9287 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01d1 expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528630.474798:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:3.0:1788528630.474800:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788528630.474802:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c6c82400, rc 0) 00000100:00100000:3.0:1788528630.474835:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+23:15653:x1875407719763328:12345-192.168.203.38@tcp:101:dd.0 Request processed in 6070us (6406us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1788528630.474841:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:0.0:1788528630.489909:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528630.490213:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719763712 00000100:00100000:1.0:1788528630.490222:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719763712 00000100:00100000:1.0:1788528630.491617:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:1.0:1788528630.491636:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+23:15653:x1875407719763712:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:1.0:1788528630.491660:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528630.491690:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c9295 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c01d8 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528630.491724:0:17137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c929c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528630.491737:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c929c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528630.491747:0:17137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c929c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528630.491874:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aae00/0x892c60dda91c9295 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01d8 expref: 25 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528630.491892:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c929c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01d8 expref: 24 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528630.491900:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:1.0:1788528630.491908:0:17137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788528630.491912:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c14aba00, rc 0) 00000100:00100000:1.0:1788528630.491993:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+24:15653:x1875407719763712:12345-192.168.203.38@tcp:101:dd.0 Request processed in 364us (2096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528630.492000:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:3.0:1788528630.498592:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528630.506688:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719763968 00000100:00100000:2.0:1788528630.506703:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719763968 00000100:00100000:2.0:1788528630.506774:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:2.0:1788528630.506784:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+24:15653:x1875407719763968:12345-192.168.203.38@tcp:36:dd.0 00010000:00010000:2.0:1788528630.507357:0:19473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2000/0x892c60dda91c92a3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528630.507375:0:19473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2000/0x892c60dda91c92a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528630.507386:0:19473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2000/0x892c60dda91c92a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788528630.507425:0:19473:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788528630.507447:0:19473:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c3a1775 reply state 00000000ef638b20 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2000/0x892c60dda91c92a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528630.507458:0:19473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2000/0x892c60dda91c92a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528630.507465:0:19473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:2.0:1788528630.507468:0:19473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788528630.507472:0:19473:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788528630.507576:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+27:15653:x1875407719763968:12345-192.168.203.38@tcp:36:dd.0 Request processed in 792us (9032us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788528630.507584:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 45 00000020:00080000:2.0:1788528630.507588:0:19473:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788528630.519338:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528630.520231:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719764096 00000100:00100000:3.0:1788528630.520243:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719764096 00000100:00100000:3.0:1788528630.520443:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 46 00000100:00100000:3.0:1788528630.520456:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+27:15653:x1875407719764096:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:3.0:1788528630.520483:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528630.520508:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83400/0x892c60dda91c92aa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c01df expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528630.520604:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83400/0x892c60dda91c92aa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01df expref: 28 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528630.520621:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83400/0x892c60dda91c92aa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01df expref: 28 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528630.520809:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:2.0:1788528630.520822:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788528630.520833:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c6c83400, rc 0) 00000100:00100000:2.0:1788528630.520970:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+28:15653:x1875407719764096:12345-192.168.203.38@tcp:101:dd.0 Request processed in 516us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528630.520979:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 46 00000100:00100000:0.0:1788528630.559751:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528630.560744:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719764352 00000100:00100000:3.0:1788528630.560756:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719764352 00000100:00100000:2.0:1788528630.561461:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:2.0:1788528630.561475:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+28:15653:x1875407719764352:12345-192.168.203.38@tcp:103:dd.0 00010000:00010000:2.0:1788528630.561490:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528630.561513:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c83400/0x892c60dda91c92aa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01df expref: 28 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528630.561537:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:2.0:1788528630.561542:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528630.561658:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+27:15653:x1875407719764352:12345-192.168.203.38@tcp:103:dd.0 Request processed in 186us (1914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528630.561667:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:3.0:1788528630.565729:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528630.565832:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719764480 00000100:00100000:0.0:1788528630.565853:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719764480 00000100:00100000:0.0:1788528630.565905:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 47 00000100:00100000:0.0:1788528630.565914:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+27:15653:x1875407719764480:12345-192.168.203.38@tcp:58:dd.0 00010000:00010000:0.0:1788528630.566019:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c92b1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528630.566035:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c92b1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528630.566046:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c92b1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788528630.569153:0:17138:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788528630.569493:0:17138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788528630.569714:0:17138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788528630.569896:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+27:15653:x1875407719764480:12345-192.168.203.38@tcp:58:dd.0 Request processed in 3976us (4168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528630.569908:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 47 00000100:00100000:1.0:1788528630.575681:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528630.575862:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719764608 00000100:00100000:0.0:1788528630.575874:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719764608 00000100:00100000:2.0:1788528630.576035:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:2.0:1788528630.576049:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+27:15653:x1875407719764608:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1788528630.576069:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528630.576248:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2a00/0x892c60dda91c92b8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c01e6 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528630.576306:0:17139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c92b1 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528630.576317:0:17139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2a00/0x892c60dda91c92b8 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01e6 expref: 28 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528630.576356:0:17139:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c92b1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528630.576371:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2a00/0x892c60dda91c92b8 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01e6 expref: 28 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528630.576383:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:2.0:1788528630.576386:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788528630.576390:0:17139:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2a00/0x892c60dda91c92b8 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01e6 expref: 28 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528630.576398:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e2a00, rc 0) 00000100:00100000:2.0:1788528630.576507:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+28:15653:x1875407719764608:12345-192.168.203.38@tcp:101:dd.0 Request processed in 461us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528630.576514:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 48 00010000:00010000:1.0:1788528630.719456:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528630.974911:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735569792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788528630.974981:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528630.975205:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735569792 00000100:00100000:1.0:1788528630.975213:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735569792 00000100:00100000:1.0:1788528630.975287:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788528630.975296:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735569792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788528630.975325:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788528630.975388:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735569792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528630.975395:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788528630.975798:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788528630.975962:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735569792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788528630.976387:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735570176:0@lo:400:kworker.0 00000100:00100000:3.0:1788528630.976435:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528630.976464:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735570688:0@lo:400:kworker.0 00000100:00100000:3.0:1788528630.976487:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528630.976505:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1875407735571200:0@lo:400:kworker.0 00000100:00100000:3.0:1788528630.976529:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528630.976549:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788528630.976575:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735570304:0@lo:400:kworker.0 00000100:00100000:3.0:1788528630.976597:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528630.976613:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735570816:0@lo:400:kworker.0 00000100:00100000:3.0:1788528630.976633:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528630.976646:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735571328:0@lo:400:kworker.0 00000100:00100000:3.0:1788528630.976667:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528630.976690:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735570176 00000100:00100000:3.0:1788528630.976696:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735570176 00000100:00100000:3.0:1788528630.976730:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735570688 00000100:00100000:3.0:1788528630.976732:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735570688 00000100:00100000:3.0:1788528630.976742:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735570304 00000100:00100000:3.0:1788528630.976745:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735570304 00000100:00100000:3.0:1788528630.976765:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788528630.976771:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735570176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528630.976842:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735570176:12345-0@lo:400:kworker.0 Request processed in 70us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528630.976849:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788528630.976878:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788528630.976885:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735570688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528630.976923:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735570688:12345-0@lo:400:kworker.0 Request processed in 39us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528630.976929:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788528630.976940:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788528630.976946:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735570304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528630.976969:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735570304:12345-0@lo:400:kworker.0 Request processed in 24us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528630.976974:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788528630.976991:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788528630.977253:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735570048:0@lo:400:kworker.0 00000100:00100000:3.0:1788528630.977286:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528630.977307:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735570560:0@lo:400:kworker.0 00000100:00100000:3.0:1788528630.977327:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528630.977341:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735571072:0@lo:400:kworker.0 00000100:00100000:3.0:1788528630.977374:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528630.977395:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788528630.977401:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:463b8984-c30b-4b73-b2f1-81113bd4e10a:3638:1875407735569920:0@lo:400:kworker.0 00000100:00100000:3.0:1788528630.977430:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528630.977455:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735570432:0@lo:400:kworker.0 00000100:00100000:3.0:1788528630.977477:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528630.977497:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735570944:0@lo:400:kworker.0 00000100:00100000:3.0:1788528630.977521:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528630.977543:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735569920 00000100:00100000:3.0:1788528630.977548:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735569920 00000100:00100000:3.0:1788528630.977602:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788528630.977610:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:3638:x1875407735569920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528630.977645:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:3638:x1875407735569920:12345-0@lo:400:kworker.0 Request processed in 37us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528630.977652:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788528630.977678:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735570048 00000100:00100000:3.0:1788528630.977682:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735570048 00000100:00100000:3.0:1788528630.977698:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735570560 00000100:00100000:3.0:1788528630.977701:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735570560 00000100:00100000:3.0:1788528630.977713:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788528630.977719:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735570048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528630.977751:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735570048:12345-0@lo:400:kworker.0 Request processed in 32us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528630.977758:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788528630.977770:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788528630.977775:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735570560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528630.977803:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735570560:12345-0@lo:400:kworker.0 Request processed in 28us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528630.977808:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788528630.977854:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735570304:0@lo:400:kworker.0 00000100:00100000:3.0:1788528630.978281:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735570176:0@lo:400:kworker.0 00000100:00100000:3.0:1788528630.978292:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735570688:0@lo:400:kworker.0 00000100:00100000:3.0:1788528630.978336:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:463b8984-c30b-4b73-b2f1-81113bd4e10a:3638:1875407735569920:0@lo:400:kworker.0 00000100:00100000:3.0:1788528630.978345:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735570048:0@lo:400:kworker.0 00000100:00100000:3.0:1788528630.978354:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735570560:0@lo:400:kworker.0 00000100:00100000:0.0:1788528630.978488:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735571200 00000100:00100000:0.0:1788528630.978493:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735571200 00000100:00100000:0.0:1788528630.978529:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735570816 00000100:00100000:0.0:1788528630.978533:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735570816 00000100:00100000:0.0:1788528630.978544:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735571328 00000100:00100000:0.0:1788528630.978546:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735571328 00000100:00100000:0.0:1788528630.978577:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735571072 00000100:00100000:0.0:1788528630.978580:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735571072 00000100:00100000:0.0:1788528630.978590:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735570432 00000100:00100000:0.0:1788528630.978592:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735570432 00000100:00100000:0.0:1788528630.978601:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735570944 00000100:00100000:0.0:1788528630.978603:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735570944 00000100:00100000:0.0:1788528630.978626:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788528630.978632:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875407735571200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528630.978682:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875407735571200:12345-0@lo:400:kworker.0 Request processed in 51us (2151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528630.978689:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788528630.978703:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788528630.978709:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735570816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528630.978736:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735570816:12345-0@lo:400:kworker.0 Request processed in 28us (2103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528630.978741:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788528630.978754:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788528630.978759:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6fef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735571328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528630.978784:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6fef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735571328:12345-0@lo:400:kworker.0 Request processed in 26us (2116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528630.978790:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788528630.978799:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788528630.978805:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4677100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875407735571072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528630.978845:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4677100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875407735571072:12345-0@lo:400:kworker.0 Request processed in 41us (1482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528630.978851:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788528630.978862:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788528630.978867:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735570432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528630.979150:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788528630.979160:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735570944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528630.979195:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735570944:12345-0@lo:400:kworker.0 Request processed in 38us (1673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528630.979201:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1788528630.979251:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788528630.979255:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788528630.979306:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788528630.979319:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735571456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788528630.979352:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528630.979487:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735570432:12345-0@lo:400:kworker.0 Request processed in 25us (1414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528630.979496:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788528630.979539:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735570816:0@lo:400:kworker.0 00010000:00080000:0.0:1788528630.979571:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc467f100 x1875407735571328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528630.979581:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735571328:0@lo:400:kworker.0 00000100:00100000:0.0:1788528630.979593:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1875407735571200:0@lo:400:kworker.0 00000100:00100000:3.0:1788528630.979684:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735570432:0@lo:400:kworker.0 00000100:00100000:3.0:1788528630.979695:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735570944:0@lo:400:kworker.0 00010000:00080000:3.0:1788528630.979706:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc467ca80 x1875407735571072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528630.979714:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735571072:0@lo:400:kworker.0 00000100:00100000:1.0:1788528630.979825:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788528630.979836:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735571584:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788528630.979865:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528630.982720:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735571584 00000100:00100000:0.0:1788528630.982735:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735571584 00000100:00100000:0.0:1788528630.982803:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788528630.982823:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735571584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788528630.982867:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788528630.982967:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735571584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 156us (3099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528630.982974:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788528630.983190:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735571584:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788528630.985417:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735571456 00000100:00100000:2.0:1788528630.985432:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735571456 00000100:00100000:2.0:1788528630.985500:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788528630.985511:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735571456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788528630.985536:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788528630.985637:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735571456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (6283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528630.985643:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788528630.986143:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735571456:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788528631.167048:0:17173:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788528631.167058:0:17173:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788528631.167110:0:17173:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788528631.167121:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788528631.167270:0:17173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17173:1875407735571712:192.168.203.38@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788528631.167371:0:17173:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c6c8f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528631.172411:0:17173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17173:1875407735571712:192.168.203.38@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788528631.172697:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528631.172885:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719764736 00000100:00100000:2.0:1788528631.172894:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719764736 00000100:00100000:2.0:1788528631.172967:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:2.0:1788528631.172978:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+28:15656:x1875407719764736:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788528631.173009:0:17139:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788528631.173158:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+28:15656:x1875407719764736:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 Request processed in 181us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528631.173166:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00080000:3.0:1788528631.173367:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788528631.178264:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528631.179093:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719764864 00000100:00100000:2.0:1788528631.179104:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719764864 00000100:00100000:2.0:1788528631.179172:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 50 00000100:00100000:2.0:1788528631.179183:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+28:15656:x1875407719764864:12345-192.168.203.38@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788528631.179257:0:17137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2e00/0x892c60dda91c92bf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.179274:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2e00/0x892c60dda91c92bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.179287:0:17137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2e00/0x892c60dda91c92bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.179382:0:17137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c92c6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.179392:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c92c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.179399:0:17137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c92c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.179422:0:17137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c92cd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.179432:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c92cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.179438:0:17137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c92cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528631.179483:0:17137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788528631.179487:0:17137:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788528631.179499:0:17137:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c92cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.179509:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2e00/0x892c60dda91c92bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.179515:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2e00/0x892c60dda91c92bf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.179522:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2e00/0x892c60dda91c92bf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.179538:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e2e00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528631.179543:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2e00/0x892c60dda91c92bf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.179599:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2e00/0x892c60dda91c92bf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.179612:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a8fc27f0d00) 00010000:00010000:2.0:1788528631.179615:0:17137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528631.179620:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2e00/0x892c60dda91c92bf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.179627:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2e00/0x892c60dda91c92bf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.179640:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c92c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.179646:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c92c6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.179651:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c92c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.179656:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e3000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528631.179659:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c92c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.179665:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c92c6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.179683:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8a8fc27f0500) 00010000:00010000:2.0:1788528631.179686:0:17137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528631.179689:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c92c6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.179695:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c92c6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.179709:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c92cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.179716:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c92cd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.179722:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c92cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.179727:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e2600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528631.179730:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c92cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.179736:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c92cd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.179743:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:2.0:1788528631.179746:0:17137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528631.179749:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c92cd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.179755:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c92cd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528631.180302:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+28:15656:x1875407719764864:12345-192.168.203.38@tcp:34:lhsmtool_posix.0 Request processed in 1117us (2043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528631.180312:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 50 00000100:00100000:1.0:1788528631.183255:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528631.183336:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719765120 00000100:00100000:2.0:1788528631.183345:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719765120 00000100:00100000:2.0:1788528631.183403:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:2.0:1788528631.183413:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+28:15656:x1875407719765120:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788528631.183434:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528631.183464:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c92d4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c01ed expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.183597:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2800/0x892c60dda91c92db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.183612:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2800/0x892c60dda91c92db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.183623:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2800/0x892c60dda91c92db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528631.183634:0:17139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788528631.183712:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2800/0x892c60dda91c92db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.183719:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2800/0x892c60dda91c92db lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.183725:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2800/0x892c60dda91c92db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.183746:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e2800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528631.183750:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2800/0x892c60dda91c92db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.183758:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2800/0x892c60dda91c92db lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.183770:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:2.0:1788528631.183773:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788528631.183777:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2800/0x892c60dda91c92db lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.183783:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2800/0x892c60dda91c92db lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.183996:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c92d4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01ed expref: 30 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.184007:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a8fc27f0d00) 00010000:00010000:2.0:1788528631.184009:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788528631.184013:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c92d4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01ed expref: 30 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.184023:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e3800, rc 0) 00000100:00100000:2.0:1788528631.184122:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+29:15656:x1875407719765120:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 710us (877us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1788528631.184129:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:3.0:1788528631.188870:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528631.188938:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719765248 00000100:00100000:0.0:1788528631.188953:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719765248 00000100:00100000:0.0:1788528631.189024:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:0.0:1788528631.189036:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+29:15656:x1875407719765248:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788528631.189085:0:17138:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788528631.189224:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+29:15656:x1875407719765248:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 Request processed in 189us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528631.189232:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:1.0:1788528631.192337:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528631.192419:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719765504 00000100:00100000:0.0:1788528631.192429:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719765504 00000100:00100000:0.0:1788528631.192483:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:0.0:1788528631.192492:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+29:15656:x1875407719765504:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788528631.192511:0:19473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528631.192530:0:19473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c92e9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c01f4 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788528631.193159:0:19473:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:0.0:1788528631.193167:0:19473:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:0.0:1788528631.193185:0:19473:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:0.0:1788528631.193327:0:19473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c92f0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.193342:0:19473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c92f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.193354:0:19473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c92f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.193407:0:19473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850800/0x892c60dda91c92e9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01f4 expref: 32 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.193425:0:19473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c92f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01f4 expref: 31 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.193441:0:19473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a90c87be200) 00010000:00010000:0.0:1788528631.193444:0:19473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788528631.193447:0:19473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101850a00, rc 0) 00000100:00100000:0.0:1788528631.193506:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+31:15656:x1875407719765504:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 1014us (1177us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1788528631.193513:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:1.0:1788528631.197059:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528631.197248:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719765760 00000100:00100000:2.0:1788528631.197279:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719765760 00000100:00100000:2.0:1788528631.197340:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:2.0:1788528631.197350:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+31:15656:x1875407719765760:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788528631.197404:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528631.197430:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850a00/0x892c60dda91c92f0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01f4 expref: 31 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.197450:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a90c87be200) 00010000:00010000:2.0:1788528631.197461:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788528631.197482:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c92fe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.197498:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c92fe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.197508:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c92fe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.197585:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c9305 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2a678597 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.197594:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c9305 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2a678597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.197600:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c9305 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2a678597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.197642:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c92fe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.197650:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c92fe lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.197665:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c92fe lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.197671:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e2600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528631.197687:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c92fe lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.197695:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c92fe lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.197704:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a8fc27f0200) 00010000:00010000:2.0:1788528631.197707:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528631.197710:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c92fe lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.197716:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c92fe lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.199101:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c9305 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2a678597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.199118:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c9305 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2a678597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.199126:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c9305 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2a678597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.199131:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e3000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528631.199135:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c9305 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2a678597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.199161:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c9305 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2a678597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.199175:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x2a678597 (ffff8a8fc27f0500) 00010000:00010000:2.0:1788528631.199178:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528631.199182:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c9305 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2a678597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.199190:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c9305 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2a678597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528631.199293:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+30:15656:x1875407719765760:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 1941us (2238us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788528631.199302:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:3.0:1788528631.203652:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528631.203769:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719765888 00000100:00100000:0.0:1788528631.203779:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719765888 00000100:00100000:0.0:1788528631.203841:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 55 00000100:00100000:0.0:1788528631.203850:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+30:15656:x1875407719765888:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788528631.203869:0:19473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528631.203892:0:19473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c930c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c01fb expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.203926:0:19473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c9313 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.203948:0:19473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c9313 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.203959:0:19473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c9313 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.204061:0:19473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850000/0x892c60dda91c930c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01fb expref: 32 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.204079:0:19473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c9313 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01fb expref: 31 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.204093:0:19473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a90c87be400) 00010000:00010000:0.0:1788528631.204096:0:19473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788528631.204099:0:19473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031a00, rc 0) 00000100:00100000:0.0:1788528631.204144:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+31:15656:x1875407719765888:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 295us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528631.204151:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 55 00000100:00100000:1.0:1788528631.212729:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528631.212871:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719766144 00000100:00100000:2.0:1788528631.212881:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719766144 00000100:00100000:2.0:1788528631.212949:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:2.0:1788528631.212961:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+31:15656:x1875407719766144:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788528631.213041:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c931a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.213059:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c931a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.213071:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c931a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788528631.213244:0:17138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1788528631.213254:0:17138:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 500430699977ns, next at 501430697666ns, rc = 0 00000004:00010000:2.0:1788528631.213326:0:17138:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000795d2ee1 reply state 0000000092567b65 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c931a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.213339:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c931a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.213348:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a90c87be400) 00010000:00010000:2.0:1788528631.213351:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788528631.213355:0:17138:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788528631.213462:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+33:15656:x1875407719766144:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 502us (741us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788528631.213469:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:1.0:1788528631.226526:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528631.226661:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719766272 00000100:00100000:0.0:1788528631.226771:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719766272 00000100:00100000:0.0:1788528631.226900:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:0.0:1788528631.226912:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+33:15656:x1875407719766272:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788528631.226946:0:19473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528631.226968:0:19473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c9321 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0202 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.227027:0:19473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c9321 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0202 expref: 34 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.227042:0:19473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c9321 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0202 expref: 34 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.227061:0:19473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a90c87be400) 00010000:00010000:0.0:1788528631.227064:0:19473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788528631.227068:0:19473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0030a00, rc 0) 00000100:00100000:0.0:1788528631.227175:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+34:15656:x1875407719766272:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 265us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528631.227200:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:0.0:1788528631.232116:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528631.232283:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719766400 00000100:00100000:3.0:1788528631.232293:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719766400 00000100:00100000:3.0:1788528631.232406:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:3.0:1788528631.232418:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2403:x1875407719766400:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788528631.232715:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+6:2403:x1875407719766400:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 Request processed in 299us (607us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788528631.232740:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:1.0:1788528631.235655:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00080000:2.0:1788528631.236428:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788528631.237006:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719766656 00000100:00100000:0.0:1788528631.237017:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719766656 00000100:00100000:0.0:1788528631.237085:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:0.0:1788528631.237095:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+34:15656:x1875407719766656:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788528631.237321:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+35:15656:x1875407719766656:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 226us (1674us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1788528631.237328:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:1.0:1788528631.240787:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528631.241173:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719766912 00000100:00100000:2.0:1788528631.241183:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719766912 00000100:00100000:2.0:1788528631.241244:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:2.0:1788528631.241254:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+35:15656:x1875407719766912:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788528631.241381:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+35:15656:x1875407719766912:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 127us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528631.241389:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:3.0:1788528631.244921:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528631.245174:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719767040 00000100:00100000:2.0:1788528631.245184:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719767040 00000100:00100000:2.0:1788528631.245250:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:2.0:1788528631.245261:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+35:15656:x1875407719767040:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788528631.245282:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528631.245301:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c9328 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0209 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.245387:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c932f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.245401:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c932f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.245413:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c932f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528631.245456:0:17139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788528631.245474:0:17139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c932f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.245501:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c9328 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0209 expref: 37 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.245518:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c932f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0209 expref: 36 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.245526:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a90c87be400) 00010000:00010000:2.0:1788528631.245529:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788528631.245532:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e3800, rc 0) 00000100:00100000:2.0:1788528631.245633:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+36:15656:x1875407719767040:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 373us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528631.245641:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:1.0:1788528631.256239:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528631.256364:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719767168 00000100:00100000:0.0:1788528631.256373:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719767168 00000100:00100000:0.0:1788528631.256447:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:0.0:1788528631.256457:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+6:2404:x1875407719767168:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788528631.256475:0:18643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528631.256496:0:18643:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb838b4a/0x892c60dda91c9336 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0210 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788528631.256528:0:18643:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ac7f7, blocks: 0x0 00010000:00010000:0.0:1788528631.256548:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=500s v=(0 0) 00010000:00010000:0.0:1788528631.256589:0:18643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788528631.256599:0:18643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb838b4a/0x892c60dda91c9336 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0210 expref: 7 pid: 18643 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.256617:0:18643:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb838b4a/0x892c60dda91c9336 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0210 expref: 7 pid: 18643 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.256646:0:18643:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031c00, rc 0) 00000100:00100000:0.0:1788528631.256711:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+7:2404:x1875407719767168:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 255us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528631.256718:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:1.0:1788528631.268665:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528631.268823:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719767424 00000100:00100000:2.0:1788528631.268833:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719767424 00000100:00100000:2.0:1788528631.268892:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:2.0:1788528631.268910:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+36:15656:x1875407719767424:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788528631.269028:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+36:15656:x1875407719767424:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 120us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528631.269036:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:3.0:1788528631.272310:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528631.272541:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719767552 00000100:00100000:0.0:1788528631.272588:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719767552 00000100:00100000:0.0:1788528631.272649:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 61 00000100:00100000:0.0:1788528631.272659:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+36:15656:x1875407719767552:12345-192.168.203.38@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788528631.282447:0:17117:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:3.0:1788528631.282467:0:17117:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788528631.282525:0:17117:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:2.0:1788528631.282659:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c91c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282659:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3200/0x892c60dda91c916f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.282672:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c91c3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282687:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3200/0x892c60dda91c916f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.282690:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c91c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282693:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3200/0x892c60dda91c916f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.282697:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528631.282698:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e3200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528631.282702:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c91c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282702:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3200/0x892c60dda91c916f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.282711:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c91c3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282711:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3200/0x892c60dda91c916f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.282727:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a8fc27f0200) 00010000:00010000:0.0:1788528631.282727:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a8fc27f0a00) 00010000:00010000:2.0:1788528631.282730:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788528631.282730:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528631.282735:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c91c3 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282735:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3200/0x892c60dda91c916f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.282740:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850400/0x892c60dda91c91c3 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282752:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3200/0x892c60dda91c916f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282769:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3600/0x892c60dda91c9176 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282774:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3600/0x892c60dda91c9176 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282779:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3600/0x892c60dda91c9176 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282784:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e3600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528631.282786:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3600/0x892c60dda91c9176 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282791:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3600/0x892c60dda91c9176 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282798:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a8fc27f0200) 00010000:00010000:0.0:1788528631.282800:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528631.282803:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3600/0x892c60dda91c9176 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282807:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3600/0x892c60dda91c9176 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282829:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c921e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282835:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c921e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282845:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c921e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282850:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528631.282852:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c921e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282858:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c921e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282866:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8a90c87be000) 00010000:00010000:0.0:1788528631.282867:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528631.282870:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c921e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282875:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850200/0x892c60dda91c921e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282888:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2000/0x892c60dda91c92a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282895:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2000/0x892c60dda91c92a3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282901:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2000/0x892c60dda91c92a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282905:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e2000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528631.282907:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2000/0x892c60dda91c92a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528631.282913:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+17:15656:x1875407719767552:12345-192.168.203.38@tcp:44:lhsmtool_posix.0 Request processed in 10251us (10608us total) trans 0 rc 0/0 00010000:00010000:0.0:1788528631.282923:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2000/0x892c60dda91c92a3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528631.282932:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 61 00010000:00010000:0.0:1788528631.282941:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:0.0:1788528631.282943:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788528631.282946:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2000/0x892c60dda91c92a3 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282952:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2000/0x892c60dda91c92a3 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282962:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c931a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282968:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c931a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282974:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c931a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282979:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e3000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528631.282983:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c931a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282988:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c931a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.282996:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a90c87be400) 00010000:00010000:0.0:1788528631.282998:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788528631.283001:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c931a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.283016:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c931a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528631.283250:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735571840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788528631.283313:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528631.284294:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735571840 00000100:00100000:1.0:1788528631.284304:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735571840 00000100:00100000:1.0:1788528631.284361:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788528631.284370:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735571840:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788528631.284497:0:18644:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788528631.284500:0:18644:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788528631.284502:0:18644:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788528631.284504:0:18644:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788528631 -> 1788528631 00002000:00010000:1.0:1788528631.284506:0:18644:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788528631.284549:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1875407735571840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 180us (1236us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788528631.284576:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:0.0:1788528631.284658:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a90fe690380/2, rc 0, transno 8589934596 00000100:00100000:0.0:1788528631.284664:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735571840:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788528631.293144:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528631.295486:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719767680 00000100:00100000:0.0:1788528631.295502:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719767680 00000100:00100000:0.0:1788528631.295591:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:0.0:1788528631.295601:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+7:2403:x1875407719767680:12345-192.168.203.38@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788528631.295732:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+7:2403:x1875407719767680:12345-192.168.203.38@tcp:16:lhsmtool_posix.0 Request processed in 131us (2596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528631.295739:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:3.0:1788528631.302647:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528631.308527:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719767936 00000100:00100000:2.0:1788528631.308548:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719767936 00000100:00100000:2.0:1788528631.308699:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 62 00000100:00100000:2.0:1788528631.308710:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+15:15656:x1875407719767936:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788528631.308765:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528631.308792:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c932f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0209 expref: 15 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.308824:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a90c87be400) 00010000:00010000:2.0:1788528631.308830:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788528631.308864:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c933d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.308878:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c933d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.308887:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c933d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788528631.309030:0:17138:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000218955e5 reply state 00000000743c594a transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c933d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.309043:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c933d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.309050:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a90c87be400) 00010000:00010000:2.0:1788528631.309053:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788528631.309069:0:17138:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788528631.309195:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+16:15656:x1875407719767936:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 486us (6556us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788528631.309202:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 62 00000100:00100000:3.0:1788528631.314184:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528631.314325:0:19172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719768064 00000100:00100000:0.0:1788528631.314335:0:19172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719768064 00000100:00100000:0.0:1788528631.314395:0:19172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:0.0:1788528631.314406:0:19172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+7:15656:x1875407719768064:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788528631.314423:0:19172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528631.314443:0:19172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ac40608/0x892c60dda91c9344 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0217 expref: -99 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.314473:0:19172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb838b4a/0x892c60dda91c9336 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0210 expref: 8 pid: 18643 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.314500:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788528631.314504:0:19172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788528631.314510:0:19172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ac40608/0x892c60dda91c9344 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0217 expref: 8 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.314544:0:19172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb838b4a/0x892c60dda91c9336 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0210 expref: 8 pid: 18643 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.314576:0:19172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb838b4a/0x892c60dda91c9336 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0210 expref: 8 pid: 18643 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528631.314590:0:19172:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19172:1875407735571968:192.168.203.38@tcp:104: 00000100:00100000:0.0:1788528631.314662:0:19172:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c6c8f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528631.319140:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528631.319247:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719768192 00000100:00100000:2.0:1788528631.319257:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719768192 00010000:00010000:2.0:1788528631.319301:0:17123:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb838b4a/0x892c60dda91c9336 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0210 expref: 9 pid: 18643 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528631.319346:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:2.0:1788528631.319368:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+9:2404:x1875407719768192:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528631.319402:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528631.319425:0:17123:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb838b4a/0x892c60dda91c9336 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0210 expref: 9 pid: 18643 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.319440:0:17123:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb838b4a/0x892c60dda91c9336 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0210 expref: 9 pid: 18643 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.319467:0:17123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528631.319472:0:17123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528631.319479:0:17123:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009ac40608/0x892c60dda91c9344 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0217 expref: 9 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.319490:0:17123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ac40608/0x892c60dda91c9344 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0217 expref: 9 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.319526:0:17123:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009ac40608/0x892c60dda91c9344 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0217 expref: 9 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528631.319550:0:17123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17123:1875407735572096:192.168.203.38@tcp:105: 00000100:00100000:2.0:1788528631.319666:0:17123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d93240 going to sleep for 11 seconds 00010000:00010000:0.0:1788528631.320148:0:19172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb838b4a/0x892c60dda91c9336 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0210 expref: 9 pid: 18643 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528631.320165:0:19172:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19172:1875407735571968:192.168.203.38@tcp:104: 00010000:00010000:0.0:1788528631.320190:0:19172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009ac40608/0x892c60dda91c9344 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0217 expref: 8 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.320202:0:19172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101850200, rc 0) 00000100:00100000:0.0:1788528631.320252:0:19172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+8:15656:x1875407719768064:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 5847us (6074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528631.320270:0:19172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:2.0:1788528631.322901:0:17123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17123:1875407735572096:192.168.203.38@tcp:105: 00010000:00010000:2.0:1788528631.322928:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528631.322991:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+7:2404:x1875407719768192:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 3636us (3860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528631.323002:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:3.0:1788528631.323819:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528631.323894:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719768320 00000100:00100000:2.0:1788528631.323903:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719768320 00000100:00100000:2.0:1788528631.324025:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:2.0:1788528631.324036:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+7:2404:x1875407719768320:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788528631.324297:0:18646:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788528631.324301:0:18646:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788528630 00002000:00010000:2.0:1788528631.324314:0:18646:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788528629 00002000:00010000:2.0:1788528631.324317:0:18646:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788528631 -> 1788528630 00002000:00010000:2.0:1788528631.324319:0:18646:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788528631.324426:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+8:2404:x1875407719768320:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 Request processed in 384us (609us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788528631.324434:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:0.0:1788528631.329216:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528631.329309:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719768448 00000100:00100000:1.0:1788528631.329319:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719768448 00000100:00100000:1.0:1788528631.329393:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 29 00000100:00100000:1.0:1788528631.329403:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+8:2404:x1875407719768448:12345-192.168.203.38@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788528631.329445:0:18644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000065caa322/0x892c60dda91c934b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528631.329467:0:18644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009ac40608/0x892c60dda91c9344 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0217 expref: 8 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528631.329476:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788528631.329481:0:18644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788528631.329486:0:18644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065caa322/0x892c60dda91c934b lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528631.329533:0:18644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009ac40608/0x892c60dda91c9344 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0217 expref: 8 pid: 19172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528631.329547:0:18644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009ac40608/0x892c60dda91c9344 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0217 expref: 8 pid: 19172 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528631.329578:0:18644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18644:1875407735572224:192.168.203.38@tcp:104: 00000100:00100000:1.0:1788528631.329654:0:18644:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d82ce600 going to sleep for 11 seconds 00000100:00100000:1.0:1788528631.332763:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528631.332857:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719768576 00000100:00100000:0.0:1788528631.332867:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719768576 00010000:00010000:0.0:1788528631.332904:0:17122:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009ac40608/0x892c60dda91c9344 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0217 expref: 9 pid: 19172 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528631.332961:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:0.0:1788528631.332970:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+9:2404:x1875407719768576:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788528631.333004:0:17122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528631.333026:0:17122:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009ac40608/0x892c60dda91c9344 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0217 expref: 9 pid: 19172 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.333040:0:17122:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009ac40608/0x892c60dda91c9344 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0217 expref: 9 pid: 19172 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.333064:0:17122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788528631.333068:0:17122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788528631.333074:0:17122:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000065caa322/0x892c60dda91c934b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.333083:0:17122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065caa322/0x892c60dda91c934b lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.333103:0:17122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528631.333164:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+9:2404:x1875407719768576:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 195us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528631.333172:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 20 00010000:00010000:3.0:1788528631.333714:0:18644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ac40608/0x892c60dda91c9344 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0217 expref: 8 pid: 19172 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528631.333730:0:18644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18644:1875407735572224:192.168.203.38@tcp:104: 00010000:00010000:3.0:1788528631.333750:0:18644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000065caa322/0x892c60dda91c934b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.333760:0:18644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000065caa322/0x892c60dda91c934b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.333768:0:18644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065caa322/0x892c60dda91c934b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.333789:0:18644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000065caa322/0x892c60dda91c934b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.333832:0:18644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065caa322/0x892c60dda91c934b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.333840:0:18644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065caa322/0x892c60dda91c934b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.333847:0:18644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c14aae00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528631.333851:0:18644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065caa322/0x892c60dda91c934b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.333861:0:18644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065caa322/0x892c60dda91c934b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.333875:0:18644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065caa322/0x892c60dda91c934b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.333883:0:18644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065caa322/0x892c60dda91c934b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528631.334049:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+7:2404:x1875407719768448:12345-192.168.203.38@tcp:1:lhsmtool_posix.0 Request processed in 4646us (4840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528631.334058:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 29 00000100:00100000:1.0:1788528631.338162:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528631.338256:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719768832 00000100:00100000:2.0:1788528631.338266:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719768832 00000100:00100000:2.0:1788528631.338337:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:2.0:1788528631.338347:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+16:15656:x1875407719768832:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788528631.338451:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c9352 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.338469:0:17139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c929c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01d8 expref: 16 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.338478:0:17139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c9352 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.338515:0:17139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c929c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01d8 expref: 16 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.338529:0:17139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c929c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01d8 expref: 16 pid: 17137 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528631.338543:0:17139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17139:1875407735572352:192.168.203.38@tcp:104: 00000100:00100000:2.0:1788528631.338667:0:17139:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d93240 going to sleep for 11 seconds 00000100:00100000:1.0:1788528631.341753:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528631.341834:0:17139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17139:1875407735572352:192.168.203.38@tcp:104: 00000100:00100000:3.0:1788528631.341843:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719768960 00000100:00100000:3.0:1788528631.341850:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719768960 00010000:00010000:2.0:1788528631.341862:0:17139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c9352 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.341885:0:17123:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c929c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01d8 expref: 17 pid: 17137 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528631.341945:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:3.0:1788528631.341955:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+17:2403:x1875407719768960:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788528631.341970:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528631.341977:0:17123:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c929c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01d8 expref: 17 pid: 17137 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.341989:0:17123:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c929c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01d8 expref: 17 pid: 17137 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.342011:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aba00/0x892c60dda91c929c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01d8 expref: 17 pid: 17137 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.342027:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:3.0:1788528631.342034:0:17123:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2a00/0x892c60dda91c92b8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01e6 expref: 16 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.342043:0:17123:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c9352 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.342051:0:17123:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c9352 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.342059:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c9352 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.342087:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788528631.342107:0:17139:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c9352 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.342115:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c9352 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528631.342142:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+16:2403:x1875407719768960:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 188us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528631.342155:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 21 00010000:00010000:2.0:1788528631.343123:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2800/0x892c60dda91c9359 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.343146:0:17139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c9321 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0202 expref: 16 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.343350:0:17139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2800/0x892c60dda91c9359 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.343384:0:17139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c9321 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0202 expref: 16 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.343399:0:17139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c9321 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0202 expref: 16 pid: 19473 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528631.343413:0:17139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17139:1875407735572480:192.168.203.38@tcp:104: 00000100:00100000:2.0:1788528631.343654:0:17139:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d936c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528631.349077:0:17139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17139:1875407735572480:192.168.203.38@tcp:104: 00000100:00100000:1.0:1788528631.349085:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00010000:00010000:2.0:1788528631.349107:0:17139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2800/0x892c60dda91c9359 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528631.349385:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719769088 00000100:00100000:0.0:1788528631.349392:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719769088 00010000:00010000:0.0:1788528631.349427:0:17122:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c9321 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0202 expref: 17 pid: 19473 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528631.349466:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:0.0:1788528631.349476:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+17:2404:x1875407719769088:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788528631.349489:0:17122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528631.349496:0:17122:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c9321 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0202 expref: 17 pid: 19473 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.349508:0:17122:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c9321 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0202 expref: 17 pid: 19473 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.349529:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c9321 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0202 expref: 17 pid: 19473 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.349544:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a90c87be400) 00010000:00010000:0.0:1788528631.349549:0:17122:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2800/0x892c60dda91c9359 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.349578:0:17122:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2800/0x892c60dda91c9359 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.349585:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2800/0x892c60dda91c9359 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.349629:0:17122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528631.349691:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+16:2404:x1875407719769088:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 216us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528631.349698:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 22 00010000:00010000:2.0:1788528631.349844:0:17139:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2800/0x892c60dda91c9359 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.349852:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2800/0x892c60dda91c9359 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788528631.349966:0:17139:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1788528631.350076:0:17139:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788528631.350110:0:17139:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1788528631.350183:0:17139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17139:1875407735572608:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788528631.350240:0:17139:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528631.350275:0:17139:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d93240 going to sleep for 11 seconds 00000100:00100000:0.0:1788528631.350374:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735572608 00000100:00100000:0.0:1788528631.350380:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735572608 00000100:00100000:0.0:1788528631.350424:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788528631.350432:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17139:x1875407735572608:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788528631.350510:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17139:x1875407735572608:12345-0@lo:1000:mdt00_002.0 Request processed in 79us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528631.350516:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788528631.351481:0:17139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17139:1875407735572608:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788528631.351896:0:17139:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1788528631.352060:0:17139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17139:1875407735572736:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788528631.352107:0:17139:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528631.352137:0:17139:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f8db7300 going to sleep for 11 seconds 00000100:00100000:1.0:1788528631.352193:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735572736 00000100:00100000:1.0:1788528631.352200:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735572736 00000100:00100000:1.0:1788528631.352244:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788528631.352252:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17139:x1875407735572736:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788528631.352384:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17139:x1875407735572736:12345-0@lo:1000:mdt00_002.0 Request processed in 132us (276us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1788528631.352391:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788528631.353177:0:17139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17139:1875407735572736:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788528631.353225:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2800/0x892c60dda91c9359 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.353235:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2800/0x892c60dda91c9359 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.353242:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2800/0x892c60dda91c9359 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.353248:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e2800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528631.353252:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2800/0x892c60dda91c9359 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.353259:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2800/0x892c60dda91c9359 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.353273:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a90c87be400) 00010000:00010000:3.0:1788528631.353276:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788528631.353281:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2800/0x892c60dda91c9359 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.353287:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2800/0x892c60dda91c9359 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.353334:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c92b1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.353340:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c92b1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.353346:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c92b1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.353352:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528631.353354:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c92b1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.353520:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c92b1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.353530:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:3.0:1788528631.353533:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788528631.353539:0:17139:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2a00/0x892c60dda91c92b8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01e6 expref: 19 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.353549:0:17139:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2a00/0x892c60dda91c92b8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01e6 expref: 19 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.353577:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2a00/0x892c60dda91c92b8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01e6 expref: 19 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.353607:0:17139:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2a00/0x892c60dda91c92b8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01e6 expref: 19 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528631.353634:0:17139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17139:1875407735572864:192.168.203.38@tcp:105: 00000100:00100000:3.0:1788528631.353779:0:17139:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f8db7300 going to sleep for 11 seconds 00000100:00100000:1.0:1788528631.357260:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528631.357328:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719769216 00000100:00100000:0.0:1788528631.357337:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719769216 00000100:00100000:0.0:1788528631.357392:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:0.0:1788528631.357403:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d16a6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+20:15653:x1875407719769216:12345-192.168.203.38@tcp:49:dd.0 00000100:00100000:0.0:1788528631.357619:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d16a6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+20:15653:x1875407719769216:12345-192.168.203.38@tcp:49:dd.0 Request processed in 217us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528631.357627:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:3.0:1788528631.365944:0:17139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17139:1875407735572864:192.168.203.38@tcp:105: 00010000:00010000:3.0:1788528631.365982:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c92b1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.365993:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101850600/0x892c60dda91c92b1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.366028:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c82e00/0x892c60dda91c9360 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.366042:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c82e00/0x892c60dda91c9360 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.366054:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c82e00/0x892c60dda91c9360 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.366065:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c82e00/0x892c60dda91c9360 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.366072:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c82e00/0x892c60dda91c9360 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.366078:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c82e00/0x892c60dda91c9360 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.366083:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c6c82e00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528631.366087:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c82e00/0x892c60dda91c9360 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.366108:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c82e00/0x892c60dda91c9360 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.366120:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:3.0:1788528631.366124:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528631.366127:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c82e00/0x892c60dda91c9360 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.366133:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c82e00/0x892c60dda91c9360 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.366143:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c9352 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.366148:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c9352 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.366154:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c9352 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.366159:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e3800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528631.366162:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c9352 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.366168:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c9352 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.366176:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:3.0:1788528631.366178:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788528631.366181:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c9352 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528631.366197:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3800/0x892c60dda91c9352 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528631.366293:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000040:00080000:0.0:1788528631.366453:0:17173:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788528631.366457:0:17173:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788528631.366485:0:17173:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788528631.366491:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788528631.366732:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+19:15656:x1875407719768832:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 28385us (28582us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1788528631.366743:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 63 00000020:00080000:3.0:1788528631.366748:0:17139:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788528631.371531:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719769344 00000100:00100000:2.0:1788528631.371547:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719769344 00000100:00100000:2.0:1788528631.371635:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:2.0:1788528631.371646:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+19:15653:x1875407719769344:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1788528631.371665:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528631.371689:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2e00/0x892c60dda91c9367 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c021e expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.371723:0:17137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c936e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.371737:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c936e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.371748:0:17137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c936e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.371873:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2e00/0x892c60dda91c9367 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c021e expref: 21 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.371892:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c936e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c021e expref: 20 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.371900:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:2.0:1788528631.371904:0:17137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788528631.371908:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e3000, rc 0) 00000100:00100000:2.0:1788528631.373545:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+20:15653:x1875407719769344:12345-192.168.203.38@tcp:101:dd.0 Request processed in 1892us (7244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528631.373583:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:0.0:1788528631.374904:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528631.378970:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719769600 00000100:00100000:2.0:1788528631.378985:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719769600 00000100:00100000:2.0:1788528631.379051:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:2.0:1788528631.379060:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+20:15656:x1875407719769600:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788528631.379601:0:17140:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788528631.379637:0:17140:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1788528631.379672:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2000/0x892c60dda91c9375 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.379690:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2000/0x892c60dda91c9375 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.379701:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2000/0x892c60dda91c9375 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.379710:0:17140:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2000/0x892c60dda91c9375 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.379717:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2000/0x892c60dda91c9375 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.379723:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2000/0x892c60dda91c9375 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.379736:0:17140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788528631.379839:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+22:15656:x1875407719769600:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 778us (4938us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788528631.379847:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 11 00000020:00080000:2.0:1788528631.379868:0:17140:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788528631.379933:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528631.379940:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2000/0x892c60dda91c9375 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.379964:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e2000 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528631.379969:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2000/0x892c60dda91c9375 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.379977:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2000/0x892c60dda91c9375 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.379990:0:17125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a90c87be400) 00010000:00010000:0.0:1788528631.379993:0:17125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788528631.379999:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2000/0x892c60dda91c9375 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.380005:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2000/0x892c60dda91c9375 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.380019:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528631.380021:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528631.380022:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528631.577468:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528631.577509:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528631.577815:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719769728 00000100:00100000:2.0:1788528631.577826:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719769728 00000100:00100000:2.0:1788528631.577890:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719769856 00000100:00100000:2.0:1788528631.577893:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719769856 00000100:00100000:2.0:1788528631.577913:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:2.0:1788528631.577922:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+8:2405:x1875407719769728:12345-192.168.203.38@tcp:4:dd.0 00002000:00010000:2.0:1788528631.577971:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9ac7f6, atime: 0x6a9ac7f5, ctime: 0x6a9ac7f6, blocks: 0x0 00010000:00010000:2.0:1788528631.577980:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000254d805a/0x892c60dda91c937c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.578001:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1788528631.578005:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528631.578012:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000254d805a/0x892c60dda91c937c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.578026:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000254d805a/0x892c60dda91c937c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788528631.680320:0:19458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:3.0:1788528631.680340:0:19458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:2.0:1788528631.680982:0:18650:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1788528631.680988:0:18650:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1788528630 -> 1788528631 00002000:00010000:2.0:1788528631.680991:0:18650:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788528630 -> 1788528631 00002000:00010000:2.0:1788528631.680993:0:18650:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:2.0:1788528631.681011:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000254d805a/0x892c60dda91c937c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.681024:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000254d805a/0x892c60dda91c937c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.681053:0:18650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000254d805a/0x892c60dda91c937c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.681060:0:18650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e2e00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528631.681065:0:18650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000254d805a/0x892c60dda91c937c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.681074:0:18650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000254d805a/0x892c60dda91c937c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.681092:0:18650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000254d805a/0x892c60dda91c937c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.681101:0:18650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000254d805a/0x892c60dda91c937c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528631.681217:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+6:2405:x1875407719769728:12345-192.168.203.38@tcp:4:dd.0 Request processed in 103291us (103763us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788528631.681227:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:2.0:1788528631.681257:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:2.0:1788528631.681268:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2405:x1875407719769856:12345-192.168.203.38@tcp:4:dd.0 00002000:00010000:2.0:1788528631.681301:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 4194304, mtime: 0x6a9ac7f7, atime: 0x6a9ac7f5, ctime: 0x6a9ac7f7, blocks: 0x2000 00010000:00010000:2.0:1788528631.681307:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e407c76/0x892c60dda91c9383 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.681327:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1788528631.681332:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528631.681338:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e407c76/0x892c60dda91c9383 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528631.681349:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e407c76/0x892c60dda91c9383 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528631.746478:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788528631.751720:0:19458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:1.0:1788528631.751893:0:18650:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:1.0:1788528631.751898:0:18650:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:1.0:1788528631.751936:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e407c76/0x892c60dda91c9383 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528631.751949:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e407c76/0x892c60dda91c9383 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528631.751958:0:18650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e407c76/0x892c60dda91c9383 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528631.751965:0:18650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e3600 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528631.751970:0:18650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e407c76/0x892c60dda91c9383 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528631.751980:0:18650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e407c76/0x892c60dda91c9383 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528631.751998:0:18650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e407c76/0x892c60dda91c9383 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528631.752107:0:18650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e407c76/0x892c60dda91c9383 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528631.752304:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2405:x1875407719769856:12345-192.168.203.38@tcp:4:dd.0 Request processed in 71035us (174790us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788528631.752318:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1 00010000:00010000:1.0:1788528632.766859:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528633.030316:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528633.031063:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528633.031099:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528633.031130:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528633.031161:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528633.031192:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719770496 00000100:00100000:3.0:1788528633.031202:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719770496 00000100:00100000:3.0:1788528633.031268:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719771008 00000100:00100000:3.0:1788528633.031271:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719771008 00000100:00100000:3.0:1788528633.031305:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:3.0:1788528633.031316:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2405:x1875407719770496:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528633.031403:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2405:x1875407719770496:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 88us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528633.031412:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:3.0:1788528633.031438:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:3.0:1788528633.031447:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dc02331c-9cea-4afd-8708-cba407bdbca8+5:2405:x1875407719771008:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528633.031495:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dc02331c-9cea-4afd-8708-cba407bdbca8+5:2405:x1875407719771008:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 49us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528633.031503:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00080000:3.0:1788528633.031526:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788528633.031547:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719770240 00000100:00100000:3.0:1788528633.031551:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719770240 00000100:00100000:3.0:1788528633.031615:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719770752 00000100:00100000:3.0:1788528633.031619:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719770752 00000100:00100000:3.0:1788528633.031655:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 62 00000100:00100000:3.0:1788528633.031665:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2405:x1875407719770240:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528633.031699:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2405:x1875407719770240:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 36us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528633.031708:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 62 00000100:00100000:3.0:1788528633.031730:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:3.0:1788528633.031740:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dc02331c-9cea-4afd-8708-cba407bdbca8+5:2405:x1875407719770752:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528633.031769:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dc02331c-9cea-4afd-8708-cba407bdbca8+5:2405:x1875407719770752:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 32us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528633.031777:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00080000:3.0:1788528633.031816:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788528633.031850:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528633.034635:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528633.034760:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719769984 00000100:00100000:0.0:1788528633.034770:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719769984 00000100:00100000:0.0:1788528633.034838:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 182 00000100:00100000:0.0:1788528633.034848:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1823b577-e6d1-43c4-8232-3cf51fabc1da+14:2405:x1875407719769984:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528633.034910:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1823b577-e6d1-43c4-8232-3cf51fabc1da+14:2405:x1875407719769984:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 63us (4604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528633.034929:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 182 00000100:00100000:0.0:1788528633.034972:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719770368 00000100:00100000:0.0:1788528633.034976:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719770368 00000100:00100000:0.0:1788528633.035009:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:0.0:1788528633.035030:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2405:x1875407719770368:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528633.035056:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2405:x1875407719770368:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (3137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528633.035063:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00080000:0.0:1788528633.035081:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788528633.035096:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719770112 00000100:00100000:0.0:1788528633.035099:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719770112 00000100:00080000:0.0:1788528633.035115:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788528633.035142:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:0.0:1788528633.035148:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+22:2405:x1875407719770112:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528633.035177:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+22:2405:x1875407719770112:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 29us (3330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528633.035184:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:3.0:1788528633.042266:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528633.042301:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528633.042502:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719770880 00000100:00100000:3.0:1788528633.042511:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719770880 00000100:00100000:3.0:1788528633.042584:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:3.0:1788528633.042610:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dc02331c-9cea-4afd-8708-cba407bdbca8+5:2405:x1875407719770880:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528633.043002:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dc02331c-9cea-4afd-8708-cba407bdbca8+5:2405:x1875407719770880:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 393us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528633.043010:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:0.0:1788528633.043399:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719770624 00000100:00100000:0.0:1788528633.043405:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719770624 00000100:00100000:0.0:1788528633.043443:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 65 00000100:00100000:0.0:1788528633.043450:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dc02331c-9cea-4afd-8708-cba407bdbca8+6:2405:x1875407719770624:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528633.043491:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dc02331c-9cea-4afd-8708-cba407bdbca8+6:2405:x1875407719770624:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 42us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528633.043498:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 65 00000100:00080000:0.0:1788528633.043515:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788528633.043519:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1788528633.750011:0:20315:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1788528633.791226:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528634.815776:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528635.074952:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c81a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735572992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788528635.075045:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528635.075185:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735572992 00000100:00100000:3.0:1788528635.075194:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735572992 00000100:00100000:3.0:1788528635.075256:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788528635.075267:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735572992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788528635.075295:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788528635.075336:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735572992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528635.075342:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1788528635.076481:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788528635.076531:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c81a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735572992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788528635.077859:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788528635.078341:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735573120:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788528635.078402:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528635.078526:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735573120 00000100:00100000:3.0:1788528635.078534:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735573120 00000100:00100000:3.0:1788528635.078667:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788528635.078677:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc467d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735573120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788528635.078698:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788528635.078746:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc467d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735573120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528635.078753:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788528635.078875:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788528635.079080:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735573120:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788528635.589255:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788528635.589279:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735573248:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788528635.589347:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528635.590319:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735573248 00000100:00100000:2.0:1788528635.590329:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735573248 00000100:00100000:2.0:1788528635.590403:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788528635.590413:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c81a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735573248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788528635.590459:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788528635.590521:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c81a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735573248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528635.590528:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788528635.590607:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735573248:0@lo:41:osp-pre-0-1.0 Debug log: 44242 lines, 44242 kept, 0 dropped, 0 bad.